When we try to organize the packages in the All category, we just drag and drop them but they won't stay in the place where we want them to be. Though it works for the other.
In order to organize the packages in ALL categories, please go to Marketplace > Packages > Grid view (NOT LIST view). Click on "Edit Order" and then you can move the packages around via drag & drop.
Once the order is saved, the public store will display the packages in the new order.