If you want your peace of mind, knock out the bosses on one world and build your base on another. You can take everything with your character on any world.