Not that i'm trying to make you break your oath, but have you made it to the fastest boats in the game? because in my opinion they feel slow until the best one. it can also make a difference if you know how to sail with the wind or not, there are pretty good guides on it. since ore is so heavy, it is the best way i have found to move around ore at a quick speed, because the game is a series of islands EVERYWHERE and wandering into a higher level bio-me too early to explore can get you killed so sailing to a new spot and landing in a safe bio-me can be a better option in my opinion.

If you REALLY want to just be on your island, you could teleport ore in from another world, but if want to kill all the bosses and clear the game you will need to sail to their spawn locations because they are all over the place, at least they were for me. hope that helps!