Early game, you can even build a raft to explore other islands, but it's really slow and dangerous. Traveling around gets a lot easier as you progress. Progression is largely tied to finding new materials by exploring and crafting things with them.