First off, boats get faster. The raft goes a fraction of the speed of the Karve, and the Longboat goes even faster. (wind permitting)
Then there are portals, you just can't take ores or ingots through them.
Its best to build near water access as it allows you to easily move large amounts of stuff around later on, as the Longboat has 18 inventory slots.