That's why better to start a new world - I've found 3 caves on the nearest mountain in 10 minutes run from the start location
For other continents just look through the horizon - game renders mountains from very far distance. When you've found high enough, head there, leave your ship, wait for the day w/o blizzard and start searching