They'll be in mountains, but the mountains have to be above a certain minimum height and/or larger than a certain minimum area, and they also have to be more than 500m away from any point you've already explored. Any mountainous areas that are within 500m of a point you've already explored will have been fully drawn in, without caves, and changes to the game don't affect areas that have already been drawn.