I generally try to not pre-explore the map. That being said, I have been staging different game play concepts and peaking a bit. My key is to find a seed I like, create a world. Then forget about it for a while, come back later when I can then explore. Just can't study the map too much, just make sure it has the features I want.