Yes, the map marker shows up from a larger distance than your revealed map area. Usually you can find it by going along the shoreline, or if it's a large forest, just walk down the middle of it. No need to uncover every single inch of the map.