Once you discover the location it will stay on the map even if you didn't get close to Haldor's camp.