I would not be too worried unless you have circumnavigated your map east, west, north & south. It does not take too many Frost Caves explored to make 2 full sets of Fenris Armor. Give Mistland biomes a wide berth when sailing.