Yeah that just makes the map for new players who join your game no longer available. That does NOT mean that the map for YOU will be cleared. I doubt that would help respawn frost caves.

Do what I did: Reroll the same seed. I did not regret it.