Requirements for frost caves:

*Tall mountains, Heights at least around obsidian range. Moder-type mountain ranges.

*......yeah that's about all i can recall actually.

They are pretty easy to spot, just look for mist and stalactites for the entrance. Inside, ice walls can be destroyed so keep that in mind. I won't spoil the rest.