I've gotten a couple in about 20-25 caves I think. But the RNG range of the caves (from nothing to overflowing with loot) is wild for how comparatively rare they are. If you are unlucky just a couple of times, getting the full set can get really tedious.