caves got walls you can knock down. A totally empty one is unusual. Not impossible, but double check it.
Caves are a little rare. If you had seen the mountain before the caves were released, none will spawn there (old world?).
Otherwise keep trying. Thankfully you don't need too many of them to get all you would need from them. I think 5 or so should get you enough for 1 person with any luck.