I fully excavate silver veins before I mine them. The walls are (usually) steep enough that wolves and golems can't reach me.