There are loads of silver out there. Easy finds at the top of most high points/peaks. Usually multiple veins at the top.

I looked by searching visually when i first played until i heard about using stagbreaker/hammer weapon. After that i laughed at how much i found. It's very plentiful.