You certainly can, however, you'll need an iron Pick to mine it. You'll also need to kill a few wolves to get the cloak for cold protection. Then, look for visible Silver outcroppings; then, whenever you see/find a golem mark the spot and once you kill him dig in the area of his spawn until you find the silver vein....90% of the time they're close to a silver vein.

What I do is: get enough iron from the swamp to make a pick and huntsman's bow level 2; go to the mountains where I hear wolves...move into the snow and throw down a fire and try to snipe the wolves that you hear (you'll need a trophy and skins). Once I have the cloak I begin to hunt exposed silver veins and golems. I always make Drauger Fang first then the armor. This mostly trivializes anything in the swamp.

Arach