Originally posted by Cockroach:

Put down some work benches. It stops spawning. I have done it and it works.

Thank you, this solved my problem :)
For me they would spawn 2 min after i killed one, so it was impossible to mine the silver ore without distraction :)