You can completely cover the area near your base with workbenches so they have nowhere to spawn. Just sandwich them between 2 stone walls so enemies can't see them and they won't attack them.