If you make a large enough area covered by work benches with a decent moat they won't even spawn in for the event. And if they do they should be far enough away to just stand around.