Originally posted by DarthTanyon:

Sounds like night time.

The only time I get attacked by a 5 pack of graydwarves is if it is night time.. OR if there is a spawner near by but then it's usually a slow trickle of one at a time.

As others have said work benches/camp fires should reduce nearby spawns.

I'm not active at night and will go to sleep when it gets cold out. I wasn't thinking of it when I made my post but this base was started with an abandoned stone tower at the center of it.

I don't have stone tech yet so I haven't been able to repair any of the pieces, maybe that means it's still seen as 'owned' by the graydwarves and that's why they're attacking so frequently?