Greydwarves are supposed to fear fire,
but I'm not sure if that would keep them away from attacking a workbench, when you place a torch next to them.
That would help to see attackers during night times though.
Which is also another thing:
Spawns at night are a lot more common for greydwarves,
so it might be a good idea to sleep them away when close to a black forest.