Originally posted by Zaflis:

Greydwarves don't spawn in meadows biome unless it's night. You may see graylings but they can be beaten even with your fists. Or just run away from them while gathering something more useable, they might quickly fall behind.

It was in the middle of the day. I didn't actually know whether the spawn was really close to a Black Forest biome, though. Or whether that's even possible.