at night - groups of 4-5 greydwarfs spawn around you in a distant
also around 1-2 graydwarf shamans and at least 1 greydwarf berserker. they will follow sounds, lights and fighting noises and attack on sight

at day - groups 1-3 greydwarvs spawn around you maybe 1 shaman but not very often

also keep in mind - often black forest structures (ruins, old towers) have seperate groups of greydwarfs mostly 3-5 greydwarfes and a shaman, and sometimes a berserker

check out for purple-ish fires in the forest those are spawners for all types of greydwarfs
if possible take em out

so. dont do stuff at night when near or in the black forest until you are good equipped

found this out during my latest project - where i cleared a larger portion of the black forest
https://steamcommunity.com/sharedfiles/filedetails/?id=2677500860