You can slightly reconsider things; just pretend that Greydwarves are tree spirits, and that for each fallen tree two of them will spawn. Granted this doesn't really explain their number, but it's a start.