is it the event horde attacks that are annoying you? like "the forest grows restless" - or is it just that greydwarves have way too high of a spawn rate?

if its the first one...thats weird. those raids don't (shouldn't...) happen that often, and the only time you should be facing large amounts of greydwarves are the raids, or if you go exploring at night (seriously, the spawnrate is even MORE nuts at night....use a bed).

If its the second one....well....thats just how it is. The spawnrate of greydwarves is pretty absurd, and they will regularly harrass you over and over and over....and over....and over.

Solutions:

Build a pit or wall that they can't cross. If its a pit or cliff, they'll see you and throw rocks if you're close enough. If its a wall, they can attack it if they see you, but they won't see you as easily....and you can at least ignore them for a few minutes and finish what you were doing before disposing of their rude, interrupting selves.

Also, you could ring your base (or mining sites) with campfires. It will keep the greydwarves far enough away that they likely won't even attempt to hurl rocks...but you have to maintain the fires if you want to keep them, and it only works on greydwarves....not skeletons or trolls.