Go back to your main base and make small incursions into the forest. Once you're familiar with the environment, learn how to kill trolls and get troll leather.

Once you got a full set, or even two pieces of lvl 1 troll armor, grey dwarves will be nothing but a nuisance to you.