They are weak to fire. If you snipe them with fire arrows before they see you a no star greydwarf will go down in one hit. Except for the shaman and the brute they are also afraid of fire and will run from you if you are holding a lit torch.