Pickaxes are the only weapon type they are weak to. You'll need to dodge their attacks, and then jump attack with a pickaxe from behind. You can attack without jumping but that's just as likely to end up with a hole in the ground causing you more issues. Dodge, don't try to block with the pickaxe the Golems hit too hard.