Greydwarves in general. All types. At the point you reach the swamp they're just annoying. Don't add any fun to the game... don't add any challenge too. They're just pests that interrupt your play even if you just chill in your meadow base and try to build some pretty buildings/town/docks etc...