They are annoying, but they're only in the black forest, so once you're out of there you don't have to worry about them.

In the mountains you have the drake, which are (IMO) worse!