You might be too close to a spawner or spawn location for them. Typically they only attack once a day or once every couple days for me. If you're chopping down a lot of trees, you'll attract them from much further out- Which is bad if you're building relatively close to the border of a black forest biome.

I would say decidedly abnormal for it to be as often as every 2-5 mins.