There is no way a whole village didn't hit it a few times. The red ones are dangerous, but not immortal. And the odds of getting 2 at once without mods is astronomical.

But you deal with the the same way you do anything else that is annoying. Find or raise a terrain bit and shoot them. They 'fly' (it appears to be an enhanced jump, possibly with feather fall) sorta but they can't get up there if you don't make it very wide. Then a couple min with the crossbow or fire stick and the problem goes away.