The first thing that goes up/down are fences and trenches where possible. Otherwise when the raids happen, get away from the house and keep their attention without killing them for however long the raid goes. I think it's 90 seconds. Then you can kill them without them regenerating.