um, you can block 100% of their damage and one, maybe two shot kill them with black metal gear.

They also fall to a couple needle arrows if you get one of the hits sneaked out of a maxed out bow.

There isnt any fixing needing to defend your home though. The invasions get worse and worse so you need that moat or a lofted terrain platform or your own island etc to keep it all safe.