Then put up walls and dig a trench around your base. I get attacked all the time with little to no damage. Heck, sometimes I just ignore them.