Sometimes the best thing to do is just lead them away from the base and take a death if you can't avoid their attacks. You can wait out the raid event and then try to kill them. If you fail and you're far enough away from the base then they most likely won't go back and destroy it. Otherwise you can take five(?) deaths in a row and the enemies should automatically despawn. I had trolls tearing into my base once when I had no way of taking them down so I just quickly took the deaths to get rid of them.