If mobs cannot get in touch with you, they start demolishing your structures. So, go climb a rock... ah, no, I mean, go and attack the mobs.