Earthworks > stone walls. Raise up the earth around your villa and you're now nice and safe inside. Btw, you should be hunting trolls and have fully upgraded troll armor and fine bow before you go into the swamp.