Wooden pole fence around the base helps a lot and should be number one priority. At least in my games enemies haven't been very interested in destroying the fence and they'll chase other biome npc's instead.