Attack circle is not big so if you split liveing quarters, crafting stations and beast pens into separate clusters bit far from one another those will be easier to fortify with stone walls and protect. Shorter perimeter makes mobs more likely to focus you instead of stucking on bordering constructions. Far away connected with portals or just half minute of run from one another works prity much the same.

Also forget dirt walls and trenches. Build on world-made island and be good for life.