Raise a 3-4m wall around the pit, with vertical walls so that enemies couldn't climb it.
If the top of the pit is level with the ground, the loxes can easily be sniped by fulings or whatever raids your base while unable to fight back.