I would skip the hut altogether. Just sneak through the portal when you need to...as long as you are 'undetected', nothing will bother it.

Of course, if say a drake and a stone gollem are squabbling nearby it could take some collateral damage so there are risks...but a couple stake walls aren't going to help much in that situation either.