I am sixty years old. I kill trolls with no armor to speak of and a level one crude bow as well as wood arrows.

They're no problem once you know how to deal with them. No moat required.

Oh, and wait till you see abominations... wait... stone golems... wait one more... Lox.

They are much harder than trolls. But equally manageable.