Due to OPs stated experience I am going to assume it was a mod issue.

Drauger can wander pretty far away from a swamp/village chasing stuff around but I think the OP would have mentioned being near a swamp/village.

And the whole inside fence thing.... ha ha didn't just wander in I suppose.

Friendly reminder that modding is done at your own risk.