There literally can be troll invasions in the meadow, lol. And yes just build a moat or kill good-er. If you're hanging out in the mountains then I assume draugrs are no problem for you.