The more bosses you defeat, the more types of enemies will attack during raid events. Just wait until drakes start to join the fun! You could use devcommands to do away with the raids. If you want to play the game as is, you'll need to incorporate defenses into your building plans. I'd say the least ugly way is either digging moats, or building in naturally isolated places as you suggested.