There is an additional benefit to creating a small village with separate outbuildings, each containing a specific base structure, especially if one tries to space them at least 40 metres apart. The prerequisites for triggering invasion events require the player to be within 40 meters of at least 3 base structures (this is not required for the "You are being hunted..." event).

Most of my remote headquarters are abandoned Draugr villages, where I have repaired and repurposed all the buildings. I never place a forge, workbench, stone-cutter in the same building, nor does my bedchamber have any crafting structures in close proximity. Rather than level ground for gardening plots I will take down an outbuilding or two, leaving me with a perfectly level and decent sized gardening plot. The best benefit is I never get invaded, and no lag means gardening is still fun.