I dont have the best system personally so I do tend to be a bit sensitive to lag in this game, but even so it still only really comes up in the areas I have a ridiculously massive base or base features like patrolling pets that leave a ton of drops all over the place as they chain aggro on nearby mobs. I also end up leaving workbenches all over the place, especially in the early game where I only get a relatively short distance of the map uncovered before night falls again so i will find myself making mini-camps with a fire and workbench out of various shelters I find along the way (or sometimes just the fire in some places like inside of caves, shelter is already a given in those areas).

The only real issue I've come across in doing so is that if the workbench is left out in the open/visible, then nearby mobs will attack it on sight; but as others mentioned, unused areas are also unloaded while the player is away so this is an occurrence you mostly stumble across when running through an area you havent been in a while and seeing damage numbers pop up in the mid-distance as you approach those structures. If they get destroyed while Im completely away, I at least havent noticed it (which admittedly, is possible for how many i end up placing and how little i care to check on them later).