world edits increase your world file size, which affects load/save speed.
I can't think workbenches are that much info.
Performance other that file size? The game appears to load a radius around the player where enemy are active and spawning and wandering etc. Past that radius nothing is loaded, and nothing is happening, so your workbench and boat dock in the far north are not affecting your house at the spawn point.