try Valheim Plus, it has an adjustable radius for the workbenches.
but mods are still gonna spawn. put up some walls, dig a trench. enclose your port fully to protect your ship(s)
but also note, mods are not officially supported, so use at your own risk.