For me. I still park my boat at swamp base on this condition.

> Have meadow or black forest nearby. (Optional, very safe spot to park so dont bother park at swamp if there safer biomes nearby.)
> Flat area on the swamp shoreline ( for quick building purpose)
> Have a spare portal on stand by.

I would build quick checkpoint home/tree house with portal inside it. If you uncertain with that just do what the other guys tell you. Destroy the boat and pick the mats and save into the chest. Since workbench use to be block spawning. Place workbench around that area to prevent spawning in future (they can still yeet your workbench if they spawned outside the radius.).