I've beaten Bonemass on two separate Valheim worlds. Never fought him in the Swamp.

In both cases, his spawning shrine was within a hundred meters of a Meadows. Bonemass isn't shy about following me out of the Swamp into the Meadows. I'm not shy about beating him down without having to engage draughr and leeches.