Swamp difficulty is just higher than most other parts of the game. A top tier iron shield with iron armor helps, but that's just to reach parity with the difficulty in the zone. Move slow and stay cautious, it only gets easier from there.