Dont worry about the movement speed penalty, the only reason you may want to go full troll armour is for the sneak bonus damage, if you are just going to the swamps I would initially go bronze and poison resist pots. If you can get some iron then maybe think of using the Iron Sledge to clear the crypts in the swamp... but initially I would say go Bronze, the speed loss is hard to feel.