Your equipment is enough regardless of how you choose to take him on. Troll-skin set would allow quite a lot of damage through if you won't be vigilant to block the attacks with the buckler tho, so either go for a bronze armor set, rely on healing potions to recover, or make sure you're confident in your blocking and dodging skills.