Make sure you've eaten 3 foods, have a shield and a weapon before re-engaging him.