Hugin will come back when you accomplished certain things. He actually told you what to do in his first dialogue.

To make it easier on you, gather sticks and stones, anything edible and start crafting a stone axe, then the hammer. You can do this when pressing the "Tab" key. There's a menu on the right hand side on what you can craft.