Originally posted by Nefrarya:

Withered bones are needed for the third boss (in the swamp), but you need to beat the second boss (in the forest) to get the key for exploring the swamp.

Yes this is the answer to my problem, went back and indeed the key was left at the place I killed the Elder at.

Thank you for your time.