You have to play smarter. sorry it sounds cruel, but facts are facts.

When you get ganked, dont attempt to get your marker until you eat and rest up to full health.

All you should be using for retrieval is a bow some arrows, and potions. Thats it.

If they are camping your marker, pull them off with bow shots and run them away until you can peel off, circle around then get your things. Or hop on a boulder and whittle them down until you can deal with them. the AI in this game, so far, has problems jumping. Use that.

Critters in this game can be exceptionally mean, but they can also be exceptionally stupid.