Originally posted by Zep Tepi:

If you press on the skull on the side of the map, your markers will disappear.

The marker, yes.
Not the loot/gravestone.
Just adding this to prevent confusion.