Haven´t lost a grave so far.
Do you have cloud save enabled for valheim? I have heard that it can cause weird things to happen very similar to what you have described. I´d recommend disabling this function for valheim.