This is a ♥♥♥♥♥♥ bug, I had it happen once (renamed portal then went through it too fast). At Valheim bug tracker it's being shown as under construction[valheimbugs.featureupvote.com]. Can always upvote it more.