I haven't figured out what causes this yet. Sometimes closing out of the game and relaunching the game has addressed the issue for me for the remainder of the Valheim session without adjusting any of the Steam configurations.

I haven't tried launching in Big Picture Mode to gauge its consistency, but I encounter other issues with Big Picture (namely the Big Picture UI still going in the background while I'm playing the game on occasion).