I have uninstalled and reinstalled. I thought that would clear it. There was an old fix from March of 21 that didn't fix it.

Right-click on Valheim in your Steam library
Click Properties
Uncheck "Enable the Steam overlay while in-game"
Uncheck "Use Desktop Game Theatre while Steam VR is active"