To all those that stumble upon this

I had launched Valheim with Geforce now (back when it was on there) and could never relaunch it locally even after reinstalling and all the other tricks.

What I had to do, like other users have posted, open local files directory, uninstall the game via steam, then delete all the remaining filed in that directory. Then reinstall and it launches fine.