After much fiddling, I finally found the culprit.

For those who uses the mod Valheim Plus, if you enabled the game category, remember to enable/set to true the settings which read "forceConsole". Setting it to false will disable the F5 menu.