You need to add -console to the launch options for Valheim.

Open Steam > Library > Right click on Valheim > Properties.
On that page you should see "Launch options" click on it and add -console

Not sure how it works for dedicated servers tho