The only way I've been able to get around this new bug they introduced was to put the connect command in my Valheim launch options.
Obviously replace the first part with the IP of the server you're connecting to.

Please note this forces you to connect to that server. So to join other servers you just need to remove the launch option.