Alternatively you can use the Steam-client server browser to find valheim servers without passwords.
Click on 'View' -> 'Servers'. A server browser window will open.
Click on 'CHANGE FILTERS', select Valheim in the game dropdown and enable the filter option 'Is not password protected'.