There is a couple of mods for this, currently:

ServerCharacters[valheim.thunderstore.io] - recently updated, but has to be installed on the server and all connecting clients to be able to do its thing. Alternately, there's also World of Valheim SSC[valheim.thunderstore.io], but that one hasn't been updated since around EA launch.