I've been wondering this myself. Specifically with Valheim+.

In my mind you should be able to edit your config and then just share that file with your friends. But I have no idea if that works, never tried.