On the lower left corner of the startup screen is a white button labeled "Show log file."

What it actually does is open your local Valheim data folder. Navigate up and copy this folder to make backups.

I don't have cloud saves enabled, but I think it will still take you to your local data folder if you do.