I have solved my own problem.

If you sign out of Valheim on one computer and shutdown immediately after quitting the game, the save is not uploaded to the Steam Cloud before the Shutdown occurs. Wait a minute or so after quitting Valheim for the cloud-save to upload.