You should be able to revert to old versions on Steam by right clicking the game, going into properties, then betas and then selecting your preferred version. The last time I tried this was with Space Engineers months ago. I don't know if it works for Valheim.

If you play Offline in Steam, you don't get the updates until YOU want the updates.