This reddit thread indicates that it can be run without steam, by either forcibly logging out of steam after running the server or using a bat file to bypass the need for the steam login.

https://www.reddit.com/r/valheim/comments/ljl8d2/can_i_host_a_dedicated_server_on_another_pc_with/

Good luck.