Having the same issue, but I am the host, and my Valheim isnt showing it needs any updates..

EDIT: Youll need to make sure that both you and your host are using the same version. If you are on the public beta, they will need to be as well or you both wont be on the same version! Check the latest update on the main page for info :D