Originally posted by blindoctor:

EDIT: Would that also require putting BepInEx on the server?

Yes, BepinEx provides the framework that allows mods to patch into Unity-based games and servers (like Valheim) and is a prerequisite for most such mods.