I think I saw a server mod that disables or blocks client mods but cant find it now. Or maybe Im wrong and it was another game. There are also mods like Valheim ServerSideMap, which distributes server map to clients - that might help but the client must cooperate and use the mod too.