as long as you all have the same content-adding mods, it should be fine. people can have different client-side mods. like one that adds a farming grid, or ones that add every plant in the game to the cultivator.