It mostly depends on the "play style" of your server: with a friend, we thought about having a "no cheats" one, so we managed to enlist some mandatory mods, and to have a greylist of a few QoL optional ones.

Your server, your rules: decide "how to play", then start from that, to think if to have mods and which ones.