I do not think it should be removed but with mods on my server we made it so it immediately starts to regen and it regens 50% faster.

Also, using the hammer and the cultivator take no stam and swimming and jumping stam consumption reduced by 50%. We think this makes the game feel a lot better.

Hopefully one day we will have settings with lots of sliders like most survival games.