Haven't tried it but by far the toughest challenge would be not using any food. It could be done, not dying would be very difficult. The stamina limitations would make everything very hard.

I think I'd instead limit myself to stamina food, some new game down the road. So low health, potential 1-shot, but can build and run around same as always.