You'll achieve the actual 'growth' by levelling the skills which will slowly start to use less stamina and get a bigger stamina pool by discovering and unlocking better foods. That's just how this game is designed.