Make sure you have your rested buff. If that's not enough, slap down a fire near where you're working for even more stamina regen.