You may be using tower shields ineffectively. To use them properly you must have a high health pool, as the tower shields stamina usage is based on your health. Rather than prioritising stamina foods, you probably need atleast 2 health foods.