Learn how to parry and dodge and you won't need arrows to fight bosses. Parrying and dodging damage also means you won't need as much ore as I assume you are using a fair chunk on armor and you will need fewer potions

Arrows are for deer and drakes, learn the other mechanics, save yourself the grind.