I wouldn't bother with health potions.

However, the swamp will require poison resist potions, at least until you gear up somewhat.

Use a blunt weapon.... swamp mobs are mostly blunt weak. And use the best food you can to maximize your health & stamina pools. And make sure you have as long a rested buff as possible before you venture out exploring. That rested buff is *huge* for stamina regeneration.

Edit: And as mentioned above, not all swamps are created equal... some will have little to no crypts, others might have 30-40 or more. If you're having trouble finding some, look for another swamp.