That can be a problem. Even some larger swamps can have very few crypts.

I would just build a small, temporary base to venture out from and see if there are crypts in the area first. It's easier to see them at night, but, of course, it's more dangerous at night in the swamps.