Just need the key to unlock them, the crypt locations are determined when the world is created. Not every swamp has crypts, some swamps have tons of them, just gotta keep looking.