A lot of swamp area are just small patches or narrow coast lines, there is nothing in there besides undeads or leeches (you can farm them for food or potion tho)
what you need to find crypts is a large and deep swamp area.