Head inlands from the coastline to find more solid land. I've not found any sunken dungeons, all the ones I've found in coast generated mistlands are the variation with the longish stairs leading up, instead of dvergr structures leading down.