They will spawn in abandoned structures in nearly any biome... I found one in a swamp today, nearly freaked me out when I thought a blob poisoned me and I didn't see it.