just like any other spawner, you can shoot it to death if you can see it.
the swamp ones like piles, usually 2-3 skeletons and 1 draghr all together.
If you can't find it or are tired of it, just go away from that area and enter the swamp or play on the edge in another spot. The spawners are rare.