That's a spawner, Greydwarf Nest. Destroy it and they will stop spawning. Or just ignore it.