I'm not sure why it is doing that, but if you don't want to keep fighting the newly spawned golumns, just dig a hole by it and once you're deep enough and the golumn is above you on the edge, dig out from below it and trap it. It stops the constant respawning of them.