There's a video online that shows that, actually, building parts being built near the obliterator do take damage when it's used.