I gave up and demolished the building and rebuilt it. I am a newb and all so it was probably some kind of support issue. It was only happening on the ground floor. the second floor never had damage. I ground floor did not have any supports to the ground I just set out floor tiles.

The new building has half pillars to the ground every 2nd floor tile and does not seem to have any damage issues yet.