Buildings have an integrity system. Pay attention to the color of the part when you mouse over it while holding your building hammer. Blue means it's touching something grounded, then it goes from green, to yellow, to red.

The simple explanation is: the more parts you build away from the ground, the less integrity you'll have. Simple wood retains integrity the worst, followed by core wood, and then iron wood and stone.