Originally posted by Marc Remillard:

it did take a while to work out why they were just falling down though, no hints as to structural integrity.

There are hints. With hammer in hand, if you mouseover building parts, the parts will turn colors. Green means well supported; red means close to collapse. Blue means supported by the ground. Structural integrity naturally degrades as pieces get higher off the ground. This limits how high you can build things.