That's something I've noticed. When I start a building with a vertical beam, then add a couple horizontal beams, and then go to put that other vertical beam in from the top, if I have to extend it to get it to ground level, it doesn't work well. A hoe (the tool, not the mercenary female) is your friend when building things. Well worth the inventory slot.