Middle mouse button with the hammer on the bottom level of your building and it will be disassembled in no time. Needs a workbench nearby, or a stonecutter if your walls are stone.