If your mouse has a middle mouse button that is the default for "unmake".
Also, if you press the hot key (1-9) for a quick item it will switch you out of building mode.