While holding the building hammer, look at what you want to break and click mouse 3.