If the worst comes to worst log in with another character, walk / boat over to the bad build, and tear it down from the outside.