No. They can't destroy the earth made walls. If there is enough of an angle to the walls they can climb them still. Be sure they are as close to 90 degrees as possible.