The trees in the swamp are indestructible so if you build high enough not even their stone throw will reach you.