The circle can be made bigger. That is why there is a "mystical force" keeping you from building near it. It gives them room to expand the circle.