terrain adjustment seems to be the only real culprit beyond adding structures as well as discovering more and more of your map.

the only real way to test this would be to fully reveal your map with you having done nothing else to adjust the world.

then, use some kind of command to delete ALL constructions the player could build. compare file size numbers.