Your world file might get larger, and autosave might take a bit longer, but the amount of the world loaded at any one time is limited so it shouldn't affect your gameplay.

If you're spreading your builds out across the map, it shouldn't be too bad. Big builds with lots of instances will take a bit to load and may decrease your FPS when you're nearby. I'm currently doing this and it's been fine thus far.