If you're spreading your builds out across the map, it shouldn't be too bad. Big builds with lots of instances will take a bit to load and may decrease your FPS when you're nearby. I'm currently doing this and it's been fine thus far.