only lag I've noticed in that regard is when I come over the rise near my main homestead and everything has to load. Once everything in render distance is loaded I don't notice any additional lag.

Also get a lot of lag when I use the portal, the more that has to load after you portal in the more lag your going to experience when a new location has to load. Most recommendations I've seen is build any portal hubs far away from your main homestead and keep them simple so they load fast.