Have I just been getting lucky? The past 4 random seeds I've played on had a trader spawn on the same island as an Elder summon.

If I remember correctly, there are multiple locations the trader can spawn in but once you get in range of one of those spawns then that becomes the set location.