I just had my fight with the Elder and no adds were spawned. I guess you didnt clear out the surrounding area before starting the fight. I think he calls for aid to nearby mobs at some point in the fight. GL