The wiki[valheim.fandom.com] has updated information on this event. Yes, they will attack when you kill Yagluth and yes they eat stone fortifications so those very secure Meadows fortresses we built need marble to withstand the attacks.