Did you get the "Ground is Shaking" event? That spawns trolls near one of your workbenches.