I've never had that happen before, and I've set off their "alarm" several times trying to make a place to sleep that's close by, although I am not sure that I've tried cutting down a tree. I'm usually trying to make a hole in a rock.

Did you get the blue flash and the noise and ignore it?

I have purposely destroyed one of their wards, and they gave me several warnings before turning on me, although I'm not sure if they turned on me after I destroyed it or before. I think it was after.