i think it targets you because it just recognizes you as "player" and its so it can be used as a trap for PvP, and it makes no distinction between builder and other players in the world.

What they should do though is any wards built in its vacinity, players registered to use items in the ward won't be targeted. Maybe that's too hard for their programmers though, lol.