Traps (Mainly the Pointed stakes)attract hostile attention, I think Growing Crops (Not fully grown but immature crops) and all livestock, including tamed animals attract aggro.
The Karve and the Longship, as well as the cart also attract aggro, curiously I've never seen anything but a serpent go after a raft, but I barely use them (Mostly for fishing)