I've only tried skeletons and greydwarfs. Skeletons are more aggressive, but do little damage, and I'm not sure but I think they also calm down unless they hear the player. It was a while ago and I didn't keep the skeletons all that long (they didn't get along with the greydwarfs..).

https://steamcommunity.com/sharedfiles/filedetails/?id=2622615883