I really dislike this as well. I occasionally have broken stuff in my home on the other side of walls that were not even cut down 50% (stone). Those micro towers are deathtraps against a log-troll. remember: they are swinging at YOU, not the building. If they swing, they think it will connect.

I have restarted and am going for minimal deaths as well. I have no delusions that something won't cap me eventually; bad luck can get anyone from a busted boat to a ambush **spear furby or cross boarder enemy you didn't see (that wolf in the meadows..)