After H&H update, you have constant spawns around you (so you will be attacked by greyling every ~2 minutes if in meadows - for example) and if you do not protect your buildings, they will eventually destroy everything, so you will be constantly fighting them off.
And killing bosses changes night spawns, so after 1st boss there will be constant night attacks of greydwarfs with shamans

So if you really into peaceful building, not the game for you anymore - unless you want to play with dev console