From experience, it seems that making noise is the thing that attracts attention to you. So chopping wood, mining, etc. will attract attention of monsters and have them come find you.

Which to me really does make sense, since we are essentially trespassing on their lands. So I would heavily lean on this being an intended mechanic.