Stakewalls around your property breaks their line of sight and they mostly leave you alone. If they become aggroed you can ignore them as long as you want, since it would take hours for them to scratch through.

For mining out in the forest, if you dig down and under the deposit they have a hard time getting down into the pit and likewise can just ignore them making noise up top. Even if they fall in, a campfire makes them scared and they won't attack. Campfire in your mining pit allows you to mine with rested, resting, and shelter buffs.