honestly sounds like you are massively under geared. crude bow will deal with ground shaking and bronze weapons + root/bronze/troll armour should cope with combat on the foul smell. as long as you don't hide inside your base the enemies won't attack it.

eat 2 meats and a honey minimum and go outside and fight :) active base defense