If you just stick to basic wood and roof material in meadows, you can build with just raids from boars and necks. Once you get enough benches around your base area, the local spawns will stop once the base and benches cover enough ground.

Only thing is, it takes a lot of wood. So you really need the brass hoe to be able to plant trees to renew the forest. Otherwise you have to venture further away to cop down trees and you can get constantly harassed by those drunken walking fire fearing mini tree stumps with legs thingamabobs.

To get brass for the hoe, you have to go into the black forest where you get more harassment. What you can do is have 1 fighting character that gifts some basic things to a building only character.