Yes the attacks will continue and gradually become more difficult as you progress further, however if the location you have found is worth fighting for then fight for it, you don't need trenches if you can defend well enough I know you said your rubbish at fighting on Valheim but you can leave a path open for mobs to funnel down and use sharp stakes to do the work (unless a update has changed the mob path finder). Enemies will look for a route that gives the least amount of resistance so leaving them path will force them down that path instead of flattening your walls, there are videos on this so it might be worth checking them out, slight terraforming wouldn't harm to save your village, pickaxe a slight cliff around your base to force the mobs down that path even more
With practise and failed experience such as what you've dealt with, you'll get the hang of it