This may not be your cup of tea, totally player preference. But another way to play is the two worlds method.

Main world - one you put your main base and elaborate building projects: do not kill any bosses

Adventure world - kill bosses from 1st to last in whatever progression speed you like

It is bit of extra step to need to logout, change world, log back each time you need swap worlds but this method lets you basically have no major raids at all on your main base world, especially trolls+ which only trigger after 2nd boss killed.

So it's either dig trenches/moat as ppl suggested or just never kill any bosses in your main world and will only get the random spawns, no raids or the 'forest is moving' , 'ground shaking' etc events