my understanding of this is that unless you are close enough to an area, nothing will happen. so, assuming you portaled far enough away, the raid is paused, but so are the mobs, and they will not destroy anything further. if your workbench is still up then you should be good.