As has been said, if its a base centered raid you need to stay in/really close to the red indicator on your map or the raid pauses until you come back and deal with it. It's intentionally that way so you can't just run away through a portal every time there is a raid and negate them.
Stay near a fire and you won't freeze.