If there isn't anyone in the vicinity, a region isn't simulated, so nothing happens. There's a bit of fast-forward applied when someone turns up, but that generally doesn't include combat. So while there can be some damage while you travel from the edge of the zone to the base, it isn't much time for anything to get too bad. Its only something that is close enough to be simulated and far enough to be out of sight that would really suffer.