You wont get attacks if you are out and about the place, the trigger seems to be if you hang around too long by a workbench at minimal, your base will trigger the attack if you stay at home too long (very annoying if you are trying to make a big build).