You won't get raid events when you're not at your base (except for "You are being hunted" which comes later). But wandering mobs can attack your base. I was sailing home with a load of ore and as I approached I saw a troll had come out of BF and was rampaging around my base (which was probably a little too close to the BF at the time).