Because you only get raided when at home, and you're usually only at home because you died or you want to rest/build.