greylings are attacking almost everything that you build just place some campfires (they fear fire) or build a wall