You want to build in the open meadows away from the treeline. The greylings don't wander out of the trees unless given a reason.