I found mine in a small stone tower, perhaps it only spawns in those and not the villages?