Well like others, I found Yag's altar before I found any Vegvisir. Its big, but it was also way out and about the 30th plains biome I had found. I am not progression driven and consider boss fights boring drudgery so I was in no rush.

I can see how this would be little fun for someone that wanted the boss fight though. All the other bosses seem to have plentiful Vegvisirs.