One thing to remember is that if the wind shifts and it does not stop you... would you even notice?

Most of the time I don't. It is only when it goes against me that I even notice it changed.

So basically it could be changing a lot more than you think but it only seems against you since that is when you notice it.