You literally can sail anywhere. But of course you have to work with the wind, which is blowing the wrong way half the time.

(Edit - but yes, I will agree 100% that sometimes it does feel like you say.)