There's some truth to the bias. A bad wind drastically slows down travel, therefore the trip takes longer, therefore there is more experience dealing with bad winds than good winds.

Of course it doesn't help when 8 out of 10 voyages go directly into head wind. Valheim's destination prediction algorithm is truly above par.