I think Darth Invader has it correct. I encountered the wind blowing directly into my face, shortly after pointing the raft in a direction.

For what it is worth, you can actually throw it into reverse, tapping "S", and that allows the raft to turn in a direction where you can at least start going forward again, even if it isn't exactly where you want it to go.

Lost a raft to "ocean danger" and lost another to leeches, both due to unhelpful wind direction...

Grinding out a Karve at the moment, heh.