Never built a raft personally. But if I did, it would be to hop to an island just a bit further than i could swim. Open ocean would not be a smart move on a raft as in real life.
As for the wind... just like actual sailing, you may have to paddle and/or tack the wind when the breeze is unfavorable.