Originally posted by YoulluPukki:

Is it me or it's by design sailing made torturing?

You have several options to overcome it:
1. Paddle
2. Sail in zig-zag pattern
3. Wait for better wind
4. Choose another direction to explore - go with the wind!
5. Magic

I usually choose between options 1, 2 and 4 as I don't have the wind magic yet.