Like in real sailing you got to cross the wind who is forcing you to go either narrow up and then narrow down your intended direction. If you need to change direction without wind, slow down to the paddle. Beside that, it truly can be annoying.