Put more attention into sailing. IRL people have to tack regularly, it's part of sailing. If you've got some of the wind in the direction you want, then sail at an 30-45 degree angle to where you want to go, adjusting when the wind changes.
It would probably quell some complaints if people could see themselves rowing, these are square sailed galleys after all. Having rowers was half the reason people were picked for viking raids anyway.