Getting them on the boat is only chapter one of the saga, you've gotta be really careful and lucky with the voyage so they're not thrown overboard by waves, scared overboard by hostiles, or killed outright by a collision with the boat because a greyling threw a rock at the mast or w/e. Try to thread a route that avoids absolutely everything and absolutely don't try it at night.