Do it the old fashioned way, sail around, he is always in the black forest, and an icon of a bag will appear on the map when you get even remotely close.

There are at least 10 merchants on your map right now, once you find the first one, the rest will disappear.