Originally posted by Sabaithal:

Neither do I, but not having a damn fishing rod just because of bad RNG makes me compromise.

You could visit someone's world who has found him if you really want access to him early. But little tip - get the belt first. The fish actually aren't very good on their own and you need flour to make them worthwhile, which is a late game item.