Depending on your world seed, the merchant might be very far away from the map center. I got frustrated holding onto all the 'treasure' you find, so I looked up another world seed with a more convenient merchant.