I multi-task. When I'm mining copper or silver I don't just pitch the rocks. I build a temp portal and take the rocks and gray dwarf bits back to the base and stash the ore in a chest. When I'm done mining I carry the ore back home (boat, cart, or walking) and start smelting. Then I go back through the portal, dismantle it and the work bench, and continue exploring. When night falls or my rested bonus wears off I set up the portal and go back home, set up the next batch of ore and sleep.

Some times I'll mine an entire island out and store the ore in chests near the closest shore and just sail from stash to stash.

I get why people that don't have a lot of free time like to skip the repetitive stuff but you can make efficient use of your time.