As yet another cranky old man I have to agree with the OP. It isn't usually a problem for me these days as I mostly do no-portals runs but my latest run I've gone back to pure vanilla no house rules and ran into it again.

I try to mitigate it by placing portals in out of the way places when possible and by using only two portals at my home base - one always left unconnected for emergencies and fixing fouliups in renaming portals, the other I rename to whatever destination. It works but requires using the same names on the map as for the portals and/or putting up charcoal signs lest I become confused or am playing after being woken up by the neighbor at 2 AM and before first cup of coffee.

The other side of the portal usage can get you caught in a loop which is hard to get out of. Had it happen when I placed a portal wrong at a burial chamber entrance. I was able to break out by hammering on a movement key, otherwise the only ways I can think of are using console commands or logging to another world and obtaining a piece of ore.