It can take up to 15-30 minutes just to catch a single fish with how buggy fishing (and ocean collision in general) is. Even if you could just walk up and grab the fish, it'd still be a pain as they take 90 minutes to respawn and there's only 4-5 of them.

I spent about 2-3 hours fishing for them and got 7. Cooked a couple to learn the recipe and left it at that, never used them.

All that just for 5 more stamina, you could just sprint for 5 seconds less every 10 minutes and accomplish the same result.

Fishing is *only* worth it if you enjoy fishing itself as the end reward. Like catching a bunch to put in a pond for your base (yes, fish in inventory will swim again if dropped in water, not sure if they're persistent though).