I haven't really seen that many people complain about fishing, but I'd guess most people don't really enjoy doing things that they have to go out of their way to do, especially if the 'reward' isn't worth it. What are the stats on cooked fish again? 35 health 15 stamina? It's something along those lines (pun not intended) which is beaten by pretty much all food found in the black forest (the area you'd need to reach in order to even begin fishing).

Obviously the game is in early access and they've mentioned a fishing update is coming, but right now fishing just isn't worth the time in my opinion.