Are you having enough stamina? Just holding RMB is fine but you need to have enough stamina to reel in the fish, or else you'll lose the catch. Or keep the line closer to you so you don't need so much stamina for reeling in.