I've found there's only about 3 fish in a particular spot that will bite. After you catch those, move a few meters down the shore and cast again.