Isn't it that if your crops are staying too long in the ground; they die off. At least I saw that happening when I first bought the game long time ago. Some of the crops that were not collected withered away, first I thought someone picked them but everyone said they didnt.
Another could be a pig or deer perhaps? coming in to eat them and run away.