Crops will wilt and die if they have invalid planting zones. That includes being overly crowded, too close to obstacles like rocks, or covered by a roof. Generally you'll know within 10sec or so if a crop is destined to poof.