Crops can be totally ignored. Even left in the ground fully grown they will not rot or anything. The only danger is if you are around and something is attacking it and you don't notice.