Crops will grow. Your lifestock will survive. You don't need to worry about them being attacked, as long as you are not there.