AI on the Bog: Monitoring and Evaluating Cranberry Crop Risk. WACV2021.Peri Akiva, Benjamin Planche, Aditi Roy, Kristin Dana, Peter Oudemans, Michael Mars.
Machine vision for precision agriculture has attracted considerable research interest in recent years. The goal of this paper is to develop an end-to-end cranberry health monitoring system to enable and support real time cranberry over-heating assessment to facilitate informed decisions that may sustain the economic viability of the farm. Toward this goal, we propose two main deep learning-based modules for: 1) cranberry fruit segmentation to delineate the exact fruit regions in the cranberry field image that are exposed to sun, 2) prediction of cloud coverage conditions and sun irradiance to estimate the inner temperature of exposed cranberries. We develop drone-based field data and ground-based sky data collection systems to collect video imagery at multiple time points for use in crop health analysis. Extensive evaluation on the data set shows that it is possible to predict exposed fruit's inner temperature with high accuracy (0.02% MAPE). The sun irradiance prediction error was found to be 8.41-20.36% MAPE in the 5-20 minutes time horizon. With 62.54% mIoU for segmentation and 13.46 MAE for counting accuracies in exposed fruit identification, this system is capable of giving informed feedback to growers to take precautionary action (e.g. irrigation) in identified crop field regions with higher risk of sunburn in the near future. Though this novel system is applied for cranberry health monitoring, it represents a pioneering step forward for efficient farming and is useful in precision agriculture beyond the problem of cranberry overheating.
Finding Berries: Segmentation and Counting of Cranberries using Point Supervision and Shape Priors. CVPRW2020.Peri Akiva, Kristin Dana, Peter Oudemans, Michael Mars.
Precision agriculture has become a key factor for increasing crop yields by providing essential information to decision makers. In this work, we present a deep learning method for simultaneous segmentation and counting of cranberries to aid in yield estimation and sun exposure predictions. Notably, supervision is done using low cost center point annotations. The approach, named Triple-S Network, incorporates a three-part loss with shape priors to promote better fitting to objects of known shape typical in agricultural scenes. Our results improve overall segmentation performance by more than 6.74% and counting results by 22.91% when compared to state-of-the-art. To train and evaluate the network, we have collected the CRanberry Aerial Imagery Dataset (CRAID), the largest dataset of aerial drone imagery from cranberry fields. This dataset will be made publicly available.
Vision-Based Cranberry Crop Ripening Assessment.Faith Johnson, Jack Lowry, Kristin Dana, Peter Oudemans.
Agricultural domains are being transformed by recent advances in AI and computer vision that support quantitative visual evaluation. Using drone imaging, we develop a framework for characterizing the ripening process of cranberry crops. Our method consists of drone-based time-series collection over a cranberry growing season, photometric calibration for albedo recovery from pixels, and berry segmentation with semi-supervised deep learning networks using point-click annotations. By extracting time-series berry albedo measurements, we evaluate four different varieties of cranberries and provide a quantification of their ripening rates. Such quantification has practical implications for 1) assessing real-time overheating risks for cranberry bogs; 2) large scale comparisons of progeny in crop breeding; 3) detecting disease by looking for ripening pattern outliers. This work is the first of its kind in quantitative evaluation of ripening using computer vision methods and has impact beyond cranberry crops including wine grapes, olives, blueberries, and maize.
Vision on the Bog: Cranberry Crop Risk Evaluation with Deep Learning.Peri Akiva, Benjamin Planche, Aditi Roy, Peter Oudemans, Kristin Dana.
Computer vision and AI for smart agriculture have exciting potential in optimizing crop yield while reducing resource use for better environmental and commercial outcomes. The goal of this work is to develop state-of-the-art computer vision algorithms for image-based crop evaluation and weather-related risk assessment to support real-time decision-making for growers. We develop a cranberry bog monitoring system that maps cranberry density and also predicts short-term cranberry internal temperatures. We have two important algorithm contributions. First, we develop a method for cranberry instance segmentation that provides the number of sun-exposed cranberries (not covered by the crop canopy) that are at risk of overheating. The algorithm is based on a novel weakly supervised framework using inexpensive point-click annotations, avoiding time-consuming annotations of fully-supervised methods. The second algorithmic contribution is an in-field joint solar irradiation and berry temperature prediction in an end-to-end differentiable network. The combined system enables over-heating risk assessment to inform irrigation decisions. To support these algorithms, we employ drone-based crop imaging and ground-based sky imaging systems to obtain a large-scale dataset at multiple time points. Through extensive experimental evaluation, we demonstrate high accuracy in cranberry segmentation, irradiance prediction and internal berry temperature prediction. This work is a pioneering step in using computer vision and machine learning for rapid, short-term decision-making that can assist growers in irrigation decisions in response to complex time-sensitive risk factors. Datasets collected over two growing seasons are made publicly available to support further research. The methods can be extended to additional crops beyond cranberries, such as grapes, olives, and grain, where irrigation management is increasingly challenging as climate changes.