25 March 2022 in Frontiers in Artificial Intelligence
The need for accurate yield estimates for viticulture is becoming more important due to increasing competition in the wine market worldwide. One of the most promising methods to estimate the harvest is berry counting, as it can be approached non-destructively, and its process can be automated. In this article, we present a method that addresses the challenge of occluded berries with leaves to obtain a more accurate estimate of the number of berries that will enable a better estimate of the harvest. We use generative adversarial networks, a deep learning-based approach that generates a highly probable scenario behind the leaves exploiting learned patterns from images with non-occluded berries. Our experiments show that the estimate of the number of berries after applying our method is closer to the manually counted reference. In contrast to applying a factor to the berry count, our approach better adapts to local conditions by directly involving the appearance of the visible berries. Furthermore, we show that our approach can identify which areas in the image should be changed by adding new berries without explicitly requiring information about hidden areas.
17 October 2022 in Journal of Field Robotics
LJLaura Verena Junker‐Frohn
Laura Verena Junker‐Frohn
+3
In this paper, we present GrowliFlower, a georeferenced, image‐based unmanned aerial vehicle time‐series dataset of two monitored cauliflower fields (0.39 and 0.60 ha) acquired in 2 years, 2020 and 2021. The proposed dataset contains RGB and multispectral orthophotos with coordinates of approximately 14,000 individual cauliflower plants. The coordinates enable the extraction of complete and incomplete time‐series of image patches showing individual plants. The dataset contains the collected phenotypic traits of 740 plants, including the developmental stage and plant and cauliflower size. The harvestable product is completely covered by leaves, thus, plant IDs and coordinates are provided to extract image pairs of plants pre‐ and post‐defoliation. In addition, to facilitate classification, detection, segmentation, instance segmentation, and other similar computer vision tasks, the proposed dataset contains pixel‐accurate leaf and plant instance segmentations, as well as stem annotations. The proposed dataset was created to facilitate the development and evaluation of various machine‐learning approaches. It focuses on the analysis of growth and development of cauliflower and the derivation of phenotypic traits to advance automation in agriculture. Two baseline results of instance segmentation tasks at the plant and leaf level based on labeled instance segmentation data are presented. The complete GrowliFlower dataset is publicly available (http://rs.ipb.uni-bonn.de/data/growliflower/).
17 June 2022 in GigaScience
Unmanned aerial vehicle (UAV)–based image retrieval in modern agriculture enables gathering large amounts of spatially referenced crop image data. In large-scale experiments, however, UAV images suffer from containing a multitudinous amount of crops in a complex canopy architecture. Especially for the observation of temporal effects, this complicates the recognition of individual plants over several images and the extraction of relevant information tremendously. In this work, we present a hands-on workflow for the automatized temporal and spatial identification and individualization of crop images from UAVs abbreviated as “cataloging” based on comprehensible computer vision methods. We evaluate the workflow on 2 real-world datasets. One dataset is recorded for observation of Cercospora leaf spot—a fungal disease—in sugar beet over an entire growing cycle. The other one deals with harvest prediction of cauliflower plants. The plant catalog is utilized for the extraction of single plant images seen over multiple time points. This gathers a large-scale spatiotemporal image dataset that in turn can be applied to train further machine learning models including various data layers. The presented approach improves analysis and interpretation of UAV data in agriculture significantly. By validation with some reference data, our method shows an accuracy that is similar to more complex deep learning–based recognition techniques. Our workflow is able to automatize plant cataloging and training image extraction, especially for large datasets.
10 July 2023 in IEEE Geoscience and Remote Sensing Letters
Cauliflower is a hand-harvested crop that must fulfill high-quality standards in sales making the timing of harvest important. However, accurately determining harvest-readiness can be challenging due to the cauliflower head being covered by its canopy. While deep learning enables automated harvest-readiness estimation, errors can occur due to field-variability and limited training data. In this paper, we analyze the reliability of a harvest-readiness classifier with interpretable machine learning. By identifying clusters of saliency maps, we derive reliability scores for each classification result using knowledge about the domain and the image properties. For unseen data, the reliability can be used to (i) inform farmers to improve their decision-making and (ii) increase the model prediction accuracy. Using RGB images of single cauliflower plants at different developmental stages from the GrowliFlower dataset [4], we investigate various saliency mapping approaches and find that they result in different quality of reliability scores. With the most suitable interpretation tool, we adjust the classification result and achieve a 15.72% improvement of the overall accuracy to 88.14% and a 15.44% improvement of the average class accuracy to 88.52% for the GrowliFlower dataset.