6 August 2024 in IEEE Transactions on AgriFood Electronics
In this article, we introduce machine learning (ML) techniques developed for the monitoring of the brown marmorated stink bug (BMSB), a significant agricultural pest responsible for considerable crop damage worldwide. The Haly.ID project, initiated in early 2021, aims to enhance BMSB monitoring through the utilization of information and communication technology methods. We employ computer vision techniques on RGB images captured by drones and investigate the performance of deep neural networks to evaluate the impact of this invasive species on crop yields in orchards around Europe. Specifically, we evaluate the single shot multibox detector, detection transformer, YOLOv5 , YOLOv9 , and YOLOv10 architectures for full-level and patch-level image analysis, respectively. To improve detection accuracy, we experiment with shortwave infrared hyperspectral imaging (SWIR-HSI) in laboratory settings. Given that pheromone baited traps are the most accepted tools for pest detection by field operators, we also propose an Internet of Things sticky trap with an integrated camera equipped with lightweight convolutional neural networks models operating “on the edge” in this resource constrained system. In addition, we develop a client–server application for real-time bug detection, integrating the ML models to provide accessible results to farmers. Lastly, we explore effective postharvesting strategies using SWIR-HSI images to detect insect punctures invisible to the naked eye, thereby enhancing the quality of marketable fruit.
21 April 2023 in Computer Networks
14 October 2024 in IEEE Transactions on AgriFood Electronics
The invasive insect brown marmorated stink bug (BMSB) is an emerging pest of global importance, as it is destroying fruits and seeds, having caused estimated damages of € 588 million to crops in 2019 in Northern Italy alone. An open challenge is to improve monitoring of BMSB in order to be able to deploy countermeasures more efficiently and to increase consumer confidence in the end product. The Horizon 2020 Haly.ID project seeks to reduce or eliminate dependence on conventional monitoring tools and practices, such as traps, baits, visual inspections, sweep netting, and tree beating. In their place, the project proposes the use of unmanned aerial vehicle (UAV) and Internet of Things (IoT) solutions for monitoring the insect population and investigates novel methods for enhancing the quality of fruit in the market. In this work, we focus on the novel autonomous IoT insect monitoring system consisting of multiple innovative solutions for BMSB monitoring and trusted data management developed in Haly.ID . In particular, this article describes the challenges faced when integrating and deploying this monitoring system consisting of those different parts and aims at presenting valuable “lessons learned” for the realization of future deployments. We show that massive over-provisioning of power supply and network speed allows to adapt the system at run-time reflecting changing project requirements, and to conduct experiments remotely. At the same time, over-provisioning introduces new weak points impacting the system reliability, such as cables that can be unplugged or damaged.