17 April 2024 in Pest Management Science
BACKGROUND: Halyomorpha halys is one of the most damaging invasive agricultural pests in North America and southern Europe. It is commonly monitored using pheromone traps, which are not very effective because few bugs are caught and some escape and/or remain outside the trap on surrounding plants where they feed, increasing the damage. Other monitoring techniques are based on visual sampling, sweep‐netting and tree‐beating. However, all these methods require several hours of human labor and are difficult to apply to large areas. The aim of this work is to develop an automated monitoring system that integrates image acquisition through the use of drones with H. halys detection through the use of artificial intelligence (AI). RESULTS: The study results allowed the development of an automated flight protocol using a mobile app to capture high‐resolution images. The drone caused only low levels of disturbance in both adult and intermediate instars, inducing freezing behavior in adults. Each of the AI models used achieved very good performance, with a detection accuracy of up to 97% and recall of up to 87% for the X‐TL model. CONCLUSION: The first application of this novel monitoring system demonstrated the potential of drones and AI to detect and quantify the presence of H. halys . The ability to capture high‐altitude, high‐resolution images makes this method potentially suitable for use with a range of crops and pests. © 2024 The Author(s). Pest Management Science published by John Wiley & Sons Ltd on behalf of Society of Chemical Industry.
6 August 2024 in IEEE Transactions on AgriFood Electronics
In this article, we introduce machine learning (ML) techniques developed for the monitoring of the brown marmorated stink bug (BMSB), a significant agricultural pest responsible for considerable crop damage worldwide. The Haly.ID project, initiated in early 2021, aims to enhance BMSB monitoring through the utilization of information and communication technology methods. We employ computer vision techniques on RGB images captured by drones and investigate the performance of deep neural networks to evaluate the impact of this invasive species on crop yields in orchards around Europe. Specifically, we evaluate the single shot multibox detector, detection transformer, YOLOv5 , YOLOv9 , and YOLOv10 architectures for full-level and patch-level image analysis, respectively. To improve detection accuracy, we experiment with shortwave infrared hyperspectral imaging (SWIR-HSI) in laboratory settings. Given that pheromone baited traps are the most accepted tools for pest detection by field operators, we also propose an Internet of Things sticky trap with an integrated camera equipped with lightweight convolutional neural networks models operating “on the edge” in this resource constrained system. In addition, we develop a client–server application for real-time bug detection, integrating the ML models to provide accessible results to farmers. Lastly, we explore effective postharvesting strategies using SWIR-HSI images to detect insect punctures invisible to the naked eye, thereby enhancing the quality of marketable fruit.
14 October 2024 in IEEE Transactions on AgriFood Electronics
The invasive insect brown marmorated stink bug (BMSB) is an emerging pest of global importance, as it is destroying fruits and seeds, having caused estimated damages of € 588 million to crops in 2019 in Northern Italy alone. An open challenge is to improve monitoring of BMSB in order to be able to deploy countermeasures more efficiently and to increase consumer confidence in the end product. The Horizon 2020 Haly.ID project seeks to reduce or eliminate dependence on conventional monitoring tools and practices, such as traps, baits, visual inspections, sweep netting, and tree beating. In their place, the project proposes the use of unmanned aerial vehicle (UAV) and Internet of Things (IoT) solutions for monitoring the insect population and investigates novel methods for enhancing the quality of fruit in the market. In this work, we focus on the novel autonomous IoT insect monitoring system consisting of multiple innovative solutions for BMSB monitoring and trusted data management developed in Haly.ID . In particular, this article describes the challenges faced when integrating and deploying this monitoring system consisting of those different parts and aims at presenting valuable “lessons learned” for the realization of future deployments. We show that massive over-provisioning of power supply and network speed allows to adapt the system at run-time reflecting changing project requirements, and to conduct experiments remotely. At the same time, over-provisioning introduces new weak points impacting the system reliability, such as cables that can be unplugged or damaged.