9 April 2019 in IEEE Access
Multi-class pest detection is one of the crucial components in pest management involving localization in addition to classification which is much more difficult than generic object detection because of the apparent differences among pest species. This paper proposes a region-based end-to-end approach named PestNet for large-scale multi-class pest detection and classification based on deep learning. PestNet consists of three major parts. First, a novel module channel–spatial attention (CSA) is proposed to be fused into the convolutional neural network (CNN) backbone for feature extraction and enhancement. The second one is called region proposal network (RPN) that is adopted for providing region proposals as potential pest positions based on extracted feature maps from images. Position-sensitive score map (PSSM), the third component, is used to replace fully connected (FC) layers for pest classification and bounding box regression. Furthermore, we apply contextual regions of interest (RoIs) as contextual information of pest features to improve detection accuracy. We evaluate PestNet on our newly collected large-scale pests’ image dataset, Multi-class Pests Dataset 2018 (MPD2018) captured by our designed task-specific image acquisition equipment, covering more than 80k images with over 580k pests labeled by agricultural experts and categorized in 16 classes. The experimental results show that the proposed PestNet performs well on multi-class pest detection with 75.46% mean average precision (mAP), which outperforms the state-of-the-art methods.
28 October 2019 in IEEE Access
In agriculture, pest always causes the major damage in fields and results in significant crop yield losses. Currently, manual pest classification and counting are very time-consuming and many subjective factors can affect the population counting accuracy. In addition, the existing pest localization and recognition methods based on Convolutional Neural Network (CNN) are not satisfactory for practical pest prevention in fields because of pests’ different scales and attitudes. In order to address these problems, an effective data augmentation strategy for CNN-based method is proposed in this paper. In training phase, we adopt data augmentation through rotating images by various degrees followed by cropping into different grids. In this way, we could obtain a large number of extra multi-scale examples that could be adopted to train a multi-scale pest detection model. In terms of test phase, we utilize the test time augmentation (TTA) strategy that separately inferences input images with various resolutions using the trained multi-scale model. Finally, we fuse these detection results from different image scales by non-maximum suppression (NMS) for the final result. Experimental results on wheat sawfly, wheat aphid, wheat mite and rice planthopper in our domain specific dataset, show that our proposed data augmentation strategy achieves the pest detection performance of 81.4 mean Average Precision (mAP), which improves 11.63%, 7.93%, 4.73% compared to three state-of-the-art approaches.
1 April 2020 in Applied Soft Computing
18 May 2020 in IEEE Transactions on Industrial Informatics
Specialized control of pests and diseases have been a high-priority issue for agriculture industry in many countries. On account of automation and cost-effectiveness, image analytic based pest recognition systems are widely utilized in practical crops prevention applications. But due to powerless handcrafted features, current image analytic approaches achieve low accuracy and poor robustness in practical large-scale multi-class pest detection and recognition. To tackle this problem, this paper proposes a novel deep learning based automatic approach using hybrid and local activated features for pest monitoring solution. In the presented method, we exploit the global information from feature maps to build our Global activated Feature Pyramid Network (GaFPN) to extract pests' highly discriminative features across various scales over both depth and position levels. It makes changes of depth or spatial sensitive features in pest images more visible during downsampling. Next, an improved pest localization module named Local activated Region Proposal Network (LaRPN) is proposed to find the precise pest objects' positions by augmenting contextualized and attentional information for feature completion and enhancement in local level. The approach is evaluated on our 7-year large-scale pest dataset containing 88.6K images (16 types of pests) with 582.1K manually labelled pest objects. The experimental results show that our solution performs over 75.03% mAP in industrial circumstances, which outweighs two other state-of-the-art methods: Faster R-CNN with mAP up to 70% and FPN mAP up to 72%. Our code and dataset will be made publicly available.
10 August 2022 in Machine Vision and Applications