Accurate prediction of food crop yield is of great significance for global food security and regional trade stability. Since remote sensing data collected from unmanned aerial vehicle (UAV) platforms have the features of flexibility and high resolution, these data can be used as samples to develop regional regression models for accurate prediction of crop yield at a field scale. The primary objective of this study was to construct regional prediction models for winter wheat yield based on multi-spectral UAV data and machine learning methods. Six machine learning methods including Gaussian process regression (GPR), support vector machine regression (SVR) and random forest regression (RFR) were used for the construction of the yield prediction models. Ten vegetation indices (VIs) extracted from canopy spectral images of winter wheat acquired from a multi-spectral UAV at five key growth stages in Xuzhou City, Jiangsu Province, China in 2021 were selected as the variables of the models. In addition, in situ measurements of wheat yield were obtained in a destructive sampling manner for prediction algorithm modeling and validation. Prediction results of single growth stages showed that the optimal model was GPR constructed from extremely strong correlated VIs (ESCVIs) at the filling stage (R2 = 0.87, RMSE = 49.22 g/m2, MAE = 42.74 g/m2). The results of multiple stages showed GPR achieved the highest accuracy (R2 = 0.88, RMSE = 49.18 g/m2, MAE = 42.57 g/m2) when the ESCVIs of the flowering and filling stages were used. Larger sampling plots were adopted to verify the accuracy of yield prediction; the results indicated that the GPR model has strong adaptability at different scales. These findings suggest that using machine learning methods and multi-spectral UAV data can accurately predict crop yield at the field scale and deliver a valuable application reference for farm-scale field crop management.
Rice bacterial leaf streak (BLS) is a serious disease in rice leaves and can seriously affect the quality and quantity of rice growth. Automatic estimation of disease severity is a crucial requirement in agricultural production. To address this, a new method (termed BLSNet) was proposed for rice and BLS leaf lesion recognition and segmentation based on a UNet network in semantic segmentation. An attention mechanism and multi-scale extraction integration were used in BLSNet to improve the accuracy of lesion segmentation. We compared the performance of the proposed network with that of DeepLabv3+ and UNet as benchmark models used in semantic segmentation. It was found that the proposed BLSNet model demonstrated higher segmentation and class accuracy. A preliminary investigation of BLS disease severity estimation was carried out based on our BLS segmentation results, and it was found that the proposed BLSNet method has strong potential to be a reliable automatic estimator of BLS disease severity.
The leaf area index (LAI) is of great significance for crop growth monitoring. Recently, unmanned aerial systems (UASs) have experienced rapid development and can provide critical data support for crop LAI monitoring. This study investigates the effects of combining spectral and texture features extracted from UAS multispectral imagery on maize LAI estimation. Multispectral images and in situ maize LAI were collected from test sites in Tongshan, Xuzhou, Jiangsu Province, China. The spectral and texture features of UAS multispectral remote sensing images are extracted using the vegetation indices (VIs) and the gray-level co-occurrence matrix (GLCM), respectively. Normalized texture indices (NDTIs), ratio texture indices (RTIs), and difference texture indices (DTIs) are calculated using two GLCM-based textures to express the influence of two different texture features on LAI monitoring at the same time. The remote sensing features are prescreened through correlation analysis. Different data dimensionality reduction or feature selection methods, including stepwise selection (ST), principal component analysis (PCA), and ST combined with PCA (ST_PCA), are coupled with support vector regression (SVR), random forest (RF), and multiple linear regression (MLR) to build the maize LAI estimation models. The results reveal that ST_PCA coupled with SVR has better performance, in terms of the VIs + DTIs (R2 = 0.876, RMSE = 0.239) and VIs + NDTIs (R2 = 0.877, RMSE = 0.236). This study introduces the potential of different texture indices for maize LAI monitoring and demonstrates the promising solution of using ST_PCA to realize the combining of spectral and texture features for improving the estimation accuracy of maize LAI.
The conventional method for crop insect detection based on visual judgment of the field is time-consuming, laborious, subjective, and error prone. The early detection and accurate localization of agricultural insect pests can significantly improve the effectiveness of pest control as well as reduce the costs, which has become an urgent demand for crop production. Maize Spodoptera frugiperda is a migratory agricultural pest that has severely decreased the yield of maize, rice, and other kinds of crops worldwide. To monitor the occurrences of maize Spodoptera frugiperda in a timely manner, an end-to-end Spodoptera frugiperda detection model termed the Pest Region-CNN (Pest R-CNN) was proposed based on the Faster Region-CNN (Faster R-CNN) model. Pest R-CNN was carried out according to the feeding traces of maize leaves by Spodoptera frugiperda. The proposed model was trained and validated using high-spatial-resolution red–green–blue (RGB) ortho-images acquired by an unmanned aerial vehicle (UAV). On the basis of the severity of feeding, the degree of Spodoptera frugiperda invasion severity was classified into the four classes of juvenile, minor, moderate, and severe. The degree of severity and specific feed location of S. frugiperda infestation can be determined and depicted in the frame forms using the proposed model. A mean average precision (mAP) of 43.6% was achieved by the proposed model on the test dataset, showing the great potential of deep learning object detection in pest monitoring. Compared with the Faster R-CNN and YOLOv5 model, the detection accuracy of the proposed model increased by 12% and 19%, respectively. Further ablation studies showed the effectives of channel and spatial attention, group convolution, deformable convolution, and the multi-scale aggregation strategy in the aspect of improving the accuracy of detection. The design methods of the object detection architecture could provide reference for other research. This is the first step in applying deep-learning object detection to S. frugiperda feeding trace, enabling the application of high-spatial-resolution RGB images obtained by UAVs to S. frugiperda-infested object detection. The proposed model will be beneficial with respect to S. frugiperda pest stress monitoring to realize precision pest control.
The convolutional neural network (CNN) method has been widely used in the classification of hyperspectral images (HSIs). However, the efficiency and accuracy of the HSI classification are inevitably degraded when small samples are available. This study proposes a multidimensional CNN model named MDAN, which is constructed with an attention mechanism, to achieve an ideal classification performance of CNN within the framework of few-shot learning. In this model, a three-dimensional (3D) convolutional layer is carried out for obtaining spatial–spectral features from the 3D volumetric data of HSI. Subsequently, the two-dimensional (2D) and one-dimensional (1D) convolutional layers further learn spatial and spectral features efficiently at an abstract level. Based on the most widely used convolutional block attention module (CBAM), this study investigates a convolutional block self-attention module (CBSM) to improve accuracy by changing the connection ways of attention blocks. The CBSM model is used with the 2D convolutional layer for better performance of HSI classification purposes. The MDAN model is applied for classification applications using HSI, and its performance is evaluated by comparing the results with the support vector machine (SVM), 2D CNN, 3D CNN, 3D–2D–1D CNN, and CBAM. The findings of this study indicate that classification results from the MADN model show overall classification accuracies of 97.34%, 96.43%, and 92.23% for Salinas, WHU-Hi-HanChuan, and Pavia University datasets, respectively, when only 1% HSI data were used for training. The training and testing times of the MDAN model are close to those of the 3D–2D–1D CNN, which has the highest efficiency among all comparative CNN models. The attention model CBSM is introduced into MDAN, which achieves an overall accuracy of about 1% higher than that of the CBAM model. The performance of the two proposed methods is superior to the other models in terms of both efficiency and accuracy. The results show that the combination of multidimensional CNNs and attention mechanisms has the best ability for small-sample problems in HSI classification.
The timely and accurate detection of wheat lodging at a large scale is necessary for loss assessments in agricultural insurance claims. Most existing deep-learning-based methods of wheat lodging detection use data from unmanned aerial vehicles, rendering monitoring wheat lodging at a large scale difficult. Meanwhile, the edge feature is not accurately extracted. In this study, a semantic segmentation network model called the pyramid transposed convolution network (PTCNet) was proposed for large-scale wheat lodging extraction and detection using GaoFen-2 satellite images with high spatial resolutions. Multi-scale high-level features were combined with low-level features to improve the segmentation’s accuracy and to enhance the extraction sensitivity of wheat lodging areas in the proposed model. In addition, four types of vegetation indices and three types of edge features were added into the network and compared to the increment in the segmentation’s accuracy. The F1 score and the intersection over union of wheat lodging extraction reached 85.31% and 74.38% by PTCNet, respectively, outperforming other compared benchmarks, i.e., SegNet, PSPNet, FPN, and DeepLabv3+ networks. PTCNet can achieve accurate and large-scale extraction of wheat lodging, which is significant in the fields of loss assessment and agricultural insurance claims.