In the last decade, the rapid development of deep learning (DL) has made it possible to perform automatic, accurate, and robust change detection (CD) on large volumes of remote sensing images (RSIs). However, despite advances in CD methods, their practical application in real-world contexts remains limited because of diverse input data and the applicational context. For example, the collected RSIs can be time-series observations, and more informative results are required to indicate the time of change or the specific change category. Moreover, training a deep neural network (DNN) requires a massive amount of training samples, and in many cases these samples are difficult to collect. To address these challenges, various specific CD methods have been developed considering different application scenarios and training resources. Additionally, recent advancements in image generation, self-supervision, and visual foundation models (VFMs) have opened up new approaches to address the ”data-hungry” issue of DL-based CD. The development of these methods in broader application scenarios requires further investigation and discussion. Therefore, this article summarizes the literature methods for different CD tasks and the available strategies and techniques to train and deploy DL-based CD methods in sample-limited scenarios. We expect this survey to be able to provide new insights and inspiration for researchers in this field to develop more effective CD methods that can be applied in a wider range of contexts.
26 July 2024 in Computers and Electronics in Agriculture
Wheat stripe rust (WSR) is a foliar disease that causes destructive damage in the wheat production context. Accurately estimating the severity of WSR in the autumn growing stage can help to objectively monitor the disease incidence level of WSR and predict the nationwide disease incidence in the following year, which have great significance for controlling its nationwide spread and ensuring the safety of grain production. In this study, to address the low accuracy and the efficiency of disease index estimation by traditional methods, WSR-diseased areas are segmented based on Segformer, and the macro disease index (MDI) is automatically calculated for the measurement of canopy-scale disease incidence. The results obtained with different semantic segmentation algorithms, loss functions, and data sets are compared for the segmentation effect, in order to address the severe class imbalance in disease region segmentation. We find that: (1) The results of the various models differed significantly, with Segformer being the best algorithm for WSR segmentation (rust class F1 score = 72.60%), based on the original data set; (2) the imbalanced nature of the data has a significant impact on the identification of the minority class (i.e., the rust class), for which solutions based on loss functions and re-weighting of the minority class are ineffective; (3) data augmentation of the minority class or under-sampling of the original data set to increase the proportion of the rust class greatly improved the F1-score of the model (rust class F1 score = 86.6%), revealing that re-sampling is a simple and effective approach to alleviating the class imbalance problem. Finally, the MDI was used to evaluate the models based on the different data sets, where the model based on the augmented data set presented the best performance (R2 = 0.992, RMSE = 0.008). In conclusion, the deep-learning-based semantic segmentation method, and the corresponding optimization measures, applied in this study allow us to achieve pixel-level accurate segmentation of WSR regions on wheat leaves, thus enabling accurate assessment of the degree of WSR disease under complex backgrounds in the field, consequently providing technical support for field surveys and calculation of the disease level.
4 July 2023 in IEEE Transactions on Geoscience and Remote Sensing
This study aimed to identify and assess vegetation indices (VIs) and their optimal band combinations using unmanned aerial vehicle (UAV) hyperspectral imagery for the quantitative inversion of wheat stripe rust. This would offer guidance for selecting rust-resistant phenotypes and facilitate large-scale disease monitoring using aerial and spaceborne remote sensing images. The experimental design encompassed 960 wheat varieties (strains) in agricultural fields. Hyperspectral imagery was acquired at 100m altitude during different disease stages, and disease index (DI) was investigated per plot. A custom program explored VIs with two, three, and four bands using 30 calculation methods and 3,463,790 band combinations. Regression models employed three-fold cross-validation and multilayer perceptron (MLP) algorithms, with the mean R 2 value indicating optimal index and band combinations. The results revealed that the chosen VIs were effective in inverting the DI. Selected two-band VIs included MGRVI (531, 571), with R 2 =0.746±0.01618; the optimal three-band VIs was ARI2 (531, 550±10, 640±25), with R 2 =0.755±0.00896; and the best four-band VIs was DBSI (531, 551, 750, 799), with R 2 =0.778±0.01300, which was comparable to full-band modeling (R 2 =0.775±0.01508). The models’ performance improved with an increasing number of bands in the VIs. This study demonstrated that appropriate multi-VIs modeling enhances performance compared to single-VIs modeling, e.g., six combinations of VIs achieved R 2 =0.790±0.01141. These findings underscore the potential of integrating machine learning algorithms and vegetation indices for quantifying wheat rust diseases, laying the foundation for developing airborne and spaceborne imaging sensors for large-scale wheat rust monitoring.
Wheat lodging has a significant impact on yields and quality, necessitating the accurate acquisition of lodging information for effective disaster assessment and damage evaluation. This study presents a novel approach for wheat lodging detection in large and heterogeneous fields using UAV remote sensing images. A comprehensive dataset spanning an area of 2.3117 km2 was meticulously collected and labeled, constituting a valuable resource for this study. Through a comprehensive comparison of algorithmic models, remote sensing data types, and model frameworks, this study demonstrates that the Deeplabv3+ model outperforms various other models, including U-net, Bisenetv2, FastSCN, RTFormer, Bisenetv2, and HRNet, achieving a noteworthy F1 score of 90.22% for detecting wheat lodging. Intriguingly, by leveraging RGB image data alone, the current model achieves high-accuracy rates in wheat lodging detection compared to models trained with multispectral datasets at the same resolution. Moreover, we introduce an innovative multi-branch binary classification framework that surpasses the traditional single-branch multi-classification framework. The proposed framework yielded an outstanding F1 score of 90.30% for detecting wheat lodging and an accuracy of 86.94% for area extraction of wheat lodging, surpassing the single-branch multi-classification framework by an improvement of 7.22%. Significantly, the present comprehensive experimental results showcase the capacity of UAVs and deep learning to detect wheat lodging in expansive areas, demonstrating high efficiency and cost-effectiveness under heterogeneous field conditions. This study offers valuable insights for leveraging UAV remote sensing technology to identify post-disaster damage areas and assess the extent of the damage.