ru luo

Ms. ru luo

orcid

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
25 March 2022 in IEEE Transactions on Geoscience and Remote Sensing
Verified
Journal Article
Closed access
LCLifu Chen
Lifu Chen
RLru luo
ru luo
Jin XingJin Xing
Jin Xing
Zhenhong LiZhenhong Li
Zhenhong Li
ZYZhihui Yuan
Zhihui Yuan
XCXingmin Cai
Xingmin Cai
Although deep learning techniques have achieved noticeable success in aircraft detection, the scale heterogeneity, position difference, complex background interference, and speckle noise keep aircraft detection in large-scale synthetic aperture radar (SAR) images challenging. To solve these problems, we propose the geospatial transformer framework and implement it as a three-step target detection neural network, namely, the image decomposition, the multiscale geospatial contextual attention network (MGCAN), and result recomposition. First, the given large-scale SAR image is decomposed into slices via sliding windows according to the image characteristics of the aircraft. Second, slices are input into the MGCAN network for feature extraction, and the cluster distance nonmaximum suppression (CD-NMS) is utilized to determine the bounding boxes of aircraft. Finally, the detection results are produced via recomposition. Two innovative geospatial attention modules are proposed within MGCAN, namely, the efficient pyramid convolution attention fusion (EPCAF) module and the parallel residual spatial attention (PRSA) module, to extract multiscale features of the aircraft and suppress background noise. In the experiment, four large-scale SAR images with 1-m resolution from the Gaofen-3 system are tested, which are not included in the dataset. The results indicate that the detection performance of our geospatial transformer is better than Faster R-CNN, SSD, Efficientdet-D0, and YOLOV5s. The geospatial transformer integrates deep learning with SAR target characteristics to fully capture the multiscale contextual information and geospatial information of aircraft, effectively reduces complex background interference, and tackles the position difference of targets. It greatly improves the detection performance of aircraft and offers an effective approach to merge SAR domain knowledge with deep learning techniques.

28 February 2021 in Remote Sensing
Verified
Journal Article
Open access
PDF file
JWjielan wang
jielan wang
HXHongguang Xiao
Hongguang Xiao
LCLifu Chen
Lifu Chen
Jin XingJin Xing
Jin Xing
ZPZhouhao Pan
Zhouhao Pan
XCXingmin Cai
Xingmin Cai
The automatic detection of aircrafts from SAR images is widely applied in both military and civil fields, but there are still considerable challenges. To address the high variety of aircraft sizes and complex background information in SAR images, a new fast detection framework based on convolution neural networks is proposed, which achieves automatic and rapid detection of aircraft with high accuracy. First, the airport runway areas are detected to generate the airport runway mask and rectangular contour of the whole airport are generated. Then, a new deep neural network proposed in this paper, named Efficient Weighted Feature Fusion and Attention Network (EWFAN), is used to detect aircrafts. EWFAN integrates the weighted feature fusion module, the spatial attention mechanism, and the CIF loss function. EWFAN can effectively reduce the interference of negative samples and enhance feature extraction, thereby significantly improving the detection accuracy. Finally, the airport runway mask is applied to the detected results to reduce false alarms and produce the final aircraft detection results. To evaluate the performance of the proposed framework, large-scale Gaofen-3 SAR images with 1 m resolution are utilized in the experiment. The detection rate and false alarm rate of our EWFAN algorithm are 95.4% and 3.3%, respectively, which outperforms Efficientdet and YOLOv4. In addition, the average test time with the proposed framework is only 15.40 s, indicating satisfying efficiency of automatic aircraft detection.

27 July 2021 in Remote Sensing
Verified
Journal Article
Open access
PDF file
RLru luo
ru luo
LCLifu Chen
Lifu Chen
Jin XingJin Xing
Jin Xing
ZYZhihui Yuan
Zhihui Yuan
STSiyu Tan
Siyu Tan
JWjielan wang
jielan wang
In aircraft detection from synthetic aperture radar (SAR) images, there are several major challenges: the shattered features of the aircraft, the size heterogeneity and the interference of a complex background. To address these problems, an Efficient Bidirectional Path Aggregation Attention Network (EBPA2N) is proposed. In EBPA2N, YOLOv5s is used as the base network and then the Involution Enhanced Path Aggregation (IEPA) module and Effective Residual Shuffle Attention (ERSA) module are proposed and systematically integrated to improve the detection accuracy of the aircraft. The IEPA module aims to effectively extract advanced semantic and spatial information to better capture multi-scale scattering features of aircraft. Then, the lightweight ERSA module further enhances the extracted features to overcome the interference of complex background and speckle noise, so as to reduce false alarms. To verify the effectiveness of the proposed network, Gaofen-3 airports SAR data with 1 m resolution are utilized in the experiment. The detection rate and false alarm rate of our EBPA2N algorithm are 93.05% and 4.49%, respectively, which is superior to the latest networks of EfficientDet-D0 and YOLOv5s, and it also has an advantage of detection speed.

13 September 2021 in Remote Sensing
Verified
Journal Article
Open access
PDF file
RLru luo
ru luo
Jin XingJin Xing
Jin Xing
LCLifu Chen
Lifu Chen
ZPZhouhao Pan
Zhouhao Pan
XCXingmin Cai
Xingmin Cai
AFAlistair Ford
Alistair Ford
Although deep learning has achieved great success in aircraft detection from SAR imagery, its blackbox behavior has been criticized for low comprehensibility and interpretability. Such challenges have impeded the trustworthiness and wide application of deep learning techniques in SAR image analytics. In this paper, we propose an innovative eXplainable Artificial Intelligence (XAI) framework to glassbox deep neural networks (DNN) by using aircraft detection as a case study. This framework is composed of three parts: hybrid global attribution mapping (HGAM) for backbone network selection, path aggregation network (PANet), and class-specific confidence scores mapping (CCSM) for visualization of the detector. HGAM integrates the local and global XAI techniques to evaluate the effectiveness of DNN feature extraction; PANet provides advanced feature fusion to generate multi-scale prediction feature maps; while CCSM relies on visualization methods to examine the detection performance with given DNN and input SAR images. This framework can select the optimal backbone DNN for aircraft detection and map the detection performance for better understanding of the DNN. We verify its effectiveness with experiments using Gaofen-3 imagery. Our XAI framework offers an explainable approach to design, develop, and deploy DNN for SAR image analytics.

29 October 2024 in IEEE Transactions on Geoscience and Remote Sensing
Verified
Journal Article
Closed access
RLru luo
ru luo
QHQishan He
Qishan He
LZLingjun Zhao
Lingjun Zhao
SZSiqian Zhang
Siqian Zhang
GKGangyao Kuang
Gangyao Kuang
KJKefeng Ji
Kefeng Ji
Fine-grained aircraft detection from synthetic aperture radar (SAR) imagery is of significance in transportation and military domains. Based on the prior knowledge that aircraft are frequently found in airports, current research adopts airport-to-aircraft detection pipelines for aircraft detection and classification in panoramic SAR images. Geospatial information, including the approximate airport location and the spatial relations between the airport and aircraft, represents valuable supplementary information that can enhance fine-grained aircraft detection performance. However, due to unreliable geographical information and the limited perceptual field, it is challenging to detect and classify aircraft in panoramic SAR imagery. To address this, a novel geospatial contextual prior-enabled knowledge reasoning framework is proposed. First, an unsupervised and lightweight geospatial-driven airport detection method is presented by combining geographic information matching and optical-to-SAR image registration, which can quickly locate airports and narrow the scope for fine detection. Then, an improved Real-Time Model for object Detection with a Recursive-gated Spatial Interaction Module (RTMDet-RSIM) is proposed for fine-grained aircraft detection. RTMDet-RSIM employs frequency domain analysis to improve global information modeling ability without excessive computational cost. Finally, a relational prior-based reasoning strategy is proposed by modeling the geospatial category relations from historical images to strengthen classification performance. Experiments on 61 panoramic SAR images covering 13 aircraft categories show that the proposed method achieves high detection accuracy with an mAP of 81.2%, while the average test time for an image size of 8738×7636 is about 8.58s. The source code and dataset will be released.

30 August 2021 in IEEE Geoscience and Remote Sensing Letters
Verified
Journal Article
Closed access
XCXingmin Cai
Xingmin Cai
LCLifu Chen
Lifu Chen
Jin XingJin Xing
Jin Xing
XXXuemin Xing
Xuemin Xing
RLru luo
ru luo
JWjielan wang
jielan wang
Layover is a kind of geometric distortion in radar systems with side-look imaging, especially in mountainous and dense urban areas. It causes phase distortion and alters target characteristics in the acquired images, which directly hinders the application of radar images. In this letter, the multilayer feature fusion attention mechanism (MF2AM) is proposed to extract layover from interferometric synthetic aperture radar (InSAR) imagery automatically. First, the SAR image, the corresponding coherence map, and interferometric phases are channel-fused to enhance semantic information of layover areas. Then, the fused image is fed into MF2AM to extract the essential features of layover. Finally, the detection results are produced via MF2AM. MF2AM consists of the encoder and the decoder. The encoder contains three parts: the resnet101, attention-based atrous spatial pyramid (AASP), and the semantic embedding branch (SEB). In the decoder, step decoding is used to better fuse high- and low-level features and improve the effect of edge segmentation. To verify the proposed method, the images of millimeter wave InSAR system are used for the experiment, and the performance is compared with DeepLabV3+ and Geospatial Contextual Attention Mechanism (GCAM). The results show that the MF2AM has achieved obvious performance advantages. The average pixel accuracy and average intersection over union (IOU) are 0.9601 and 0.9310, respectively, and the average test time is only 7.97 s.