29 May 2023 in IEEE Transactions on Geoscience and Remote Sensing
Multispectral remote sensing images (RSI), including hyperspectral and multispectral images, contain adequate information of ground objects and areas and play important roles in environmental monitoring, weather forecasting, urban planning, etc. However, due to many inevitable external effects on the remote sensing pathway, remote sensing images are often degraded by blur. The fields of multispectral remote sensing image deblurring have witnessed great improvements in recent years, including both optimization-based and deep-learning-based methods. However, issues are to be addressed in the remote sensing image deblurring field, such as the incompatibility of general regularizations, lack of spectral correlations for multispectral RSIs, demands of blind deblurring for real world applications, and high costs of computation. To address these problems, we incorporate a novel prior exploiting gradient information similarity between different spectral bands, and we name it auxiliary band gradient information (ABGI) prior. We show that the ABGI prior is applicable to all gradient sparsity regularizations by a simple subtract-then-add step. Specifically, we apply ABGI prior to the patch-wise minimal pixel (PMP) prior based deblurring method, and we also prove that the PMP prior exhibits sparsity for clear natural RSIs. We estimate our method on remote sensing image datasets of different spectral types and geographic resolutions. Compared to other state-of-the-art deblurring methods, our method shows superior performance on both simulated and real world blur.
7 June 2024 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
With the continuous development of edge computing, real-time processing of satellite images has gradually become a research hotspot. However, the current semantic segmentation methods for SAR images are suboptimal in terms of segmentation performance and inference speed. Therefore, we propose a fast fine semantic segmentation network for building regions in SAR images, called FFSSNet. The architecture of this network comprises a feature extractor, a Feature Reprocessing Module (FRM), a Multi-scale Feature Deep Fusion Module (MFDFM), and an auxiliary branch. Aiming at the problem of low signal-to-noise ratio of SAR images, the network extracts multi-scale features rich in context information through a feature extractor with a large receptive field. After that, through the FRM and MFDFM, the semantic information in each scale is deeply extracted and fused. This makes the feature maps contain semantic information of all scales. In addition, we design an auxiliary branch for reducing misclassification of pixels in non-target regions. We test the network using two completely different datasets. Compared with other state-of-the-art methods, our proposed method has the better performance in terms of segmentation accuracy, inference speed and generalisation ability.
27 February 2026 in IEEE Geoscience and Remote Sensing Letters
With the widespread application of high-resolution remote sensing videos (RSV), object segmentation in RSV plays an irreplaceable role in various fields such as surface target recognition. However, existing methods struggle with this task due to the small object size, high object density, and significant scale variation among objects. To address these challenges, we propose RSV-LoRA, a novel approach that fine-tunes Segment Anything Model (SAM) to effectively capture and segment objects in remote sensing videos. First, RSV-LoRA integrates a Mixture of Experts into the LoRA framework, alleviating the limitations of fixed network structures in recognizing objects at varying scales. Subsequently, RSV-LoRA employs multi-scale dilated convolutions as experts while maintaining the inherent efficiency of low-rank adaptation. This introduces enhanced local feature extraction capability, thereby improving the recognition performance for objects in RSV. Moreover, RSV-LoRA is efficient in terms of training as only the RSV-LoRA layers are trained while the weights of SAM remain frozen, thereby reducing the number of trainable parameters. Owing to such training characteristics, RSV-LoRA is plug-and-play, allowing its layers to be adapted to various tasks and objects. Extensive experiments conducted on the SAT-MTB, iSAID, and VHR-10 datasets demonstrate the effectiveness of RSV-LoRA.