24 May 2024 in IEEE Transactions on Geoscience and Remote Sensing
Remote sensing image change detection (CD) is an important technology for monitoring ground object change. Although Transformer-based CD methods have been proposed and achieved good results, however, there does exist one open problem: Transformer-based methods are weak for localizing information acquisition, easily ignore detailed information, and are of high computational complexity. Also, the variation of target sizes challenges the generalization of networks. To address these issues, we propose a siamese network named as CBSASNet for remote sensing CD, in which channel bias split attention is employed to recover the information in the change region and the cross-temporal fusion module is utilized to highlight the information of change regions through the optimized single-temporal image features. The experimental result indicates that CBSASNet does not only outperform 16 state-of-the-art works, but also its modules complement each other in the ablation testing.
13 March 2025 in Expert Systems with Applications
11 April 2024 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
The existing salient object detection in optical remote sensing images methods mostly employ the same strategy to handle features at different levels without fully considering the distinct characteristics these features possess at various levels. This results in the neglect of some high-level semantics and low-level details during the feature extraction process. Furthermore, existing methods often rely on simple convolution operations to construct modules for feature extraction and fusion. Due to the inherent locality of convolution operations, these models are limited in their performance. To address these challenges, we propose a novel progressive complementation network with semantics and details (SDPCNet) consisting of three parts: Deep semantics aggregation module (DSAM), semantics-guided feature complement module (SFCM), and detail feature enhancement module (DFEM). Specifically, the DSAM is applied on the two highest-level features, guided by the global view with global long-range dependencies and local context generated by transformer and dilated convolution. The DSAM deeply delves the semantic information in high-level features to perceive the object positions and alleviate the adverse effects of cluttered backgrounds. The SFCM operates on the intermediate two levels of features, performing global correlation modeling on the aggregated cross-level features. It enhances multiscale semantic information and edge details using multiple sets of dilated convolutions to address the challenges posed by the uncertainty in the size and number of salient objects. The DFEM acts on the lowest two levels of features, enhancing edge details in spatial dimension and emphasizing semantics in different channel dimensions. It is then fused with high-level features to augment feature diversity and reduce the impact of background noise. Extensive experiments conducted on the ORSSD, EORSSD, and ORSI-4199 datasets demonstrate that our proposed SDPCNet outperforms 23 state-of-the-art methods across eight evaluation metrics.
15 January 2025 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
As deep learning demonstrates excellent performance in remote sensing image change detection (CD), early methods that mostly used Convolutional Neural Networks (CNNs) have limitations in the accuracy due to their insufficient global feature representation, an inherent shortcoming of CNNs. The lack of global feature can lead to notable issues, such as the inability to detect small targets and loss of edge information. In recent years, vision transformers (ViTs) have been employed in CD owing to their powerful global feature representation capabilities. However, pure transformer methods lack effective local feature extraction, which also restricts the performance of CD, while the original transformer models require a large amount of computing resources. To address these issues and improve CD performance, we propose a Lightweight Transformer-based Multi-scale Feature Fusion network (LTMFFNet). By integrating CNN structures both before and after the multi-head self-attention in each layer of the main backbone, we enhance the encoder's local feature extraction ability and reduce the computational complexity through convolution and linear operations. For the siamese encoding outputs at different scales, we design two distinct fusion modules based on depth- wise convolution for bitemporal information fusion in deep layers and shallow layers, respectively. Our model employs a multi-layer cascaded structure with a deep supervision strategy applied to multiple outputs. Experiments on four public CD datasets demonstrate that our network achieves better performance while maintaining relatively smaller computational complexity compared to other state-of-the-art methods for CD.
24 November 2025 in Knowledge-Based Systems