29 January 2024 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
In the context of fast progress in deep learning, convolutional neural networks (CNNs) have been extensively applied to the semantic segmentation of remote sensing images and have achieved significant progress. However, certain limitations exist in capturing global contextual information due to the characteristics of convolutional local properties. Recently, Transformer has become a focus of research in computer vision and has shown great potential in extracting global contextual information, further promoting the development of semantic segmentation tasks. In this paper, we use ResNet50 as an encoder, embed the hybrid attention mechanism into Transformer, and propose a Transformer-based decoder. The Channel-Spatial Transformer Block (CSTB) further aggregates features by integrating the local feature maps extracted by the encoder with their associated global dependencies. At the same time, an adaptive approach is employed to reweight the interdependent channel maps to enhance the feature fusion. The Global Cross-Fusion Module (GCFM) combines the extracted complementary features to obtain more comprehensive semantic information. Extensive comparative experiments were conducted on the ISPRS Potsdam and Vaihingen datasets, where mIoU reached 78.06% and 76.37%, respectively. The outcomes of multiple ablation experiments also validate the effectiveness of the proposed method.
19 August 2024 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Contextual information can effectively aid deep learning models in extracting inter-class and intra-class difference features in remote sensing images. Our research presents a novel approach called the adaptive attention network (AANet) for semantic segmentation in high-resolution remote sensing images. The proposed AANet aims to enhance the segmentation performance while minimizing the network's computational and parametric aspects. Furthermore, the AANet is designed to facilitate real-time segmentation. The AANet involves the construction of three distinct modules, namely the Multiscale Channel Attention Module (MCAM), the Multidimensional Spatial Attention Module (MSAM), and the Contextual Information Adaptive Fusion Module (CIAFM). MCAM enhances a multi-scale approach to effectively capture contextual information from neighboring channels and category information. MSAM is designed to extract and combine detailed information from each dimension of the spatial domain. CIAFM focuses on the complementary nature of channel and spatial context information and the correlation between pixels and categories. The methodology employed in this study involved conducting experiments on the ISPRS Vaihingen, ISPRS Potsdam, and MO-CSSSD datasets alongside a comparative analysis with conventional semantic segmentation models. The results of the study indicate that our approach demonstrates exceptional performance on the ISPRS Vaihingen dataset, ISPRS Potsdam dataset, and MO-CSSSD dataset, achieving mIoU scores of 83.17%, 85.67%, and 89.68%, respectively.
19 August 2025 in IEEE Transactions on Geoscience and Remote Sensing
To fully leverage contextual information for the precise segmentation of objects in remote sensing images, while addressing the challenges associated with substantial object scale variations and complex backgrounds, we propose a lightweight cross-domain coupling network (LCCN) tailored for semantic segmentation of high-resolution remote sensing images (HRSIs). To standardize feature selection and fusion procedures, the LCCN incorporates an innovative Encoder-Coupler-Decoder architecture designed to facilitate key feature extraction and optimization. A cross-domain coupling module (CDCM) is created in the Coupler to conduct preliminary features screening of spaces and dimensions based on channel and spatial attention. It performs multi-scale feature extraction and global information modeling through the feature grouping and loop aggregation. This helps to extract key features while reducing the computational overhead. To further decrease the interference from complex backgrounds, a secondary optimization of the key features is carried out: a lightweight fully-featured mapping attention module (LFMAM) is designed within the Decoder. LFMAM utilizes an interactive fusion strategy and a lightweight linear self-attention mechanism, comprehensively considering all interactions between global-to-global, global-to-local, local-to-local, and local-to-global processes. By capturing the effective correlations and variances among features to further refine them, it enables the network to further optimize the crucial information while ensuring light weight. We have conducted extensive comparison experiments and ablation experiments on the ISPRS Vaihingen and ISPRS Potsdam datasets. The extensive experimental results demonstrate that our proposed LCCN can obtain superior performance compared to other advanced semantic segmentation models.