25 November 2022 in Computers in Biology and Medicine
2 December 2024 in IEEE Transactions on Circuits and Systems for Video Technology
To tackle the challenge of single-spectral object re-identification in complex and dynamic lighting scenarios, multi-spectral object re-identification, which integrates visible light and infrared information, is gradually taking the lead. Nevertheless, the significant heterogeneity across spectra causes formidable obstacles for this task. Most existing approaches alleviate inter-spectral disparities by amalgamating representations from different spectra, ignoring the selection of spectrum-specific crucial information. To address this issue, we propose a novel Representation Selective Coupling Network (RSCNet) for multi-spectral object re-identification. Specifically, we design an Attention-Fourier Token Sparsification (AFTS) module to adaptively sparse and join tokens from multi-spectral images in the attention domain and Fourier domain. This not only preserves spectrum-specific crucial information but also reduces inter-spectral gaps by selective coupling of multi-spectral representation. Meanwhile, to further align multi-spectral information and guide the model to learn more discriminative representation, we propose an Information Unification Constraint (IUC) learning strategy. Both feature-level information constraint and distribution-level information constraint are simultaneously deployed in IUC. Finally, we conduct extensive experiments on three multi-spectral object re-identification benchmarks, and the experimental results verify the effectiveness of our proposed method.
19 June 2024 in IEEE Transactions on Geoscience and Remote Sensing
Image super-resolution (SR) stands as a pivotal process in the domains of image processing and computer vision, finding diverse applications in film, television, photography, surveillance, medical imaging, and remote sensing. In the context of remote sensing images (RSI), the inherent challenge arises from low spatial resolution caused by factors like sensor noise, orbit height, and weather conditions, necessitating super-resolution reconstruction. An evident limitation of prevailing methods lies in their dependence on idealized fixed degradation models, which fail to capture the intricate degradation processes unique to remote sensing scenes. In response to these constraints, this article introduces an innovative blind super-resolution reconstruction method tailored for remote sensing images. The proposed approach integrates convolution with a transformer and incorporates an amplitude phase learning module (ALM) to comprehensively capture local and long-range dependencies while enhancing frequency information. The iterative optimization strategy refines texture information by carefully balancing structural and detail elements. Key contributions include a holistic approach to remote sensing image super-resolution, ALM integration for precise feature representation, and the introduction of a patch-based frequency loss (PFL) mechanism for evaluating frequency domain features. Rigorous experiments demonstrate that, compared to other state-of-the-art methods, the proposed algorithm delivers super-resolution results with exceptional visual perception quality across three distinct remote sensing datasets.
22 February 2025 in Expert Systems with Applications
1 April 2025 in IEEE Transactions on Geoscience and Remote Sensing
Remote sensing change detection (RSCD) holds significant research value in remote sensing image processing. In recent years, many researchers have achieved remarkable results in RSCD tasks using methods based on CNNs or Transformers. Considering the limited receptive field of CNN models and the high computational cost of Transformers, many researchers have combined the two approaches, yielding promising results. However, most current RSCD-based models focus solely on change and temporal information, overlooking their complementary relationship. Additionally, some multi-scale feature fusion methods emphasize enhancing individual scales while neglecting the correlations between different scales. To address the above issues, we propose a multi-scale complementary enhanced context fusion network (MCECF). The network first introduces a global-local context aggregation module (GLCAM) to capture global-local context information while extracting multi-level feature maps. Subsequently, a complementary enhancement difference module (CEDM) is employed to complementarily aggregate the captured change and temporal information of bi-temporal remote sensing image features. To fully leverage the correlations between multi-scale features, a progressive decoder comprising a supervised spatial attention (SSA) mechanism and a multi-scale complementary enhanced fusion module (MCEFM) was developed. Moreover, to tackle the disparity between changed and unchanged regions, a dual-branch dynamic attention fusion module (DAFM) was designed to enhance the model’s adaptability to diverse scenarios. We conducted comparative experiments on five RSCD datasets against nine SOTA methods, and the results confirmed the effectiveness of the proposed MCECF in RSCD tasks. Our code will be made available at https://github.com/kakuqikaduo/MCECF.