The fusion of multi-band images including far-infrared image (FIRI), near-infrared image (NIRI) and visible image (VISI) primarily suffers from four challenges. One is the problem of simultaneous fusion for multiple images. Most existing methods are oriented towards the fusion of two objects, which is generally achieved with a sequential fusion method. This means that intermediate fusion results are repeatedly integrated with the unprocessed images until all images have been fused. However, this may amplify the blurring effect and even engender artifacts. Second, consistent training labels for image fusion cannot currently be obtained for some types of images (e.g., medical images and multi-band images), which may lead to the failed application of supervised learning methods. Third, the existing methods often do not directly focus on the potential mapping relationship between the original and resulting images, which usually increases the unpredictability of the fusion results. Fourth, redundant features or singularities are often not eliminated in the general fusion process, and both may interfere with or even obscure significant features in the source images. To address the abovementioned problems, this paper proposes a latent representation learning model that can synchronously integrate multi-band images without samples. Specifically, the model can capture the clean and distinctive features of the originals via latent low-rank and sparse embedding. The extracted intrinsic features are projected onto the target fusion space through an assumed mapping relationship. The final results were obtained through the designed optimization algorithm. In addition, numerous experiments were implemented to prove the rationality and feasibility of the proposed fusion model with subjective evaluation, objective indexes and convergence analysis.

Remote sensing image change detection (RSCD) aims to extract high-level semantic feature (HLSF) to identify the changed areas (CAs) between dual-temporal images (DTIs). However, the diversity in the CA shape and size poses certain challenge to the CD task. Besides, different illumination conditions in the same scene of the DTI further increase the CD difficulty. In response to these above issues, this paper proposes a multi-scale feature (MSF) fusion CD network-WSMsFNet, which fully utilizes the local and global information of multi-scale features to achieve comprehensive representation of the change scene; In addition, the network improves the feature extraction ability of each module through the whole process supervision loss function. Firstly, the network hierarchically extracts different scale information of the two temporal RS; Then, special information enhancement and fusion modules are constructed for various feature layers (i.e., the same level, adjacent level, and global features), aiming to enhance the local feature representation ability and contextual information relevance of the deep network; Finally, the whole-process loss function is set to supervise the intermediate layer learning, which can effectively enhance the feature representation ability and guide feature extraction direction of each module. Experiments have shown that the WSMsFNet has achieved significant results in both qualitative and quantitative indicators.

Remote sensing (RS) image change detection (CD) aims to identify areas of interest that have changed between bitemporal images. For complex scenarios (e.g., varying lighting conditions), the diverse shapes and scales of the changed areas is especially vulnerable to cause CD models to suffer from serious missed detections. To address aforementioned problem, we propose a high recall multiscale feature fusion model for RS change interpretation. Initially, the RaHFF-Net extracts hierarchical multiscale feature from bitemporal RS images; Then, it employs CNN and Transformer to effectively merge local and global information across same-scale, cross-scale, and multiscale features. Finally, to address the issue of instance imbalance in CD, a novel hyperexpectation push pull loss regularization term is proposed. This loss function is designed to elevate the expected predictions of positive instances across the dataset, thereby enabling the development of a deep learning model with a high recall rate.

Remote sensing change detection(RSCD) aims to identify the regions of interest that have changed between dual-temporal images. However, most deep models predict CD results by extracting multi-scale hybrid features, which could easily lead to ambiguous semantic boundaries; in addition, the existing feature acquisition tends to lack consideration of capturing their diversity usually causing poor model generalization. Thus, this paper decomposes the mixed features into change and invariant features jointly with stochastic distribution sampling and convolution thus accomplishing robust RSCD based on decoupled representations. In the training stage, the posterior distribution of the uncoupled features is first learned through label calibration to train the prior distribution generator; then, robust feature decoupling is implemented combining the convolutional feature separator with re-parameterized sampling over the decoupled posteriori distribution, and further aggregating the decoupled features through prototype learning; finally, the exceed-expectation loss regularizer is proposed to push or pull these positive and negative sample features to a more distant end, thereby increasing the inter-class distance by boosting the predicted expectation. In the testing stage, the robust RSCD based on decoupled representation is accomplished through the feature separator, decoupled prior distribution random sampling, and CD head without posterior distribution support. Experiments prove that DSFDcd has achieved remarkable results in terms of qualitative and quantitative metrics. Our codes will be available at https://github.com/iceking111/DSFDcd.