Infrared–visible image fusion is valuable across various applications due to the complementary information that it provides. However, the current fusion methods face challenges in achieving high-quality fused images. This paper identifies a limitation in the existing fusion framework that affects the fusion quality: modal differences between infrared and visible images are often overlooked, resulting in the poor fusion of the two modalities. This limitation implies that features from different sources may not be consistently fused, which can impact the quality of the fusion results. Therefore, we propose a framework that utilizes feature-based decomposition and domain normalization. This decomposition method separates infrared and visible images into common and unique regions. To reduce modal differences while retaining unique information from the source images, we apply domain normalization to the common regions within the unified feature space. This space can transform infrared features into a pseudo-visible domain, ensuring that all features are fused within the same domain and minimizing the impact of modal differences during the fusion process. Noise in the source images adversely affects the fused images, compromising the overall fusion performance. Thus, we propose the non-local Gaussian filter. This filter can learn the shape and parameters of its filtering kernel based on the image features, effectively removing noise while preserving details. Additionally, we propose a novel dense attention in the feature extraction module, enabling the network to understand and leverage inter-layer information. Our experiments demonstrate a marked improvement in fusion quality with our proposed method.
22 August 2025 in IEEE Transactions on Geoscience and Remote Sensing
Currently, due to the densely packed and varied orientations of objects in the remote sensing images, the oriented object detection is still a challenging task. In the existing methods, the oriented bounding box (OBB) representations either include angle parameters or require a larger number of parameters and additional processes to obtain the final rotated rectangles, which can potentially induce the positional errors and decrease the accuracy of object detection in remote sensing images. In this paper, we propose a unified five-distance bounding box representation for remote sensing oriented object detection, which gets rid of the utilization of angle parameters and simultaneously represents the OBBs with the least distance-based parameters. We then construct a unified five-distance region proposal network (UF-RPN) based on the new OBB representation to achieve higher performance of oriented object detection. Additionally, most existing two-stage methods assume that the localization errors of objects are relatively small in the second stage of the network and believe that directly regressing the errors of general OBB representation would achieve sufficiently-high performance of object detection, neglecting that there is still room for improvement in the detection head by utilizing a more advanced OBB representation. Therefore, a five-distance detection head (FD-Head) is developed by utilizing the five-distance OBB representation in the detection head. Experimental results on the HRSC2016, DIOR-R, DOTA-v1.0 and DOTA-v2.0 datasets demonstrate the superiority and robustness of our method. Our code is publicly available at https://github.com/QYJ123/UFDet.
This article primarily focuses on the study of image-based localization technology. While traditional methods have made significant advancements in technology and applications, the emerging field of visual image-based localization technology demonstrates tremendous potential for research. Deep learning has exhibited a strong performance in image processing, particularly in developing visual navigation and localization techniques using large-scale visual models. This paper introduces a sophisticated scene image localization technique based on large models in a vast spatial sample environment. The study involved training convolutional neural networks using millions of geographically labeled images, extracting image position information using large model algorithms, and collecting sample data under various conditions in elastic scene space. Through visual computation, the shooting position of photos was inferred to obtain the approximate position information of users. This method utilizes geographic location information to classify images and combines it with landmarks, natural features, and architectural styles to determine their locations. The experimental results show variations in positioning accuracy among different models, with the most optimal model obtained through training on a large-scale dataset. They also indicate that the positioning error in urban street-based images is relatively small, whereas the positioning effect in outdoor and local scenes, especially in large-scale spatial environments, is limited. This suggests that the location information of users can be effectively determined through the utilization of geographic data, to classify images and incorporate landmarks, natural features, and architectural styles. The study’s experimentation indicates the variation in positioning accuracy among different models, highlighting the significance of training on a large-scale dataset for optimal results. Furthermore, it highlights the contrasting impact on urban street-based images versus outdoor and local scenes in large-scale spatial environments.
1 January 2026 in IEEE Transactions on Intelligent Transportation Systems
Visual image-based localization is important to intelligent systems, greatly influencing Earth science uses. However, variability in lighting conditions can impair the performance of such systems, particularly for single-image localization tasks. This article proposes an original all-day visual localization model that incorporates visible and infrared (IR) imagery, boosting its robustness to lighting changes. The proposed model takes on a large-scale architecture, exploiting the capabilities of both image modalities to achieve better localization accuracy across different lighting situations. The contributions of this study include: 1) a multimodal fusion approach correlates visual data with geographic coordinates, refining the precision of image localization; 2) an adaptive fusion mechanism is implemented, adjusting the contribution of each image stream in response to environmental cues, thereby ensuring more reliable localization outcomes; and 3) a lightweight localization method that utilizes a single image for outdoor localization, eliminating the need for additional sensor data. We have conducted extensive testing, including shared datasets and random experiments, and the results show that our designed model not only improves localization accuracy in different dimensions compared to other models but also enhances the coverage of the lighting environment. It can also achieve image localization in nighttime environments and simulate the ability of human eyes to perceive environmental location information.