Chaoqun Sima

Chaoqun Sima

Auto-generated profile, based on publicly available information

Chaoqun Sima

Faculty of Computer Science and Technology, Qilu University of Technology (Shandong Academy of Sciences), Jinan, China

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
11 September 2024 in IEEE Transactions on Instrumentation and Measurement
Verified
Journal Article
Closed access
GLGuohua Lv
Guohua Lv
CSChaoqun Sima
Chaoqun Sima
YGYongbiao Gao
Yongbiao Gao
ADAimei Dong
Aimei Dong
GMGuangxiao Ma
Guangxiao Ma
JCJinyong Cheng
Jinyong Cheng
In the field of image fusion, the fusion of infrared and visible images emerges as a crucial work, retaining the inherent characteristics of each source image for the creation of high-quality fusion images. However, existing fusion algorithms primarily prioritize visual performance and statistical metrics, often neglecting the requisites of high-level vision tasks. To bridge this gap, our paper proposes SIGFusion, an end-to-end method for infrared and visible image fusion. SIGFusion not only considers the visual performance and statistical metrics of the fused image but also focuses on meeting the demands of subsequent high-level vision tasks, thereby enhancing performance in fusion and high-level vision tasks. Concretely, we define significant semantic information as salient targets presenting in both infrared and visible images. By utilizing targets, our fusion network is guided to enhance these salient targets. In contrast to the isolated employ of either infrared or visible images, our target-based method comprehensively utilizes the semantic information within the image. Additionally, the utilization of target-based self-attention loss enhances the extraction of vital information from the source image. It is worth noting that masks are only necessary during the training stage and are automatically generated through detection algorithms. We conduct experiments in both image fusion and high-level vision tasks. Experimental results demonstrate the effectiveness of SIGFusion in both infrared and visible image fusion tasks, as well as in subsequent high-level vision tasks. The source code is available at https://github.com/poison-pig/SIGFusion.

12 March 2026 in IEEE Transactions on Multimedia
Verified
Journal Article
Closed access
GLGuohua Lv
Guohua Lv
CSChaoqun Sima
Chaoqun Sima
JWJuncan Wang
Juncan Wang
YGYongbiao Gao
Yongbiao Gao
ZWZhonghe Wei
Zhonghe Wei
JCJinyong Cheng
Jinyong Cheng
Image fusion involves integrating the information of multiple source images into one fused image, maximizing each source image's advantages. Existing image fusion methods combining text information mainly focus on enhancing the fusion effect, ignoring the requirements of subsequent tasks. High level task oriented fusion methods are usually limited to image information processing, ignoring the potential of text information at the high-level semantic, such as scene understanding and target recognition. We propose an image fusion method called TextFuse, which combines text information and subsequent task requirements, to guide image fusion through the text description generated by the source image and subsequent task requirements. Specifically, we use the text generation model to generate text descriptions for the source image, and design strategies to generate additional text information for key areas to comprehensively express the content of the source image. In the fusion process, we use text information and detection network to guide the model, so as to enhance the model's understanding of the image, generate a fusion image containing rich semantic information and visual details, and improve the performance in subsequent tasks. The text information provides additional semantic context for the image fusion process, enhances the details of key areas, and significantly improves the quality of the fused image. At the same time, the guidance of subsequent tasks further optimized the performance of fused images in follow-up tasks. Experimental results show that the proposed method is significantly better than the state-of-the-art image fusion methods in terms of visual effect and follow-up task performance. The source code is available at: https://github.com/poison-pig/TextFuse.