23 April 2024 in IEEE Transactions on Biomedical Engineering
In the field of medical imaging, the fusion of data from diverse modalities plays a pivotal role in advancing our understanding of pathological conditions. Sparse representation (SR), a robust signal modeling technique, has demonstrated noteworthy success in multi-dimensional (MD) medical image fusion. However, a fundamental limitation appearing in existing SR models is their lack of directionality, restricting their efficacy in extracting anatomical details from different imaging modalities. To tackle this issue, we propose a novel directional SR model, termed complex sparse representation (ComSR), specifically designed for medical image fusion. ComSR independently represents MD signals over directional dictionaries along specific directions, allowing precise analysis of intricate details of MD signals. Besides, current studies in medical image fusion mostly concentrate on addressing either 2D or 3D fusion problems. This work bridges this gap by proposing a MD medical image fusion method based on ComSR, presenting a unified framework for both 2D and 3D fusion tasks. Experimental results across six multi-modal medical image fusion tasks, involving 93 pairs of 2D source images and 20 pairs of 3D source images, substantiate the superiority of our proposed method over 11 state-of-the-art 2D fusion methods and 4 representative 3D fusion methods, in terms of both visual quality and objective evaluation.
27 April 2022 in IEEE Sensors Letters
In the field of image fusion, great progress has been achieved in sparse representation (SR)-based methods with the advent of considerable efficacious algorithms being developed. The improvement of SR-based image fusion methods mainly focuses on pursuing better signal representation as well as effective measurement to sparse coefficients. However, the preprocessing strategy, which plays an important role in SR-based fusion methods, is rarely investigated. The traditional preprocessing strategies such as the zero-mean normalized strategy result in the loss of low-frequency information and insufficient detail extraction. To address the above issues, we propose a local contrast (LC)-based preprocessing strategy, since local contrast can be harnessed to capture geometrical visual patterns as well as preserve comprehensive information. Experimental results on multifocus and multimodal image fusion tasks demonstrate that the proposed preprocessing strategy outperforms the traditional ones in terms of both visual quality and objective evaluation.
18 June 2024 in IEEE Sensors Journal
Multi-focus image fusion aims to merge source images with distinct focused areas into a single, fully focused fused image. Sparse representation (SR) stands out as a robust signal modeling technique that has achieved remarkable success in multi-focus image fusion. Numerous SR-based fusion methods have been proposed over the years, underscoring the importance of SR in enhancing fusion quality. However, a fundamental problem appearing in most existing SR models is the absence of directionality. This deficiency restricts their capacity to extract intricate details. To address this issue, we propose the complex sparse representation (CSR) model for image fusion. This model utilizes the properties of hypercomplex signals to extract directional information from real-valued signals through complex extension. Subsequently, the directional components of the input signal are decomposed into sparse coefficients over corresponding directional dictionaries. The key advantage of our design over conventional SR models is the ability to capture the geometrical image structures effectively, since CSR coefficients can provide precise measurements of detailed information along specific directions. Experimental results conducted on three widely-used multi-focus image fusion datasets substantiate the superiority of our method over 17 representative multi-focus image fusion methods in terms of both visual quality and objective evaluation.
29 March 2026 in Information Fusion