By integrating effective features of multi-modality medical images to provide richer information, multi-modality medical image fusion has been substantially used in computer-aided diagnosis applications. However, many existing fusion schemes do not consider how to eliminate the effects of the noise in source medical images and cannot provide enough details and textures for disease diagnosis. To address the problems above, we propose a new fidelity-driven optimization (FDO) reconstruction and details preserving guided-based fusion method for multi-modality medical images. To overcome the influence of noise in multi-modality medical images, a rank coefficient optimization method of low-rank approximation based on weighted mean curvature is proposed to reconstruct multi-modality medical image. Moreover, we propose an iterative detail preserving guided fusion (DPGF) method to integrate more textures and detail information of source multi-modality medical images, while ensuring high signal-to noise ratios. The experimental results show that the proposed method outperforms some of the state-of-the-art fusion methods. Specifically, the extensive experiments prove that our method has high robustness for noisy medical images, which also indicates the application prospects in diagnosis applications. Supplemental material and codes of this work are publicly available at https://github.com/VCMHE/FDO_DPGF.
14 April 2021 in IEEE Transactions on Instrumentation and Measurement
Multimodal medical image fusion technology has been widely used in various applications of clinical diagnosis, which aims to provide richer information by integrating effective features of multiple medical images. In this article, a novel fusion scheme based on region-preserving edge enhancement is proposed for medical images. The overlapping regions of source images that need to be fused are detected first. Next, according to the different visual features, the overlapping map is divided by Fuzzy c-means (FCM)-based algorithm. Then, different fusion strategies based on visual saliency and texture details are proposed for region-preserving and edge enhancement. Experimental results show that the proposed scheme can effectively highlight the visual features and retain key information. Furthermore, the performance of different medical images also demonstrates that the proposed method can obtain better results than those achieved by some of the state-of-the-art methods.
Image registration is an important research topic in medical image-guided therapy, which is dedicated to registering the high-dose imaging sequences with low-dose/faster means. Registering computer tomography (CT) scanning sequences with cone beam computer tomography (CBCT) scanning sequences is a typical application and has been widely used in CBCT-guided radiotherapy. The main problem is the difference in image clarity of these two image sequences. To solve this problem, for the single projection image sequence matching tasks encountered in medical practice, a novel local quality based curved section encoding strategy is proposed in this paper, which is called the high-quality curved section (HQCS). As an optimized cross-section regularly encoded along the sequence of image, this curved section could be used in order to solve the matching problem. Referencing the independent ground truth provided by medical image physicians, with an experiment combined with the four most widely used indicators used on image registration, matching performance of HQCS on CT/CBCT datasets was tested with varying clarity. Experimental results show that the proposed HQCS can register the CT/CBCT effectively and outperforms the commonly used methods. Specifically, the proposed HQCS has low time complexity and higher scalability, which indicates that the application enhanced the task of diagnosis.
Cone beam CT (CBCT) is one of the main imaging devices adopted in image guided radiotherapy (IGRT). However, as a respective advanced radiotherapy technology, it limits the contribution of IGRT when the IGRT is performed in default IGRT workflow, since the imaging characteristics, registration methods, evaluation criterion, and even crucial organs at risks (OARs) are different as the tumor site changes. In this paper, we propose a novel specialized IGRT workflow based on the subtypes of diagnosis site. Three site-specific IGRT workflow, for head and neck site, chest site and abdomen site are stated separately, organized with preparation of reference images and structures, parameters setting of image acquisition and reconstruction, image registration, registration results assessment, positioning correction, changing frequency of IGRT practice, as well as review and analysis of IGRT data. The responsibilities of radiotherapy team (oncologists, medical physicists and radiotherapy therapists) in site-specific IGRT workflow are also demonstrated.