Jiao Du

Jiao Du

Auto-generated profile, based on publicly available information

Jiao Du

School of Computer Science and Cyber Engineering, Guangzhou University, Guangzhou, China

Research Focus & Metrics

Academic Career Length

9Years (2018-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
8 May 2023 in IEEE Transactions on Multimedia
Verified
Journal Article
Closed access
JWJinyu Wen
Jinyu Wen
FQFeiwei Qin
Feiwei Qin
JDJiao Du
Jiao Du
MFMeie Fang
Meie Fang
XWXinhua Wei
Xinhua Wei
PLPing Li
Ping Li
Multimodal image fusion plays an essential role in medical image analysis and application, where computed tomography (CT), magnetic resonance (MR), single-photon emission computed tomography (SPECT), and positron emission tomography (PET) are commonly-used modalities, especially for brain disease diagnoses. Most existing fusion methods do not consider the characteristics of medical images, and they adopt similar strategies and assessment standards to natural image fusion. While distinctive medical semantic information (MS-Info) is hidden in different modalities, the ultimate clinical assessment of the fusion results is ignored. Our MsgFusion first builds a relationship between the key MS-Info of the MR/CT/PET/SPECT images and image features to guide the CNN feature extractions using two branches and the design of the image fusion framework. For MR images, we combine the spatial domain feature and frequency domain feature (SF) to develop one branch. For PET/SPECT/CT images, we integrate the gray color space feature and adapt the HSV color space feature (GV) to develop another branch. A classification-based hierarchical fusion strategy is also proposed to reconstruct the fusion images to persist and enhance the salient MS-Info reflecting anatomical structure and functional metabolism. Fusion experiments are carried out on many pairs of MR-PET/SPECT and MR-CT images. According to seven classical objective quality assessments and one new subjective clinical quality assessment from 30 clinical doctors, the fusion results of the proposed MsgFusion are superior to those of the existing representative methods.

5 August 2022 in IEEE Journal of Biomedical and Health Informatics
Verified
Journal Article
Closed access
GWGuofen Wang
Guofen Wang
WLWeisheng Li
Weisheng Li
JDJiao Du
Jiao Du
BXBin Xiao
Bin Xiao
XGXinbo Gao
Xinbo Gao
Medical image fusion technology integrates the contents of medical images of different modalities, thereby assisting users of medical images to better understand their meaning. However, the fusion of medical images corrupted by noise remains a challenge. To solve the existing problems in medical image fusion and denoising algorithms related to excessive blur, unclean denoising, gradient information loss, and color distortion, a novel medical image fusion and denoising algorithm is proposed. First, a new image layer decomposition model based on hybrid variation-sparse representation and weighted Schatten p-norm is proposed. The alternating direction method of multipliers is used to update the structure, detail layer dictionary, and detail layer coefficient map of the input image while denoising. Subsequently, appropriate fusion rules are employed for the structure layers and detail layer coefficient maps. Finally, the fused image is restored using the fused structure layer, detail layer dictionary, and detail layer coefficient maps. A large number of experiments confirm the superiority of the proposed algorithm over other algorithms. The proposed medical image fusion and denoising algorithm can effectively remove noise while retaining the gradient information without color distortion.


25 July 2019 in IEEE Journal of Biomedical and Health Informatics
Verified
Journal Article
Closed access
JDJiao Du
Jiao Du
WLWeisheng Li
Weisheng Li
HTHengliang Tan
Hengliang Tan
The recently developed multiscale-based fusion methods can be improved with two approaches: an advanced image decomposition scheme and an advanced fusion rule. In this paper, three-layer image decomposition, enhanced illumination fusion rule-based fusion method is proposed. The proposed method includes three steps. First, each input image is decomposed into its corresponding smooth, texture and edge layers using defined local extrema and low-pass filters in the spatial domain. Second, three different strategies are applied as fusion rules for the three-layer representation. To preserve the illumination closely related to tumors, the illumination is corrected by applying a higher contrast to the decomposed image details, including the texture and edge inputs, such as those found in grayscale CT and MRI images. The final fused image is created by the addition of the normalized smooth, texture and edge image layers. The experiments demonstrate that the proposed method performs better than the existing state-of-the-art fusion methods.

11 September 2018 in IEEE Transactions on Biomedical Engineering
Verified
Journal Article
Closed access
WLWeisheng Li
Weisheng Li
JDJiao Du
Jiao Du
ZZZhengmin Zhao
Zhengmin Zhao
JLJinyi Long
Jinyi Long
Detail information on objects of interest plays a vital role in current medical diagnosis. However, the existing multimodal sensor fusion methods cause problems of low contrast and color distortion during the process of integration. Therefore, the preservation of detail information in high contrast is worthy of investment in the field of medical image fusion. This paper presents a new multiscale fusion-based framework using the local Laplacian pyramid transform (LLP) and adaptive cloud model (ACM). The proposed framework, LLP+ACM, includes three key modules. First, the input images are decomposed into detail-enhanced approximate and residual images using LLP. Second, ACM is adopted to fuse the approximate images. A salience match tool is used to fuse the residual images. Third, the fused image is reconstructed using the inversed LLP. Experiments show that the proposed LLP+ACM significantly improves detail information with high contrast and reduces the color distortion of the fused images in both subjective and objective evaluations.

27 February 2019 in IEEE Access
Verified
Journal Article
Open access
JDJiao Du
Jiao Du
WLWeisheng Li
Weisheng Li
HTHeliang Tan
Heliang Tan
It is difficult to extract both structural and functional information from the input grey MRI and pseudo-color PET images using the same decomposition scheme in multi-scale transform fusion methods. To overcome this limitation, we propose two algorithms based on intrinsic image decomposition to decompose MRI and PET images into its two separate components in the spatial domain. Algorithm 1 could extract structural information while reducing the noise from MRI image. Algorithm 2 is for averaging the color information from PET image. As for the image fusion rule, the defined importance of image coefficients is used to combine the decomposed two-scale components to produce the final fused image, which could keep more spatial resolution with substitution strategies. It demonstrates that the proposed fusion methods could improve the values of mutual information by the metrics on disease database. Furthermore, the proposed methods produce the competitive visual signal-to-noise ratio values on experiments for robustness database. In addition to the variance in metrics values, the non-parametric Friedman test and the post-hoc Bonferroni-Dunn test are used to analysis the significance difference between the proposed and the state-of-the-arts methods.