To solve the problem that traditional image registration methods based on continuous optimization for large motion lung 4D CT image sequences are easy to fall into local optimal solutions and lead to serious misregistration, a novel image registration method based on high-order Markov Random Field (MRF) is proposed. By analyzing the effect of the deformation field constraint of the potential functions with different order cliques in MRF model, energy functions with high-order cliques form are designed separately for 2D and 3D images to preserve topology of the deformation field. In order to preserve the topology of the deformation field more effectively, it is necessary to apply a smooth term and a topology preservation term simultaneously in the energy function and use logarithmic function to impose a penalty on the Jacobian matrix with high-order cliques in the topology preservation term. For the complexity of the designed energy function with high-order cliques form, Markov Chain Monte Carlo (MCMC) algorithm is used to solve the optimization problem of the designed energy function. To address the high computational requirements in lung 4D CT image registration, a multi-level processing strategy is adopted to reduce the space complexity of the proposed registration method and promotes the computational efficiency. In the DIR-lab dataset with 4D CT images and the COPD (Chronic Obstructive Pulmonary Disease) dataset with 3D CT images, the average target registration error (TRE) of our proposed method can reach 0.95mm respectively.
21 October 2022 in IEEE Journal of Biomedical and Health Informatics
Achieving the pathological type diagnosis of pulmonary nodules on chest CT is a critical step in the early detection of lung cancer and treatment of patients. Based on a small and unbalanced self-constructed dataset, we achieved intelligent diagnosis of five pathological types including adenocarcinoma, squamous cell carcinoma, small cell carcinoma, inflammatory and other benign diseases for the first time. In order to reduce the dependence of deep convolutional neural network (DCNN) on a large amount of training data, a reverse adversarial classification network (RACN) was proposed based on semi-supervised learning, which consists of a reverse generative adversarial network (RGAN) for unsupervised regression and a supervised classification network (CN). In RGAN, five specific normal distributions P with different means and variances were assigned to represent the five pathological types, and then a special regression task was designed by mapping pulmonary nodules to the random sampling Z of P. The input of generator in RGAN is set to 3D nodule volume data, the inputs of discriminator are set to Z and the output of generator. The regression task enables RGAN to extract specific features, which will be deeply integrate into CN to improve the classification performance. Experiments showed that the average sensitivity of RACN in detecting malignant nodules was 0.6525, where the sensitivity of adenocarcinoma, small cell carcinoma and squamous cell carcinoma was 0.8426, 0.5604 and 0.5543. Besides, the RACN can achieve 93.21% accuracy for diagnosing malignant nodules on the public LIDC-IDRI dataset, obtaining the state-of-the-art results.
1 October 2021 in Computer Methods and Programs in Biomedicine