Artificial Intelligence (AI) algorithms for automatic lung nodule detection and classification can assist radiologists in their daily routine of chest CT evaluation. Even though many AI algorithms for these tasks have already been developed, their implementation in the clinical workflow is still largely lacking. Apart from the significant number of false-positive findings, one of the reasons for that is the bias that these algorithms may contain. In this review, different types of biases that may exist in chest CT AI nodule detection and classification algorithms are listed and discussed. Examples from the literature in which each type of bias occurs are presented, along with ways to mitigate these biases. Different types of biases can occur in chest CT AI algorithms for lung nodule detection and classification. Mitigation of them can be very difficult, if not impossible to achieve completely.
Objective: The aim of this phantom study was to investigate the effect of scan parameters and noise suppression techniques on the minimum radiation dose for acceptable image quality for CT emphysema densitometry. Methods: The COPDGene phantom was scanned on a third generation dual-source CT system with 16 scan setups (CTDIvol 0.035–10.680 mGy). Images were reconstructed at 1.0/0.7 mm slice thickness/increment, with three kernels (one soft, two hard), filtered backprojection and three grades of third-generation iterative reconstruction (IR). Additionally, deep learning-based noise suppression software was applied. Main outcomes: overlap in area of the normalized histograms of CT density for the emphysema insert and lung material, and the radiation dose required for a maximum of 4.3% overlap (defined as acceptable image quality). Results: In total, 384 scan reconstructions were analyzed. Decreasing radiation dose resulted in an exponential increase of the overlap in normalized histograms of CT density. The overlap was 11–91% for the lowest dose setting (CTDIvol 0.035mGy). The soft kernel reconstruction showed less histogram overlap than hard filter kernels. IR and noise suppression also reduced overlap. Using intermediate grade IR plus noise suppression software allowed for 85% radiation dose reduction while maintaining acceptable image quality. Conclusion: CT density histogram overlap can quantify the degree of discernibility of emphysema and healthy lung tissue. Noise suppression software, IR, and soft reconstruction kernels substantially decrease the dose required for acceptable image quality. Advances in knowledge: Noise suppression software, IR, and soft reconstruction kernels allow radiation dose reduction by 85% while still allowing differentiation between emphysema and normal lung tissue.
The objective of this study is to evaluate the feasibility of a disease-specific deep learning (DL) model based on minimum intensity projection (minIP) for automated emphysema detection in low-dose computed tomography (LDCT) scans. LDCT scans of 240 individuals from a population-based cohort in the Netherlands (ImaLife study, mean age ± SD = 57 ± 6 years) were retrospectively chosen for training and internal validation of the DL model. For independent testing, LDCT scans of 125 individuals from a lung cancer screening cohort in the USA (NLST study, mean age ± SD = 64 ± 5 years) were used. Dichotomous emphysema diagnosis based on radiologists’ annotation was used to develop the model. The automated model included minIP processing (slab thickness range: 1 mm to 11 mm), classification, and detection maps generation. The data-split for the pipeline evaluation involved class-balanced and imbalanced settings. The proposed DL pipeline showed the highest performance (area under receiver operating characteristics curve) for 11 mm slab thickness in both the balanced (ImaLife = 0.90 ± 0.05) and the imbalanced dataset (NLST = 0.77 ± 0.06). For ImaLife subcohort, the variation in minIP slab thickness from 1 to 11 mm increased the DL model’s sensitivity from 75 to 88% and decreased the number of false-negative predictions from 10 to 5. The minIP-based DL model can automatically detect emphysema in LDCTs. The performance of thicker minIP slabs was better than that of thinner slabs. LDCT can be leveraged for emphysema detection by applying disease specific augmentation.
Objective: To develop an automatic COVID-19 Reporting and Data System (CO-RADS)–based classification in a multi-demographic setting. Methods: This multi-institutional review boards–approved retrospective study included 2720 chest CT scans (mean age, 58 years [range 18–100 years]) from Italian and Russian patients. Three board-certified radiologists from three countries assessed randomly selected subcohorts from each population and provided CO-RADS–based annotations. CT radiomic features were extracted from the selected subcohorts after preprocessing steps like lung lobe segmentation and automatic noise reduction. We compared three machine learning models, logistic regression (LR), multilayer perceptron (MLP), and random forest (RF) for the automated CO-RADS classification. Model evaluation was carried out in two scenarios, first, training on a mixed multi-demographic subcohort and testing on an independent hold-out dataset. In the second scenario, training was done on a single demography and externally validated on the other demography. Results: The overall inter-observer agreement for the CO-RADS scoring between the radiologists was substantial (k = 0.80). Irrespective of the type of validation test scenario, suspected COVID-19 CT scans were identified with an accuracy of 84%. SHapley Additive exPlanations (SHAP) interpretation showed that the “wavelet_(LH)_GLCM_Imc1” feature had a positive impact on COVID prediction both with and without noise reduction. The application of noise reduction improved the overall performance between the classifiers for all types. Conclusion: Using an automated model based on the COVID-19 Reporting and Data System (CO-RADS), we achieved clinically acceptable performance in a multi-demographic setting. This approach can serve as a standardized tool for automated COVID-19 assessment. Keypoints: • Automatic CO-RADS scoring of large-scale multi-demographic chest CTs with mean AUC of 0.93 ± 0.04.• Validation procedure resembles TRIPOD 2b and 3 categories, enhancing the quality of experimental design to test the cross-dataset domain shift between institutions aiding clinical integration.• Identification of COVID-19 pneumonia in the presence of community-acquired pneumonia and other comorbidities with an AUC of 0.92.
Challenges such as class imbalance, time intensive visual scoring, and limited amounts of labeled data are often encountered while accessing lung cancer screening low-dose computed tomography (LDCT) data for automated emphysema detection. To tackle these issues, we propose a generative adversarial network (GAN) based on unsupervised anomaly detection (UAD) to identify emphysema in LDCT. And to initiate disease specific feature learning, we introduce data augmentation based on minimum intensity projection (minIP) for the adversarial framework. The generator of the UAD model resembles an image latent-image configuration consisting of fully convolutional encoder-decoder architecture with skip connections. The discriminator is an encoder, which acts as a feature extractor and a classifier. We tested the robustness of the minIP based UAD model by adding anomalies to the training set. Furthermore to illustrate the usefulness of minIP and to serve as a comparison methodology for emphysema detection in LDCT, the proposed model was compared to the 2.5D transfer learning model. Visualization techniques like post processed residual images and Grad-cam maps were used to explain the UAD model inference. Our proposed minIP based UAD model showed an area under the curve of 0.91 0.02 for emphysema detection in LDCT. The UAD model was robust to inclusion of anomalies up to 3%. The augmentation improved the sensitivity of the transfer learning model by 2% however the UAD model outperformed the transfer learning model. The UAD model with minIP is a potential computer-aided tool for early detection of emphysema in lung cancer screening data.