Background Commercially available artificial intelligence (AI) tools can assist radiologists in interpreting chest radiographs, but their real-life diagnostic accuracy remains unclear. Purpose To evaluate the diagnostic accuracy of four commercially available AI tools for detection of airspace disease, pneumothorax, and pleural effusion on chest radiographs. Materials and Methods This retrospective study included consecutive adult patients who underwent chest radiography at one of four Danish hospitals in January 2020. Two thoracic radiologists (or three, in cases of disagreement) who had access to all previous and future imaging labeled chest radiographs independently for the reference standard. Area under the receiver operating characteristic curve, sensitivity, and specificity were calculated. Sensitivity and specificity were additionally stratified according to the severity of findings, number of findings on chest radiographs, and radiographic projection. The χ² and McNemar tests were used for comparisons. Results The data set comprised 2040 patients (median age, 72 years [IQR, 58-81 years]; 1033 female), of whom 669 (32.8%) had target findings. The AI tools demonstrated areas under the receiver operating characteristic curve ranging 0.83-0.88 for airspace disease, 0.89-0.97 for pneumothorax, and 0.94-0.97 for pleural effusion. Sensitivities ranged 72%-91% for airspace disease, 63%-90% for pneumothorax, and 62%-95% for pleural effusion. Negative predictive values ranged 92%-100% for all target findings. In airspace disease, pneumothorax, and pleural effusion, specificity was high for chest radiographs with normal or single findings (range, 85%-96%, 99%-100%, and 95%-100%, respectively) and markedly lower for chest radiographs with four or more findings (range, 27%-69%, 96%-99%, 65%-92%, respectively) (P < .001). AI sensitivity was lower for vague airspace disease (range, 33%-61%) and small pneumothorax or pleural effusion (range, 9%-94%) compared with larger findings (range, 81%-100%; P value range, > .99 to < .001). Conclusion Current-generation AI tools showed moderate to high sensitivity for detecting airspace disease, pneumothorax, and pleural effusion on chest radiographs. However, they produced more false-positive findings than radiology reports, and their performance decreased for smaller-sized target findings and when multiple findings were present. © RSNA, 2023 Supplemental material is available for this article. See also the editorial by Yanagawa and Tomiyama in this issue.

Background Automated interpretation of normal chest radiographs could alleviate the workload of radiologists. However, the performance of such an artificial intelligence (AI) tool compared with clinical radiology reports has not been established. Purpose To perform an external evaluation of a commercially available AI tool for (a) the number of chest radiographs autonomously reported, (b) the sensitivity for AI detection of abnormal chest radiographs, and (c) the performance of AI compared with that of the clinical radiology reports. Materials and Methods In this retrospective study, consecutive posteroanterior chest radiographs from adult patients in four hospitals in the capital region of Denmark were obtained in January 2020, including images from emergency department patients, in-hospital patients, and outpatients. Three thoracic radiologists labeled chest radiographs in a reference standard based on chest radiograph findings into the following categories: critical, other remarkable, unremarkable, or normal (no abnormalities). AI classified chest radiographs as high confidence normal (normal) or not high confidence normal (abnormal). Results A total of 1529 patients were included for analysis (median age, 69 years [IQR, 55-69 years]; 776 women), with 1100 (72%) classified by the reference standard as having abnormal radiographs, 617 (40%) as having critical abnormal radiographs, and 429 (28%) as having normal radiographs. For comparison, clinical radiology reports were classified based on the text and insufficient reports excluded (n = 22). The sensitivity of AI was 99.1% (95% CI: 98.3, 99.6; 1090 of 1100 patients) for abnormal radiographs and 99.8% (95% CI: 99.1, 99.9; 616 of 617 patients) for critical radiographs. Corresponding sensitivities for radiologist reports were 72.3% (95% CI: 69.5, 74.9; 779 of 1078 patients) and 93.5% (95% CI: 91.2, 95.3; 558 of 597 patients), respectively. Specificity of AI, and hence the potential autonomous reporting rate, was 28.0% of all normal posteroanterior chest radiographs (95% CI: 23.8, 32.5; 120 of 429 patients), or 7.8% (120 of 1529 patients) of all posteroanterior chest radiographs. Conclusion Of all normal posteroanterior chest radiographs, 28% were autonomously reported by AI with a sensitivity for any abnormalities higher than 99%. This corresponded to 7.8% of the entire posteroanterior chest radiograph production. © RSNA, 2023 Supplemental material is available for this article. See also the editorial by Park in this issue.

Objectives: To investigate the diagnostic impact and performance of spectral dual-layer detector CT in the detection and characterization of cancer compared to conventional CE-CT. Methods: In a national workup program for occult cancer, 503 patients (286 females and 217 males) were prospectively enrolled for a contrast-enhanced spectral CT scan. The readings were performed with and without spectral data available. A minimum of 3 months between interpretations was implemented to minimize recall bias. The sequence of reads for the individual patient was randomized. Readers were blinded for patient identifiers and clinical outcome. Two radiologists with 9 and 33 years of experience performed the readings in consensus. If disagreement, a third radiologist with 11 years of experience determined the outcome of the reading Results: Significantly more cancer findings were identified on the spectral reading. In 73 cases of proven cancer, we found a sensitivity of 89% vs 77% and a specificity of 77% vs 83% on spectral CT compared to conventional CT. A slight increase in reading time in spectral images of 82 s was found (382 vs 300, p < 0.001). For all cystic lesions, the perceived diagnostic certainty increased from 30% being completely certain to 96% most pronounced in the kidney, liver, thyroid, and ovaries. And adding the spectral information to the reading gave a decrease in follow-up examination for diagnostic certainty (0.25 vs 0.81 per reading, p < 0.001). Conclusion: The use of contrast-enhanced spectral CT increases the confidence of the radiologists in correct characterization of various lesions and minimizes the need for supplementary examinations. Key Points: • Spectral CT is associated with a higher sensitivity, but a slightly lower specificity compared to conventional CT. • Spectral CT increases the confidence of the radiologists. • The need for supplementary examinations is decreased, with only a slight increase in reading times.

Distant metastases are found in the many of patients with lung cancer at time of diagnosis. Several diagnostic tools are available to distinguish between metastatic spread and benign lesions in the adrenal gland. However, all require additional diagnostic steps after the initial CT. The purpose of this study was to evaluate if texture analysis of CT-abnormal adrenal glands on the initial CT correctly differentiates between malignant and benign lesions in patients with confirmed lung cancer. In this retrospective study 160 patients with endoscopic ultrasound-guided biopsy from the left adrenal gland and a contrast-enhanced CT in portal venous phase were assessed with texture analysis. A region of interest encircling the entire adrenal gland was used and from this dataset the slice with the largest cross section of the lesion was analyzed individually. Several texture parameters showed statistically significantly difference between metastatic and benign lesions but with considerable between-groups overlaps in confidence intervals. Sensitivity and specificity were assessed using ROC-curves, and in univariate binary logistic regression the area under the curve ranged from 36 % (Kurtosis 0.5) to 69 % (Entropy 2.5) compared to 73 % in the best fitting model using multivariate binary logistic regression. In lung cancer patients with abnormal adrenal gland at imaging, adrenal gland texture analyses appear not to have any role in discriminating benign from malignant lesions.

A commercial AI tool used off-label correctly excluded pathology in 24.5%–52.7% of unremarkable chest radiographs at greater than or equal to 98% sensitivity, with lower rates of critical misses than radiology reports.