In this study, we aimed to predict mechanical ventilation requirement and mortality using computational modeling of chest radiographs (CXRs) for coronavirus disease 2019 (COVID-19) patients. This two-center, retrospective study analyzed 530 deidentified CXRs from 515 COVID-19 patients treated at Stony Brook University Hospital and Newark Beth Israel Medical Center between March and August 2020. Linear discriminant analysis (LDA), quadratic discriminant analysis (QDA), and random forest (RF) machine learning classifiers to predict mechanical ventilation requirement and mortality were trained and evaluated using radiomic features extracted from patients’ CXRs. Deep learning (DL) approaches were also explored for the clinical outcome prediction task and a novel radiomic embedding framework was introduced. All results are compared against radiologist grading of CXRs (zone-wise expert severity scores). Radiomic classification models had mean area under the receiver operating characteristic curve (mAUCs) of 0.78 ± 0.05 (sensitivity = 0.72 ± 0.07, specificity = 0.72 ± 0.06) and 0.78 ± 0.06 (sensitivity = 0.70 ± 0.09, specificity = 0.73 ± 0.09), compared with expert scores mAUCs of 0.75 ± 0.02 (sensitivity = 0.67 ± 0.08, specificity = 0.69 ± 0.07) and 0.79 ± 0.05 (sensitivity = 0.69 ± 0.08, specificity = 0.76 ± 0.08) for mechanical ventilation requirement and mortality prediction, respectively. Classifiers using both expert severity scores and radiomic features for mechanical ventilation (mAUC = 0.79 ± 0.04, sensitivity = 0.71 ± 0.06, specificity = 0.71 ± 0.08) and mortality (mAUC = 0.83 ± 0.04, sensitivity = 0.79 ± 0.07, specificity = 0.74 ± 0.09) demonstrated improvement over either artificial intelligence or radiologist interpretation alone. Our results also suggest instances in which the inclusion of radiomic features in DL improves model predictions over DL alone. The models proposed in this study and the prognostic information they provide might aid physician decision making and efficient resource allocation during the COVID-19 pandemic.

Patients receiving mechanical ventilation for coronavirus disease 2019 (COVID-19) related, moderate-to-severe acute respiratory distress syndrome (CARDS) have mortality rates between 76–98%. The objective of this retrospective cohort study was to identify differences in prone ventilation effects on oxygenation, pulmonary infiltrates (as observed on chest X-ray (CXR)), and systemic inflammation in CARDS patients by survivorship and to identify baseline characteristics associated with survival after prone ventilation. The study cohort included 23 patients with moderate-to-severe CARDS who received prone ventilation for ≥16 h/day and was segmented by living status: living (n = 6) and deceased (n = 17). Immediately after prone ventilation, PaO₂/FiO₂ improved by 108% (p < 0.03) for the living and 150% (p < 3 × 10⁻⁴) for the deceased. However, the 48 h change in lung infiltrate severity in gravity-dependent lung zones was significantly better for the living than for the deceased (p < 0.02). In CXRs of the lower lungs before prone ventilation, we observed 5 patients with confluent infiltrates bilaterally, 12 patients with ground-glass opacities (GGOs) bilaterally, and 6 patients with mixed infiltrate patterns; 80% of patients with confluent infiltrates were alive vs. 8% of patients with GGOs. In conclusion, our small study indicates that CXRs may offer clinical utility in selecting patients with moderate-to-severe CARDS who will benefit from prone ventilation. Additionally, our study suggests that lung infiltrate severity may be a better indicator of patient disposition after prone ventilation than PaO₂/FiO₂.

Stereotactic radiosurgery/radiation therapy (SRS/SRT) increasingly has been used to treat brain metastases. However, the development of distant brain metastases (DBMs) in the untreated brain remains a serious complication. We sought to develop a spatially aware radiomic signature to model the time-to-DBM development in a cohort of patients leveraging pretreatment magnetic resonance imaging (MRI) and radiation therapy treatment planning data including radiation dose distribution maps. We retrospectively analyzed a cohort of 105 patients with brain metastases treated by SRS/SRT with pretreatment multiparametric MRI (T1, T1 postcontrast, T2, fluid-attenuated inversion recovery). Three-dimensional radiomic features were extracted from each MRI sequence within 5 isodose regions of interest (ROIs) identified via radiation dose distribution maps and gross target volume (GTV) contours. Clinical features including patient performance status, number of lesions treated, tumor volume, and tumor stage were collected to serve as a baseline for comparison. Cox proportional hazards (CPH) modeling and Kaplan–Meier analysis were used to model time-to-DBM development. CPH models trained using radiomic features achieved a mean concordance index (c-index) of 0.63 (standard deviation [SD], 0.08) compared with a c-index of 0.49 (SD, 0.09) for CPH models trained using clinical factors. A CPH model trained using both radiomic and clinical features achieved a c-index of 0.69 (SD, 0.08). The identified radiomic signature was able to stratify patients into distinct risk groups with statistically significant differences (P = .00007) in time-to-DBM development as measured by log-rank test. Clinical features were unable to do the same. Radiomic features from the peritumoral 50% to 75% isodose ROI and GTV region were most predictive of DBM development. Our results suggest that radiomic features extracted from pretreatment MRI and multiple isodose ROIs can model time-to-DBM development in patients receiving SRS/SRT for brain metastases, outperforming clinical feature baselines. Notably, we believe we are the first to leverage SRS/SRT dose maps for ROI identification and subsequent radiomic analysis of peritumoral and untargeted brain regions using multiparametric MRI. We observed that the peritumoral environment may be implicated in DBM development for SRS/SRT-treated brain metastases. Our preliminary results might enable the identification of patients with predisposition to DBM development and prompt subsequent changes in disease management.

Radiomic graph analysis of pretreatment CT enables holistic analysis of head and neck squamous cell carcinoma tumors and their surrounding environment, showing good performance in local-regional recurrence and distant metastasis prediction and unique model interpretability.

Clinical outcome or severity prediction from medical images has largely focused on learning representations from single-timepoint or snapshot scans. It has been shown that disease progression can be better characterized by temporal imaging. We therefore hypothesized that outcome predictions can be improved by utilizing the disease progression information from sequential images. We present a deep learning approach that leverages temporal progression information to improve clinical outcome predictions from single-timepoint images. In our method, a self-attention based Temporal Convolutional Network (TCN) is used to learn a representation that is most reflective of the disease trajectory. Meanwhile, a Vision Transformer is pretrained in a self-supervised fashion to extract features from single-timepoint images. The key contribution is to design a recalibration module that employs maximum mean discrepancy loss (MMD) to align distributions of the above two contextual representations. We train our system to predict clinical outcomes and severity grades from single-timepoint images. Experiments on chest and osteoarthritis radiography datasets demonstrate that our approach outperforms other state-of-the-art techniques.