3 September 2023 in British Journal of Radiology
Multiomics data including imaging radiomics and various types of molecular biomarkers have been increasingly investigated for better diagnosis and therapy in the era of precision oncology. Artificial intelligence (AI) including machine learning (ML) and deep learning (DL) techniques combined with the exponential growth of multiomics data may have great potential to revolutionize cancer subtyping, risk stratification, prognostication, prediction and clinical decision-making. In this article, we first present different categories of multiomics data and their roles in diagnosis and therapy. Second, AI-based data fusion methods and modeling methods as well as different validation schemes are illustrated. Third, the applications and examples of multiomics research in oncology are demonstrated. Finally, the challenges regarding the heterogeneity data set, availability of omics data, and validation of the research are discussed. The transition of multiomics research to real clinics still requires consistent efforts in standardizing omics data collection and analysis, building computational infrastructure for data sharing and storing, developing advanced methods to improve data fusion and interpretability, and ultimately, conducting large-scale prospective clinical trials to fill the gap between study findings and clinical benefits.
25 November 2022 in IEEE Transactions on Medical Imaging
RMRajarajesawari Muthusivarajan
Rajarajesawari Muthusivarajan
+2
Medical imaging deep learning models are often large and complex, requiring specialized hardware to train and evaluate these models. To address such issues, we propose the PocketNet paradigm to reduce the size of deep learning models by throttling the growth of the number of channels in convolutional neural networks. We demonstrate that, for a range of segmentation and classification tasks, PocketNet architectures produce results comparable to that of conventional neural networks while reducing the number of parameters by multiple orders of magnitude, using up to 90% less GPU memory, and speeding up training times by up to 40%, thereby allowing such models to be trained and deployed in resource-constrained settings.
1 October 2019 in Clinical Radiology
17 January 2019 in Neuro-Oncology
Undersampling of gliomas at first biopsy is a major clinical problem, as accurate grading determines all subsequent treatment. We submit a technological solution to reduce the problem of undersampling by estimating a marker of tumor proliferation (Ki-67) using MR imaging data as inputs, against a stereotactic histopathology gold standard. MR imaging was performed with anatomic, diffusion, permeability, and perfusion sequences, in untreated glioma patients in a prospective clinical trial. Stereotactic biopsies were harvested from each patient immediately prior to surgical resection. For each biopsy, an imaging description (23 parameters) was developed, and the Ki-67 index was recorded. Machine learning models were built to estimate Ki-67 from imaging inputs, and cross validation was undertaken to determine the error in estimates. The best model was used to generate graphical maps of Ki-67 estimates across the whole brain. Fifty-two image-guided biopsies were collected from 23 evaluable patients. The random forest algorithm best modeled Ki-67 with 4 imaging inputs (T2-weighted, fractional anisotropy, cerebral blood flow, Ktrans). It predicted the Ki-67 expression levels with a root mean square (RMS) error of 3.5% (R2 = 0.75). A less accurate predictive result (RMS error 5.4%, R2 = 0.50) was found using conventional imaging only. Ki-67 can be predicted to clinically useful accuracies using clinical imaging data. Advanced imaging (diffusion, perfusion, and permeability) improves predictive accuracy over conventional imaging alone. Ki-67 predictions, displayed as graphical maps, could be used to guide biopsy, resection, and/or radiation in the care of glioma patients.
26 November 2020 in American Journal of Neuroradiology
BACKGROUND AND PURPOSE: Increased cellular density is a hallmark of gliomas, both in the bulk of the tumor and in areas of tumor infiltration into surrounding brain. Altered cellular density causes altered imaging findings, but the degree to which cellular density can be quantitatively estimated from imaging is unknown. The purpose of this study was to discover the best MR imaging and processing techniques to make quantitative and spatially specific estimates of cellular density. MATERIALS AND METHODS: We collected stereotactic biopsies in a prospective imaging clinical trial targeting untreated patients with gliomas at our institution undergoing their first resection. The data included preoperative MR imaging with conventional anatomic, diffusion, perfusion, and permeability sequences and quantitative histopathology on biopsy samples. We then used multiple machine learning methodologies to estimate cellular density using local intensity information from the MR images and quantitative cellular density measurements at the biopsy coordinates as the criterion standard. RESULTS: The random forest methodology estimated cellular density with R2 = 0.59 between predicted and observed values using 4 input imaging sequences chosen from our full set of imaging data (T2, fractional anisotropy, CBF, and area under the curve from permeability imaging). Limiting input to conventional MR images (T1 pre- and postcontrast, T2, and FLAIR) yielded slightly degraded performance (R2 = 0.52). Outputs were also reported as graphic maps. CONCLUSIONS: Cellular density can be estimated with moderate-to-strong correlations using MR imaging inputs. The random forest machine learning model provided the best estimates. These spatially specific estimates of cellular density will likely be useful in guiding both diagnosis and treatment.
6 February 2020 in American Journal of Neuroradiology
BACKGROUND AND PURPOSE: Gliomas are highly heterogeneous tumors, and optimal treatment depends on identifying and locating the highest grade disease present. Imaging techniques for doing so are generally not validated against the histopathologic criterion standard. The purpose of this work was to estimate the local glioma grade using a machine learning model trained on preoperative image data and spatially specific tumor samples. The value of imaging in patients with brain tumor can be enhanced if pathologic data can be estimated from imaging input using predictive models. MATERIALS AND METHODS: Patients with gliomas were enrolled in a prospective clinical imaging trial between 2013 and 2016. MR imaging was performed with anatomic, diffusion, permeability, and perfusion sequences, followed by image-guided stereotactic biopsy before resection. An imaging description was developed for each biopsy, and multiclass machine learning models were built to predict the World Health Organization grade. Models were assessed on classification accuracy, Cohen κ, precision, and recall. RESULTS: Twenty-three patients (with 7/9/7 grade II/III/IV gliomas) had analyzable imaging-pathologic pairs, yielding 52 biopsy sites. The random forest method was the best algorithm tested. Tumor grade was predicted at 96% accuracy (κ = 0.93) using 4 inputs (T2, ADC, CBV, and transfer constant from dynamic contrast-enhanced imaging). By means of the conventional imaging only, the overall accuracy decreased (89% overall, κ = 0.79) and 43% of high-grade samples were misclassified as lower-grade disease. CONCLUSIONS: We found that local pathologic grade can be predicted with a high accuracy using clinical imaging data. Advanced imaging data improved this accuracy, adding value to conventional imaging. Confirmatory imaging trials are justified.