Purpose: To assess the accuracy of answers provided by ChatGPT-3 when prompted with questions from the daily routine of radiologists and to evaluate the text response when ChatGPT-3 was prompted to provide references for a given answer. Methods: ChatGPT-3 (San Francisco, OpenAI) is an artificial intelligence chatbot based on a large language model (LLM) that has been designed to generate human-like text. A total of 88 questions were submitted to ChatGPT-3 using textual prompt. These 88 questions were equally dispersed across 8 subspecialty areas of radiology. The responses provided by ChatGPT-3 were assessed for correctness by cross-checking them with peer-reviewed, PubMed-listed references. In addition, the references provided by ChatGPT-3 were evaluated for authenticity. Results: A total of 59 of 88 responses (67%) to radiological questions were correct, while 29 responses (33%) had errors. Out of 343 references provided, only 124 references (36.2%) were available through internet search, while 219 references (63.8%) appeared to be generated by ChatGPT-3. When examining the 124 identified references, only 47 references (37.9%) were considered to provide enough background to correctly answer 24 questions (37.5%). Conclusion: In this pilot study, ChatGPT-3 provided correct responses to questions from the daily clinical routine of radiologists in only about two thirds, while the remainder of responses contained errors. The majority of provided references were not found and only a minority of the provided references contained the correct information to answer the question. Caution is advised when using ChatGPT-3 to retrieve radiological information.
MRI-based machine learning designed with sequential decision steps reliably differentiated four unique medulloblastoma molecular subgroups. Background Radiogenomics of pediatric medulloblastoma (MB) offers an opportunity for MB risk stratification, which may aid therapeutic decision making, family counseling, and selection of patient g...
11 February 2021 in American Journal of Neuroradiology
BACKGROUND AND PURPOSE: B-Raf proto-oncogene, serine/threonine kinase (BRAF) status has important implications for prognosis and therapy of pediatric low-grade gliomas. Currently, BRAF status classification relies on biopsy. Our aim was to train and validate a radiomics approach to predict BRAF fusion and BRAF V600E mutation. MATERIALS AND METHODS: In this bi-institutional retrospective study, FLAIR MR imaging datasets of 115 pediatric patients with low-grade gliomas from 2 children’s hospitals acquired between January 2009 and January 2016 were included and analyzed. Radiomics features were extracted from tumor segmentations, and the predictive model was tested using independent training and testing datasets, with all available tumor types. The model was selected on the basis of a grid search on the number of trees, opting for the best split for a random forest. We used the area under the receiver operating characteristic curve to evaluate model performance. RESULTS: The training cohort consisted of 94 pediatric patients with low-grade gliomas (mean age, 9.4 years; 45 boys), and the external validation cohort comprised 21 pediatric patients with low-grade gliomas (mean age, 8.37 years; 12 boys). A 4-fold cross-validation scheme predicted BRAF status with an area under the curve of 0.75 (SD, 0.12) (95% confidence interval, 0.62–0.89) on the internal validation cohort. By means of the optimal hyperparameters determined by 4-fold cross-validation, the area under the curve for the external validation was 0.85. Age and tumor location were significant predictors of BRAF status (P values = .04 and <.001, respectively). Sex was not a significant predictor (P value = .96). CONCLUSIONS: Radiomics-based prediction of BRAF status in pediatric low-grade gliomas appears feasible in this bi-institutional exploratory study.
28 September 2017 in American Journal of Neuroradiology
BACKGROUND AND PURPOSE: Head CT is the current neuroimaging tool of choice in acute evaluation of pediatric head trauma. The potential cancer risks of CT-related ionizing radiation should limit its use in children. We evaluated the role of MR imaging, including a “black bone” sequence, compared with CT in detecting skull fractures and intracranial hemorrhages in children with acute head trauma. MATERIALS AND METHODS: We performed a retrospective evaluation of 2D head CT and brain MR imaging studies including the black bone sequence of children with head trauma. Two experienced pediatric neuroradiologists in consensus created the standard of reference. Another pediatric neuroradiologist blinded to the diagnosis evaluated brain MR images and head CT images in 2 separate sessions. The presence of skull fractures and intracranial posttraumatic hemorrhages was evaluated. We calculated the sensitivity and specificity of CT and MR imaging with the black bone sequence in the diagnosis of skull fractures and intracranial hemorrhages. RESULTS: Twenty-eight children (24 boys; mean age, 4.89 years; range, 0–15.5 years) with head trauma were included. MR imaging with the black bone sequence revealed lower sensitivity (66.7% versus 100%) and specificity (87.5% versus 100%) in identifying skull fractures. Four of 6 incorrectly interpreted black bone MR imaging studies showed cranial sutures being misinterpreted as skull fractures and vice versa. CONCLUSIONS: Our preliminary results show that brain MR imaging complemented by a black bone sequence is a promising nonionizing alternative to head CT for the assessment of skull fractures in children. However, accuracy in the detection of linear fractures in young children and fractures of aerated bone remains limited.
Purpose: Biopsy-based assessment of H3 K27 M status helps in predicting survival, but biopsy is usually limited to unusual presentations and clinical trials. We aimed to evaluate whether radiomics can serve as prognostic marker to stratify diffuse intrinsic pontine glioma (DIPG) subsets. Methods: In this retrospective study, diagnostic brain MRIs of children with DIPG were analyzed. Radiomic features were extracted from tumor segmentations and data were split into training/testing sets (80:20). A conditional survival forest model was applied to predict progression-free survival (PFS) using training data. The trained model was validated on the test data, and concordances were calculated for PFS. Experiments were repeated 100 times using randomized versions of the respective percentage of the training/test data. Results: A total of 89 patients were identified (48 females, 53.9%). Median age at time of diagnosis was 6.64 years (range: 1–16.9 years) and median PFS was 8 months (range: 1–84 months). Molecular data were available for 26 patients (29.2%) (1 wild type, 3 K27M-H3.1, 22 K27M-H3.3). Radiomic features of FLAIR and nonenhanced T1-weighted sequences were predictive of PFS. The best FLAIR radiomics model yielded a concordance of .87 [95% CI: .86–.88] at 4 months PFS. The best T1-weighted radiomics model yielded a concordance of .82 [95% CI: .8–.84] at 4 months PFS. The best combined FLAIR + T1-weighted radiomics model yielded a concordance of .74 [95% CI: .71–.77] at 3 months PFS. The predominant predictive radiomic feature matrix was gray-level size-zone. Conclusion: MRI-based radiomics may predict progression-free survival in pediatric diffuse midline glioma/diffuse intrinsic pontine glioma.