2 April 2024 in Ear, Nose & Throat Journal
Background: ChatGPT is an artificial intelligence tool, which utilizes machine learning to analyze and generate human-like text. The user-friendly accessibility of this tool enables patients conveniently access medical information without intricate terminology challenges. The objective of this study was to assess the accuracy of ChatGPT in providing insights into indications and management of complications after tonsillectomy, a common pediatric otolaryngology procedure. Methods: The responses generated by ChatGPT were compared to the “Clinical practice guidelines: tonsillectomy in children—executive summary” developed by the American Academy of Otolaryngology—Head and Neck Surgery Foundation (AAO-HNSF). An assessment was carried out by presenting predetermined questions regarding indications and complications post tonsillectomy to ChatGPT, followed by a comparison of its responses with the established guideline by 2 otolaryngology experts. The responses of both parties were reviewed by the senior author. Results: A total of 16 responses generated by ChatGPT were assessed. After a comprehensive review, it was concluded that 15 out of 16 (93.8%) responses demonstrated a high degree of reliability and accuracy, closely adhering to the standard established by the AAO-HNSF guideline. Conclusion: The results validate the potential of using ChatGPT to enhance healthcare delivery making guidelines more accessible to patients while also emphasizing the importance of ensuring the provision of accurate and reliable medical advice to patients.
1 October 2024 in OTO Open
Objective: This study investigates ChatGPT's accuracy, readability, understandability, and actionability in responding to patient queries on sudden sensorineural hearing loss (SSNHL) in English and Spanish, when compared to Google responses. The objective is to address concerns regarding its proficiency in addressing medical inquiries when presented in a language divergent from its primary programming.Study Design: Observational.Setting: Virtual environment.Methods: Using ChatGPT 3.5 and Google, questions from the AAO‐HNSF guidelines were presented in English and Spanish. Responses were graded by 2 otolaryngologists proficient in both languages using a 4‐point Likert scale and the PEMAT‐P tool. To ensure uniform application of the Likert scale, a third independent evaluator reviewed the consistency in grading. Readability was evaluated using 3 different tools specific to each language. IBM SPSS Version 29 was used for statistical analysis using one‐way analysis of variance.Results: Across both languages, the responses displayed a native‐level language proficiency. Accuracy was comparable between sources and languages. Google's Spanish responses had better readability (effect size 0.35, P < .001), while Google's English responses were more understandable (effect size 0.67, P = .018). ChatGPT's English responses demonstrated the highest level of actionability (60%), though not significantly different when compared to other sources (effect size 0.47, P = .14).Conclusion: ChatGPT offers patients comprehensive and guideline‐conforming answers to SSNHL patient medical queries in the 2 most spoken languages in the United States. However, improvements in its readability and understandability are warranted for more accessible patient education.
1 January 2024 in Journal of Otolaryngology - Head & Neck Surgery
SSSabrina Daniela da Silva
Background: Minimally invasive parathyroidectomy (MIP) in patients with a parathyroid adenoma (PA) requires imaging modalities for precise localization. Parathyroid hormone assay on ultrasound-guided fine-needle aspiration washout, or PTH washout, can be used for this purpose. It is unclear whether PTH washout complements traditional PA localization techniques such as a sestamibi (MIBI) scan or diminishes its need. This study aims to determine whether a positive PTH washout obviates the need for an MIBI scan in the preoperative localization of a PA. Method: A multi-center retrospective, comparative review comprised adult patients who underwent MIP at 2 McGill University teaching hospitals between 2018 and 2022. Patients who had both PTH washout and MIBI scan for preoperative localization of PA, final histopathology reports available, and preoperative/postoperative results recorded were included in the final analysis. Results: Of the 193 patients’ charts reviewed, 87 were included in this study. Of these 87 patients, 74.7% (65/87) had a positive PTH washout result. Among those, MIBI correctly detected 90.8% (59/65) of the PAs. The MIBI scan did not contribute meaningful information for any of the 65 patients who had positive PTH washout results. Conclusion: These findings strongly support the use of preoperative dedicated ultrasound as the initial standard procedure. When a PA candidate on ultrasound is found, a PTH washout should be performed. If positive, it could suffice as the sole localization method for MIP surgery. When a PA was identified on ultrasound and confirmed with PTH washout, the MIBI scan did not add more information. Benefits include fewer patient tests, less exposure to ionizing radiation, and reduced healthcare expenses.
1 November 2025 in Journal of Otolaryngology - Head & Neck Surgery
SSSabrina Daniela da Silva
+3
Importance: ChatGPT has emerged as a medical resource through advanced language processing. Patients with thyroid nodules classified under The Bethesda System for Reporting Thyroid Cytopathology (TBSRTC) may use it to complement discussions with physicians. Objective: We aimed to determine whether ChatGPT's recommendations on managing thyroid nodules classified by TBSRTC align with those of experienced thyroid specialists. Setting/Participants: A multidisciplinary panel of 5 thyroid cancer specialists, including otolaryngologists and endocrinologists, from 3 university-affiliated teaching hospitals in Montreal, Canada, evaluated the responses. Intervention/Exposure: ChatGPT-3.5 was prompted with 4 questions for each of the 6 Bethesda categories regarding the meaning and management of thyroid nodules, generating 24 responses for evaluation. Main Outcome/Measures: We assessed ChatGPT’s accuracy against the latest American Thyroid Association (ATA) guidelines using a 4-point Likert scale (90%). Additionally, specialists rated their comfort or reluctance in recommending ChatGPT as a complementary tool for patient discussions. Results: Of the 24 ChatGPT-generated responses, 19 (79.2%) demonstrated moderate to good consistency with the ATA guidelines. The mean consistency score was 3.38/4 and median was 3.5. Consensus (IQR ≤ 1) was achieved in 23 out of 24 responses (95.8%), reflecting strong inter-rater reliability. Consistency scores were highest in Bethesda I–III and declined progressively in higher-risk categories, with the lowest mean score observed in Bethesda VI. Similarly, an upward trend in clinician reluctance was observed from Bethesda I through VI, indicating greater caution in recommending ChatGPT responses for patients suspicious for or diagnosed with malignancy (Bethesda V–VI). Conclusion and Relevance: While ChatGPT’s responses generally align with specialist recommendations, they are not fully reliable. ChatGPT lacks the ability to serve as an independent or accurate source of medical advice for thyroid nodule management. It remains a useful complement for patient discussions, especially in low-risk scenarios, but further improvements are necessary to make it a safe, reliable component of patient care in complex cases.
1 January 2025 in Journal of Otolaryngology - Head & Neck Surgery
Importance: Advancements in medical education have led to the adoption of virtual learning. Certain medical fields, including Otolaryngology—Head and Neck Surgery (OHNS), are underrepresented in undergraduate medical education curricula. LearnENT, an OHNS educational app, addresses this gap and has gained a global user base through its active social media presence. Objectives: To investigate the efficacy of the LearnENT social media team in disseminating OHNS educational resources and engaging users. Design: A longitudinal observational study with data collection conducted over an 8 month period surrounding the implementation of the social media team. Setting: The study utilized 2 platforms: Instagram Business tools and the LearnENT application dashboard. Participants: Instagram followers and LearnENT app users globally, with data segmented by demographics and professional backgrounds. Exposures or Intervention: Analysis of Instagram Business data, including trends in followers, accounts reached, accounts engaged, impressions, and activity on the LearnENT application dashboard. Main Outcome Measures: Follower demographics, audience activity patterns, account interactions, and app usage trends. Results: The Instagram account achieved a 49.7% increase in followers (900 total) over 8 months. Engagement metrics showed an 87% rise in accounts reached and a 70% increase in impressions. App usage increased by 12%, reaching a total of 8257 users across 36 countries. Key content types, such as “Question of the Week,” received the highest engagement rates. Conclusion: The LearnENT social media team has effectively disseminated OHNS educational resources and engaged learners, as evidenced by a 49.7% increase in followers and 12% increase app users. Relevance: The global reach and diversity of the LearnENT Instagram community highlight its potential to connect individuals worldwide. Strategies to further enhance engagement include creating visually-appealing graphics, addressing audience preferences, and collaborating with other OHNS-related accounts.
3 December 2024 in ESMO Gastrointestinal Oncology
Underdiagnosis of constitutional mismatch repair deficiency (CMMRD) syndrome leads to suboptimal cancer surveillance and management of CMMRD patients. Assessing pitfalls that led to the misdiagnosis of CMMRD is important to improve care trajectories, and to highlight the importance of accurate molecular and pathology-based assessment of patients presenting with CMMRD-associated features. A retrospective chart review of two patients with molecularly confirmed CMMRD ascertained through the Medical Genetics service of the McGill University Health Centre (MUHC) was conducted to study the pathway and pitfalls to diagnosis. Records were reviewed and summarized as timelines to depict important events relating to diagnosis and management of CMMRD patients. Unfamiliarity with CMMRD contributed to a diagnosis delay and initiation of CMMRD-specific surveillance. Pitfalls along the diagnostic pathway included inaccurate clinical information relayed to pathologists, unfamiliarity with CMMRD-defining features on immunohistochemistry (IHC) analyses, IHC variability and unreliability, and lack of awareness of the pivotal role for medical genetics in the diagnosis of CMMRD. Improved awareness of CMMRD in patients presenting with CMMRD-associated features can help guide IHC analysis and expedite referral to medical genetics for accurate molecular diagnosis. Consequently, timely CMMRD diagnosis improves surveillance and patient management and allows for appropriate genetic counseling for family members.