Torul D, et al. J Korean Assoc Oral Maxillofac Surg. 2017 Dec;43(Suppl 1):S9-S13. https://doi.org/10.5125/jkaoms.2017.43.S1.S9

Objectives: This study aimed to evaluate the performance of three widely used artificial intelligence (AI) chatbots—ChatGPT-4, Gemini 2.5 Pro, and Claude Sonnet 4—in answering patient-oriented frequently asked questions (FAQs) related to orthognathic surgery. Given the increasing reliance on AI tools in healthcare, it is essential to evaluate their performance to provide accurate, empathetic, readable, and clinically appropriate information. Methods: Twenty FAQs in Turkish about orthognathic surgery were presented to each chatbot. The responses were evaluated by three oral and maxillofacial surgeons using a modified Global Quality Score (GQS), binary clinical appropriateness judgment, and a five-point empathy rating scale. The evaluation process was conducted in a double-blind manner. The Ateşman Readability Formula was applied to each response using an automated Python-based script. Comparative statistical analyses—including ANOVA, Kruskal–Wallis, and post hoc tests—were used to determine significant differences in performance among chatbots. Results: Gemini outperformed both GPT-4 and Claude in GQS, empathy, and clinical appropriateness (p < 0.001). GPT-4 demonstrated the highest readability scores (p < 0.001) but frequently lacked empathetic tone and safety-oriented guidance. Claude showed moderate performance, balancing ethical caution with limited linguistic clarity. A moderate positive correlation was found between empathy and perceived response quality (r = 0.454; p = 0.044). Conclusions: AI chatbots vary significantly in their ability to support surgical patient education. While GPT-4 offers superior readability, Gemini provides the most balanced and clinically reliable responses. These findings underscore the importance of context-specific chatbot selection and continuous clinical oversight to ensure safe and ethical AI-driven communication.

Background/aim: Temporomandibular Disorders (TMD), as in the occurrence of many diseases, have been associated with oxidative stress (OS) resulting from the disruption of antioxidant mechanisms and the accumulation of reactive oxygen species in tissues. This study was designed to compare salivary and serum OS and inflammation markers of individuals with TMD and healthy subjects. Materials and methods: A prospective cross-sectional study was conducted. Twenty-seven TMD patients diagnosed with disc displacement (DD) according to Research Diagnostic Criteria for Temporomandibular Disorders (RDC/TMD) and 17 healthy subjects were enrolled in the study. Prior to any treatment, serum, and saliva samples were taken from the patients and centrifuged, and stored at -80 °C until analyzed. All samples were examined for Interleukin-6 (IL-6), Malondialdehyde (MDA), and 8-hydroxydeoxyguanosine (8-OHdG) concentrations. Results: There was no significant difference between the groups regarding median values of 8-OHdG, IL-6, and MDA (p > 0.05). When the relationship between serum and salivary 8-OHdG, IL-6, and MDA levels in all subjects was evaluated, there was a strong positive correlation between the levels of 8-OHdG and IL-6 in the serum (r = 0.752, p <0.001). In the study group, when the relationship between pain levels and serum and saliva 8-OHdG, IL-6, and MDA levels was assessed, a positive and strong correlation was found between the levels of 8-OHdG and IL-6 in serum. Conclusion: Although the strong correlation between pain scores and serum 8-OHdG and MDA levels supports the hypothesis that inflammation and OS mechanisms may be interrelated, according to the results of the study, inflammatory and OS markers in patients with TMD were not different from healthy individuals.