Maria Śmierciak

Maria Śmierciak

Auto-generated profile, based on publicly available information

Maria Śmierciak

Student Scientific Society, Department of Ophthalmology, Faculty of Medical Sciences in Katowice , Medical University of Silesia in Katowice , Poland

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 January 2024 in Postępy Higieny I Medycyny Doświadczalnej
Verified
Journal Article
Open access
PDF file
MCMarcin Jakub Ciekalski
Marcin Jakub Ciekalski
MLMaciej Laskowski
Maciej Laskowski
AKAgnieszka Koperczak
Agnieszka Koperczak
MŚMaria Śmierciak
Maria Śmierciak
SSSebastian Sirek
Sebastian Sirek
Introduction: Artificial intelligence (AI) has evolved significantly, driven by advancements in computing power and big data. Technologies like machine learning and deep learning have led to sophisticated models such as GPT-3.5 and GPT-4. This study assesses the performance of these AI models on the Polish National Specialty Exam in ophthalmology, exploring their potential to support research, education, and clinical decision-making in healthcare. Materials and Methods: The study analyzed 98 questions from the Spring 2023 Polish NSE in Ophthalmology. Questions were categorized into five groups: Physiology & Diagnostics, Clinical & Case Questions, Treatment & Pharmacology, Surgery, and Pediatrics. GPT-3.5 and GPT-4 were tested for their accuracy in answering these questions, with a confidence rating from 1 to 5 assigned to each response. Statistical analyses, including the Chi-squared test and Mann-Whitney U test, were employed to compare the models’ performance. Results: GPT-4 demonstrated a significant improvement over GPT-3.5, correctly answering 63.3% of questions compared to GPT-3.5’s 37.8%. GPT-4’s performance met the passing criteria for the NSE. The models showed varying degrees of accuracy across different categories, with a notable gap in fields like surgery and pediatrics. Conclusions: The study highlights the potential of GPT models in aiding clinical decisions and educational purposes in ophthalmology. However, it also underscores the models’ limitations, particularly in specialized fields like surgery and pediatrics. The findings suggest that while AI models like GPT-3.5 and GPT-4 can significantly assist in the medical field, they require further development and fine-tuning to address specific challenges in various medical domains.