Background: Clinical decision support systems (CDSSs) interventions were used to improve the life quality and safety in patients and also to improve practitioner performance, especially in the field of medication. Therefore, the aim of the paper was to summarize the available evidence on the impact, outcomes and significant factors on ...
Background: The new coronavirus has been spreading since the beginning of 2020, and many efforts have been made to develop vaccines to help patients recover. It is now clear that the world needs a rapid solution to curb the spread of COVID-19 worldwide with non-clinical approaches such as artificial intelligence techniques. ...
15 December 2019 in The International Journal of Health Planning and Management
Background and Aims: ChatGPT is a popular large language model with potential educational applications in medicine. However, its performance in standardized, multi‐disciplinary medical exams has not been comprehensively assessed. This study evaluates ChatGPT's accuracy and quality in Iran's national medical pre‐internship exam. Methods: We tested ChatGPT (GPT‐3.5, May 3rd version) on 195 multiple‐choice questions from the March 2022 Iranian pre‐internship exam, covering 23 medical specialties. Questions with visual content were excluded. Each question was asked in a new chat to avoid memory bias. Responses were evaluated by 55 experts using a 5‐point Likert scale and compared against the official answer key. Data were analyzed descriptively using SPSS. Results: ChatGPT answered 68.6% of questions correctly. Expert ratings averaged 4.23/5 (SD = 1.21), indicating good to excellent quality. Best‐performing specialties included pharmacology (85.7%), otorhinolaryngology (83.3%), and dermatology (83.3%). Lower performance was observed in pulmonology (42.9%) and epidemiology (50%). Conclusion: ChatGPT shows promise as a supplemental educational tool in medical education, but its accuracy varies by specialty. Faculty guidance is essential to ensure responsible integration until further improvements and validations are made.
"ChatGPT and Bing and Home Blood Pressure Monitoring (HBPM) knowledge" About our article titled "Comparing ChatGPT and Bing, in response to the Home Blood Pressure Monitoring (HBPM) knowledge checklist" [1], as mentioned in our study, we tried to evaluate the accuracy and repeatability of the answers of artificial intelligence chatbots about blood pressure. The evaluation by experts made sure that ChatGPT is preferable to Bing, but this point should always be considered that in addition to the increasing use of artificial intelligence tools in health care, it is necessary to pay attention to the limitations and inform patients about them. The evolution of these tools always provides an opportunity for future research to explore them in more detail. The recommendation for a code of human conduct is thoughtful. Emphasizing the collaborative nature of AI tools and ethical considerations is the right step in healthcare. Paying attention to guidelines and ethical standards during the development of these tools can remove many limitations. Thank you for your insightful contribution to this important discussion.