Marwa Saad

Mrs. Marwa Saad


Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
21 October 2024 in Algorithms
Verified
Journal Article
Open access
PDF file
MSMarwa Saad
Marwa Saad
WAWesam Almasri
Wesam Almasri
THTanvirul Hye
Tanvirul Hye
Monzurul RoniMonzurul Roni
Monzurul Roni
CMChangiz Mohiyeddini
Changiz Mohiyeddini
ChatGPT by OpenAI is an AI model designed to generate human-like responses based on diverse datasets. Our study evaluated ChatGPT-3.5’s capability to generate pharmacology multiple-choice questions adhering to the NBME guidelines for USMLE Step exams. The initial findings show ChatGPT’s rapid adoption and potential in healthcare education and practice. However, concerns about its accuracy and depth of understanding prompted this evaluation. Using a structured prompt engineering process, ChatGPT was tasked to generate questions across various organ systems, which were then reviewed by pharmacology experts. ChatGPT consistently met the NBME criteria, achieving an average score of 13.7 out of 16 (85.6%) from expert 1 and 14.5 out of 16 (90.6%) from expert 2, with a combined average of 14.1 out of 16 (88.1%) (Kappa coefficient = 0.76). Despite these high scores, challenges in medical accuracy and depth were noted, often producing “pseudo vignettes” instead of in-depth clinical questions. ChatGPT-3.5 shows potential for generating NBME-style questions, but improvements in medical accuracy and understanding are crucial for its reliable use in medical education. This study underscores the need for AI models tailored to the medical domain to enhance educational tools for medical students.

29 September 2025 in Algorithms
Verified
Journal Article
Open access
PDF file
WAWesam Almasri
Wesam Almasri
MSMarwa Saad
Marwa Saad
CMChangiz Mohiyeddini
Changiz Mohiyeddini
Background: Large language models (LLMs) such as Google Gemini have demonstrated strong capabilities in natural language generation, but their ability to create medical assessment items aligned with National Board of Medical Examiners (NBME) standards remains underexplored. Objective: This study evaluated the quality of Gemini-generated NBME-style pharmacology questions using a structured rubric to assess accuracy, clarity, and alignment with examination standards. Methods: Ten pharmacology questions were generated using a standardized prompt and assessed independently by two pharmacology experts. Each item was evaluated using a 16-criterion NBME rubric with binary scoring. Inter-rater reliability was calculated (Cohen’s Kappa = 0.81) following a calibration session. Results: On average, questions met 14.3 of 16 criteria. Strengths included logical structure, appropriate distractors, and clinically relevant framing. Limitations included occasional pseudo-vignettes, cueing issues, and one instance of factual inaccuracy (albuterol mechanism of action). The evaluation highlighted Gemini’s ability to produce high-quality NBME-style questions, while underscoring concerns regarding sample size, reproducibility, and factual reliability. Conclusions: Gemini shows promise as a tool for generating pharmacology assessment items, but its probabilistic outputs, factual inaccuracies, and limited scope necessitate caution. Larger-scale studies, inclusion of multiple medical disciplines, incorporation of student performance data, and use of broader expert panels are recommended to establish reliability and educational applicability.

22 October 2024 in OBM Integrative and Complementary Medicine
Verified
Journal Article
Open access
PDF file
CMChangiz Mohiyeddini
Changiz Mohiyeddini
ECElizabeth Carlson
Elizabeth Carlson
DSDeena S
Deena S
WAWesam Almarsi
Wesam Almarsi
MSMarwa Saad
Marwa Saad
SBStephanie Baker
Stephanie Baker
Moral injury refers to a complex psychological condition that is assumed to emerge following exposure to distressing events that challenge the moral values or ethical beliefs of individuals by direct commission, omission, observation, or betrayal by a trusted leader. Moral injury can be found across various occupational domains, such as military, healthcare, and law enforcement. Symptoms of moral injury can include guilt, a sense of moral disorientation, struggle with spiritual or existential issues, and more. This paper aims to summarize current debates on the definition, symptomatology, and assessment of moral injury. Furthermore, it discusses the conceptual and psychological overlap and differences between moral injury and Post-Traumatic Stress Disorder (PTSD) and addresses current therapeutic approaches for treating patients with moral injury.