Rachel Stephens

Rachel Stephens

Auto-generated profile, based on publicly available information

Rachel Stephens

Department of Biomedical Informatics, University at Buffalo, Buffalo, NY

Research Focus & Metrics

Academic Career Length

2Years (2025-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
12 May 2025
Verified
Book Chapter
Open access
PDF file
RSRachel Stephens
Rachel Stephens
GFGillian Franklin
Gillian Franklin
KTKevin B. Taylor
Kevin B. Taylor
KTKaity Han-Yung Tung
Kaity Han-Yung Tung
VIVladyslav Ilchenko
Vladyslav Ilchenko
Peter L ElkinPeter L Elkin
Peter L Elkin
We evaluated the performance of Semantic Clinical Artificial Intelligence (SCAI, pronounced Sky), a large language model (LLM) knowledge resource through usability testing. This pretest-intervention-posttest mixed-methods user interface (UI) design study investigates usability to determine whether the LLM provides a more comprehensive, efficient, and enhanced user-friendly means of delivering end user information as compared to using primary sources of information from the Internet (Web). Our analysis focused on assessing the LLM’s efficiency and usability in helping users arrive at accurate and reliable outcomes, to ultimately determine its value as an innovative tool for packaging and presenting information. Usability test sessions were conducted using the cognitive walkthrough approach, via Zoom. Participants were asked to respond to scenarios using only the LLM, and then only the web, and vice versa. These sessions were followed by user feedback sessions where participants rated their experiences and responded to open-ended questions related to the overall usability and satisfaction with SCAI.