Joshua Biro

Joshua Biro

Auto-generated profile, based on publicly available information

Joshua Biro

MedStar Health National Center for Human Factors in Healthcare, Washington, USA

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
27 January 2025 in Journal of Medical Internet Research
Verified
Journal Article
Open access
JBJoshua Biro
Joshua Biro
JHJessica L Handley
Jessica L Handley
NCNathan K Cobb
Nathan K Cobb
VKVarsha Kottamasu
Varsha Kottamasu
JCJeffrey Collins
Jeffrey Collins
RRRaj M Ratwani
Raj M Ratwani
Artificial intelligence–enabled ambient digital scribes may have many potential benefits, yet results from our study indicate that there are errors that must be evaluated to mitigate safety risks.

24 July 2025 in Journal of Participatory Medicine
Verified
Journal Article
Open access
GFGarrett Foresman
Garrett Foresman
JBJoshua Biro
Joshua Biro
ATAlberta Tran
Alberta Tran
KMKate MacRae
Kate MacRae
SKSadaf Kazi
Sadaf Kazi
KMKristen Miller
Kristen Miller
Background: Artificial intelligence (AI) is rapidly transforming health care, offering potential benefits in diagnosis, treatment, and workflow efficiency. However, limited research explores patient perspectives on AI, especially in its role in diagnosis and communication. This study examines patient perceptions of various AI applications, focusing on the diagnostic process and communication. Objective: This study aimed to examine patient perspectives on AI use in health care, particularly in diagnostic processes and communication, identifying key concerns, expectations, and opportunities to guide the development and implementation of AI tools. Methods: This study used a qualitative focus group methodology with co-design principles to explore patient and family member perspectives on AI in clinical practice. A single 2-hour session was conducted with 17 adult participants. The session included interactive activities and breakout sessions focused on five specific AI scenarios relevant to diagnosis and communication: (1) portal messaging, (2) radiology review, (3) digital scribe, (4) virtual human, and (5) decision support. The session was audio-recorded and transcribed, with facilitator notes and demographic questionnaires collected. Data were analyzed using inductive thematic analysis by 2 independent researchers (GF and JB), with discrepancies resolved via consensus. Results: Participants reported varying comfort levels with AI applications contingent on the level of patient interaction, with digital scribe (average 4.24, range 2-5) and radiology review (average 4.00, range 2-5) being the highest, and human (average 1.68, range 1-4) being the lowest. In total, five cross-cutting themes emerged: (1) validation (concerns about model reliability), (2) usability (impact on diagnostic processes), (3) transparency (expectations for disclosing AI usage), (4) opportunities (potential for AI to improve care), and (5) privacy (concerns about data security). Participants valued the co-design session and felt they had a significant say in the discussions. Conclusions: This study highlights the importance of incorporating patient perspectives in the design and implementation of AI tools in health care. Transparency, human oversight, clear communication, and data privacy are crucial for patient trust and acceptance of AI in diagnostic processes. These findings inform strategies for individual clinicians, health care organizations, and policy makers to ensure responsible and patient-centered AI deployment in health care.

1 February 2023 in JMIR Human Factors
Verified
Journal Article
Open access
JBJoshua Biro
Joshua Biro
CLCourtney Linder
Courtney Linder
DNDavid Neyens
David Neyens
Background: The rising adoption of telehealth provides new opportunities for more effective and equitable health care information mediums. The ability of chatbots to provide a conversational, personal, and comprehendible avenue for learning about health care information make them a promising tool for addressing health care inequity as health care trends continue toward web-based and remote processes. Although chatbots have been studied in the health care domain for their efficacy for smoking cessation, diet recommendation, and other assistive applications, few studies have examined how specific design characteristics influence the effectiveness of chatbots in providing health information. Objective: Our objective was to investigate the influence of different design considerations on the effectiveness of an educational health care chatbot. Methods: A 2×3 between-subjects study was performed with 2 independent variables: a chatbot’s complexity of responses (eg, technical or nontechnical language) and the presented qualifications of the chatbot’s persona (eg, doctor, nurse, or nursing student). Regression models were used to evaluate the impact of these variables on 3 outcome measures: effectiveness, usability, and trust. A qualitative transcript review was also done to review how participants engaged with the chatbot. Results: Analysis of 71 participants found that participants who received technical language responses were significantly more likely to be in the high effectiveness group, which had higher improvements in test scores (odds ratio [OR] 2.73, 95% CI 1.05-7.41; P=.04). Participants with higher health literacy (OR 2.04, 95% CI 1.11-4.00, P=.03) were significantly more likely to trust the chatbot. The participants engaged with the chatbot in a variety of ways, with some taking a conversational approach and others treating the chatbot more like a search engine. Conclusions: Given their increasing popularity, it is vital that we consider how chatbots are designed and implemented. This study showed that factors such as chatbots’ persona and language complexity are two design considerations that influence the ability of chatbots to successfully provide health care information.

24 April 2025 in npj Digital Medicine
Verified
Journal Article
Open access
PDF file
JBJoshua M. Biro
Joshua M. Biro
JHJessica L. Handley
Jessica L. Handley
JMJ. Malcolm McCurry
J. Malcolm McCurry
AVAdam Visconti
Adam Visconti
JWJeffrey Weinfeld
Jeffrey Weinfeld
RRRaj M. Ratwani
Raj M. Ratwani
The rapid increase in patient portal messaging has heightened the workload for primary care physicians (PCPs), contributing to burnout. The use of generative artificial intelligence (AI) to draft responses to patient messages has shown promise in reducing cognitive burden, yet there is still much unknown about the safety and perceptions of using AI drafts. This cross-sectional simulation study assessed whether PCPs could identify and correct errors in AI-generated draft responses to patient portal messages. Twenty practicing PCPs reviewed 18 patient portal messages, four of which contained errors categorized as objective inaccuracies or potentially harmful omissions. Each error was insufficiently addressed by 13–15 participants, and 35–45% of erroneous drafts were submitted entirely unedited. While 80% of participants agreed AI drafts reduced cognitive workload and 75% found them safe, uncorrected errors highlight patient safety risks, underscoring the need for improved design, training, and error-detection mechanisms for AI tools.

21 March 2025 in Journal of the American Medical Informatics Association
Verified
Journal Article
Closed access
JBJoshua M Biro
Joshua M Biro
JHJessica L Handley
Jessica L Handley
JMJames Mickler
James Mickler
SRSahithi Reddy
Sahithi Reddy
VKVarsha Kottamasu
Varsha Kottamasu
NCNathan K Cobb
Nathan K Cobb
Objectives: The objective of this work is to demonstrate the value of simulation testing for rapidly evaluating artificial intelligence (AI) products. Materials and Methods: Researcher-physician teams simulated the use of 2 Ambient Digital Scribe (ADS) products by reading scripts of outpatient encounters while using both products, yielding a total of 44 draft notes. Time to edit, perceived amount of effort and editing, and errors in the AI-generated draft notes were analyzed. Results: Ambient Digital Scribe Product A draft notes took significantly longer to edit, had fewer omissions, and more additions and irrelevant or misplaced text errors than ADS Product B. Ambient Digital Scribe Product A was rated as performing better for most encounters. Discussion: Artificial intelligence-enabled products are being rapidly developed and implemented into practice, outpacing safety concerns. Simulation testing can efficiently identify safety issues. Conclusion: Simulation testing is a crucial first step to take when evaluating AI-enabled technologies.

31 March 2026 in The Lancet Primary Care
Verified
Journal Article
Open access
JBJoshua Biro
Joshua Biro
YJYalda Jabbarpour
Yalda Jabbarpour
RRRaj Ratwani
Raj Ratwani