Roma Shusterman

Dr. Roma Shusterman

orcid

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
22 February 2025 in npj Digital Medicine
Verified
Journal Article
Open access
PDF file
RSRoma Shusterman
Roma Shusterman
AWAllison C. Waters
Allison C. Waters
SOShannon O’nEill
Shannon O’nEill
MBMarshall Bangs
Marshall Bangs
PLPhan Luu
Phan Luu
DTDon M. Tucker
Don M. Tucker
Continuing advances in Large Language Models (LLMs) are transforming medical knowledge access across education, training, and treatment. Early literature cautions their non-determinism, potential for harmful responses, and lack of quality control. To address these issues, we propose a domain-specific, validated dataset for LLM training and an actor–critic prompting protocol grounded in active inference. A Therapist agent generates initial responses to patient queries, while a Supervisor agent refines them. In a blind validation study, experienced cognitive behavior therapy for insomnia (CBT-I) therapists evaluated 100 patient queries. For each query, they were given either the LLM’s response or one of two therapist-crafted responses—one appropriate and one deliberately inappropriate—and asked to rate the quality and accuracy of each reply. The LLM often received higher ratings than the appropriate responses, indicating effective alignment with expert standards. This structured approach lays the foundation for safely integrating advanced LLM technology into medical applications.

2 November 2023
Verified
Book Chapter
Closed access
PDF file
SZShijing Zhou
Shijing Zhou
KMKyle Morgan
Kyle Morgan
EHEvan Hathaway
Evan Hathaway
RSRoma Shusterman
Roma Shusterman
PLPhan Luu
Phan Luu
DTDon M. Tucker
Don M. Tucker