Jerry Liu

Jerry Liu

Auto-generated profile, based on publicly available information

Jerry Liu

Rush University Medical Center, Chicago, IL, United States

Research Focus & Metrics

Academic Career Length

1Year (2026-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
19 May 2026 in JMIR Mental Health
Verified
Journal Article
Open access
DSDaniel Szoke
Daniel Szoke
IHIlana Hutzler
Ilana Hutzler
JLJerry Liu
Jerry Liu
SASamantha Addante
Samantha Addante
ZAZuhaib Akhtar
Zuhaib Akhtar
PHPhilip Held
Philip Held
Background: Artificial intelligence (AI)–based conversational tools are rapidly expanding within mental health care as a means of increasing access and scalability. At the same time, these systems introduce distinct safety risks arising from both user disclosures (eg, self-harm ideation) and inappropriate or inadequate AI responses. Objective: This study aimed to develop and evaluate the Automated Safety Testing and Reporting Application (ASTRA), an external system intended to identify clinically relevant risk behaviors across entire AI-mediated mental health conversations. Methods: ASTRA was tested on a dataset of 100 synthetic therapeutic conversations written by licensed clinicians to reflect risk behaviors and harmful responses between users and AI tools. Conversations varied in length and included both subtle and overt risk behavior examples across 8 predefined categories. Human coder consensus ratings served as the reference standard. ASTRA’s classifications were evaluated across 2 prompt iterations using standard diagnostic performance metrics and agreement statistics. Results: ASTRA demonstrated consistently high concordance with expert human ratings across all categories. Accuracy exceeded 0.90 for all risk behavior categories examined, with specificity uniformly high and sensitivity varying by category (range 0.55-1.00). Agreement beyond chance was substantial to almost perfect between ASTRA and human raters (κ=0.65-1.00). Detection of user self-harm indicators was particularly accurate, even in conversations where risk was expressed subtly. Conclusions: In this initial validation study, ASTRA reliably identified multiple forms of mental health–related risk behaviors at the conversation level. These findings support the feasibility of independent safety monitoring systems as a complement to AI tools used in mental health contexts and underscore the need for further evaluation using larger and real-world datasets.

13 January 2026 in JMIR Preprints
Verified
Preprint
Open access
DSDaniel Szoke
Daniel Szoke
IHIlana Hutzler
Ilana Hutzler
JLJerry Liu
Jerry Liu
SASamantha Addante
Samantha Addante
ZAZuhaib Akhtar
Zuhaib Akhtar
PHPhilip Held
Philip Held
BACKGROUND Artificial intelligence (AI)–based conversational tools are rapidly expanding within mental health care as a means of increasing access and scalability. At the same time, these systems introduce distinct safety risks arising from both user disclosures (eg, self-harm ideation) and inappropriate or inadequate AI responses. OBJECTIVE This study aimed to develop and evaluate the Automated Safety Testing and Reporting Application (ASTRA), an external system intended to identify clinically relevant risk behaviors across entire AI-mediated mental health conversations. METHODS ASTRA was tested on a dataset of 100 synthetic therapeutic conversations written by licensed clinicians to reflect risk behaviors and harmful responses between users and AI tools. Conversations varied in length and included both subtle and overt risk behavior examples across 8 predefined categories. Human coder consensus ratings served as the reference standard. ASTRA’s classifications were evaluated across 2 prompt iterations using standard diagnostic performance metrics and agreement statistics. RESULTS ASTRA demonstrated consistently high concordance with expert human ratings across all categories. Accuracy exceeded 0.90 for all risk behavior categories examined, with specificity uniformly high and sensitivity varying by category (range 0.55-1.00). Agreement beyond chance was substantial to almost perfect between ASTRA and human raters (κ=0.65-1.00). Detection of user self-harm indicators was particularly accurate, even in conversations where risk was expressed subtly. CONCLUSIONS In this initial validation study, ASTRA reliably identified multiple forms of mental health–related risk behaviors at the conversation level. These findings support the feasibility of independent safety monitoring systems as a complement to AI tools used in mental health contexts and underscore the need for further evaluation using larger and real-world datasets.