Zuhaib Akhtar

Zuhaib Akhtar

Auto-generated profile, based on publicly available information

Zuhaib Akhtar

Rush University Medical Center, Chicago, IL, United States

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
10 October 2024 in JMIR Research Protocols
Verified
Journal Article
Open access
PHPhilip Held
Philip Held
SPSarah A Pridgen
Sarah A Pridgen
YCYaozhong Chen
Yaozhong Chen
ZAZuhaib Akhtar
Zuhaib Akhtar
DADarpan Amin
Darpan Amin
SPSean Pohorence
Sean Pohorence
Background: Digital mental health tools, designed to augment traditional mental health treatments, are becoming increasingly important due to a wide range of barriers to accessing mental health care, including a growing shortage of clinicians. Most existing tools use rule-based algorithms, often leading to interactions that feel unnatural compared with human therapists. Large language models (LLMs) offer a solution for the development of more natural, engaging digital tools. In this paper, we detail the development of Socrates 2.0, which was designed to engage users in Socratic dialogue surrounding unrealistic or unhelpful beliefs, a core technique in cognitive behavioral therapies. The multiagent LLM-based tool features an artificial intelligence (AI) therapist, Socrates, which receives automated feedback from an AI supervisor and an AI rater. The combination of multiple agents appeared to help address common LLM issues such as looping, and it improved the overall dialogue experience. Initial user feedback from individuals with lived experiences of mental health problems as well as cognitive behavioral therapists has been positive. Moreover, tests in approximately 500 scenarios showed that Socrates 2.0 engaged in harmful responses in under 1% of cases, with the AI supervisor promptly correcting the dialogue each time. However, formal feasibility studies with potential end users are needed. Objective: This mixed methods study examines the feasibility of Socrates 2.0. Methods: On the basis of the initial data, we devised a formal feasibility study of Socrates 2.0 to gather qualitative and quantitative data about users’ and clinicians’ experience of interacting with the tool. Using a mixed method approach, the goal is to gather feasibility and acceptability data from 100 users and 50 clinicians to inform the eventual implementation of generative AI tools, such as Socrates 2.0, in mental health treatment. We designed this study to better understand how users and clinicians interact with the tool, including the frequency, length, and time of interactions, users’ satisfaction with the tool overall, quality of each dialogue and individual responses, as well as ways in which the tool should be improved before it is used in efficacy trials. Descriptive and inferential analyses will be performed on data from validated usability measures. Thematic analysis will be performed on the qualitative data. Results: Recruitment will begin in February 2024 and is expected to conclude by February 2025. As of September 25, 2024, overall, 55 participants have been recruited. Conclusions: The development of Socrates 2.0 and the outlined feasibility study are important first steps in applying generative AI to mental health treatment delivery and lay the foundation for formal feasibility studies. International Registered Report Identifier (IRRID): DERR1-10.2196/58195

5 December 2025 in JMIR Mental Health
Verified
Journal Article
Open access
PHPhilip Held
Philip Held
SPSarah A Pridgen
Sarah A Pridgen
DSDaniel R Szoke
Daniel R Szoke
YCYaozhong Chen
Yaozhong Chen
ZAZuhaib Akhtar
Zuhaib Akhtar
DADarpan Amin
Darpan Amin
Background: Innovative, scalable mental health tools are needed to address systemic provider shortages and accessibility barriers. Large language model–based tools can provide real-time, tailored feedback to help users engage in cognitive reappraisal outside traditional therapy sessions. Socrates 2.0 (Rush University Medical Center) is a multiagent artificial intelligence tool that guides users through Socratic dialogue. Objective: The study aimed to examine the feasibility, acceptability, and potential for symptom reduction of Socrates 2.0. Methods: A total of 61 adult participants enrolled in a 4-week mixed methods preclinical feasibility study. The participants used Socrates 2.0 as desired and completed the self-report measures of depression, social anxiety, posttraumatic stress, and obsessive-compulsive symptoms at baseline and 1-month follow-up. Feasibility, acceptability, and appropriateness, along with usability and working alliance, were assessed via validated measures. The semistructured interviews explored user experiences and perceptions. Results: Participants engaged with Socrates 2.0 an average of 6.70 (SD 4.57) times over 4 weeks. Feasibility (mean 4.26, SD 0.67), acceptability (mean 4.16, SD 0.84), and usability ratings were high. Participants reported small-to-moderate reductions in depression (effect size d =0.30), social anxiety ( d =0.25), obsessive-compulsive ( d =0.33), and posttraumatic stress ( d =0.28) symptoms. Working alliance scores suggested a moderately strong perceived bond with the artificial intelligence tool. Qualitative feedback indicated that the nonjudgmental, on-demand nature of Socrates 2.0 encouraged self-reflection and exploration. Some users critiqued the repeated questioning style and limited conversation depth. Conclusions: Socrates 2.0 was perceived as feasible, acceptable, and moderately helpful for self-guided cognitive reappraisal, demonstrating potential as an adjunct to traditional therapy. Further research, including randomized trials, is needed to determine effectiveness across different populations, optimize personalization, and address the repetitive conversational nature.

19 May 2026 in JMIR Mental Health
Verified
Journal Article
Open access
DSDaniel Szoke
Daniel Szoke
IHIlana Hutzler
Ilana Hutzler
JLJerry Liu
Jerry Liu
SASamantha Addante
Samantha Addante
ZAZuhaib Akhtar
Zuhaib Akhtar
PHPhilip Held
Philip Held
Background: Artificial intelligence (AI)–based conversational tools are rapidly expanding within mental health care as a means of increasing access and scalability. At the same time, these systems introduce distinct safety risks arising from both user disclosures (eg, self-harm ideation) and inappropriate or inadequate AI responses. Objective: This study aimed to develop and evaluate the Automated Safety Testing and Reporting Application (ASTRA), an external system intended to identify clinically relevant risk behaviors across entire AI-mediated mental health conversations. Methods: ASTRA was tested on a dataset of 100 synthetic therapeutic conversations written by licensed clinicians to reflect risk behaviors and harmful responses between users and AI tools. Conversations varied in length and included both subtle and overt risk behavior examples across 8 predefined categories. Human coder consensus ratings served as the reference standard. ASTRA’s classifications were evaluated across 2 prompt iterations using standard diagnostic performance metrics and agreement statistics. Results: ASTRA demonstrated consistently high concordance with expert human ratings across all categories. Accuracy exceeded 0.90 for all risk behavior categories examined, with specificity uniformly high and sensitivity varying by category (range 0.55-1.00). Agreement beyond chance was substantial to almost perfect between ASTRA and human raters (κ=0.65-1.00). Detection of user self-harm indicators was particularly accurate, even in conversations where risk was expressed subtly. Conclusions: In this initial validation study, ASTRA reliably identified multiple forms of mental health–related risk behaviors at the conversation level. These findings support the feasibility of independent safety monitoring systems as a complement to AI tools used in mental health contexts and underscore the need for further evaluation using larger and real-world datasets.

8 August 2026
Verified
Conference Paper
Open access
SNSubhrangshu Nandi
Subhrangshu Nandi
ADArghya Datta
Arghya Datta
RNRohith Nama
Rohith Nama
UPUdita Patel
Udita Patel
NVNikhil Vichare
Nikhil Vichare
JMJeetu Mirchandani
Jeetu Mirchandani

8 March 2024 in JMIR Preprints
Verified
Preprint
Open access
PHPhilip Held
Philip Held
SPSarah A Pridgen
Sarah A Pridgen
YCYaozhong Chen
Yaozhong Chen
ZAZuhaib Akhtar
Zuhaib Akhtar
DADarpan Amin
Darpan Amin
SPSean Pohorence
Sean Pohorence
BACKGROUND Digital mental health tools, designed to augment traditional mental health treatments, are becoming increasingly important due to a wide range of barriers to accessing mental health care, including a growing shortage of clinicians. Most existing tools use rule-based algorithms, often leading to interactions that feel unnatural compared with human therapists. Large language models (LLMs) offer a solution for the development of more natural, engaging digital tools. In this paper, we detail the development of Socrates 2.0, which was designed to engage users in Socratic dialogue surrounding unrealistic or unhelpful beliefs, a core technique in cognitive behavioral therapies. The multiagent LLM-based tool features an artificial intelligence (AI) therapist, Socrates, which receives automated feedback from an AI supervisor and an AI rater. The combination of multiple agents appeared to help address common LLM issues such as looping, and it improved the overall dialogue experience. Initial user feedback from individuals with lived experiences of mental health problems as well as cognitive behavioral therapists has been positive. Moreover, tests in approximately 500 scenarios showed that Socrates 2.0 engaged in harmful responses in under 1% of cases, with the AI supervisor promptly correcting the dialogue each time. However, formal feasibility studies with potential end users are needed. OBJECTIVE This mixed methods study examines the feasibility of Socrates 2.0. METHODS On the basis of the initial data, we devised a formal feasibility study of Socrates 2.0 to gather qualitative and quantitative data about users’ and clinicians’ experience of interacting with the tool. Using a mixed method approach, the goal is to gather feasibility and acceptability data from 100 users and 50 clinicians to inform the eventual implementation of generative AI tools, such as Socrates 2.0, in mental health treatment. We designed this study to better understand how users and clinicians interact with the tool, including the frequency, length, and time of interactions, users’ satisfaction with the tool overall, quality of each dialogue and individual responses, as well as ways in which the tool should be improved before it is used in efficacy trials. Descriptive and inferential analyses will be performed on data from validated usability measures. Thematic analysis will be performed on the qualitative data. RESULTS Recruitment will begin in February 2024 and is expected to conclude by February 2025. As of September 25, 2024, overall, 55 participants have been recruited. CONCLUSIONS The development of Socrates 2.0 and the outlined feasibility study are important first steps in applying generative AI to mental health treatment delivery and lay the foundation for formal feasibility studies. INTERNATIONAL REGISTERED REPORT DERR1-10.2196/58195

13 January 2026 in JMIR Preprints
Verified
Preprint
Open access
DSDaniel Szoke
Daniel Szoke
IHIlana Hutzler
Ilana Hutzler
JLJerry Liu
Jerry Liu
SASamantha Addante
Samantha Addante
ZAZuhaib Akhtar
Zuhaib Akhtar
PHPhilip Held
Philip Held
BACKGROUND Artificial intelligence (AI)–based conversational tools are rapidly expanding within mental health care as a means of increasing access and scalability. At the same time, these systems introduce distinct safety risks arising from both user disclosures (eg, self-harm ideation) and inappropriate or inadequate AI responses. OBJECTIVE This study aimed to develop and evaluate the Automated Safety Testing and Reporting Application (ASTRA), an external system intended to identify clinically relevant risk behaviors across entire AI-mediated mental health conversations. METHODS ASTRA was tested on a dataset of 100 synthetic therapeutic conversations written by licensed clinicians to reflect risk behaviors and harmful responses between users and AI tools. Conversations varied in length and included both subtle and overt risk behavior examples across 8 predefined categories. Human coder consensus ratings served as the reference standard. ASTRA’s classifications were evaluated across 2 prompt iterations using standard diagnostic performance metrics and agreement statistics. RESULTS ASTRA demonstrated consistently high concordance with expert human ratings across all categories. Accuracy exceeded 0.90 for all risk behavior categories examined, with specificity uniformly high and sensitivity varying by category (range 0.55-1.00). Agreement beyond chance was substantial to almost perfect between ASTRA and human raters (κ=0.65-1.00). Detection of user self-harm indicators was particularly accurate, even in conversations where risk was expressed subtly. CONCLUSIONS In this initial validation study, ASTRA reliably identified multiple forms of mental health–related risk behaviors at the conversation level. These findings support the feasibility of independent safety monitoring systems as a complement to AI tools used in mental health contexts and underscore the need for further evaluation using larger and real-world datasets.