Objective: The objective of this study was to explore the acceptability and feasibility of a therapeutic assessment protocol for the Screening and Support of Youth (SASY). SASY provides brief but comprehensive community-based screening and support for diverse youth in the community. Methods: SASY screening evaluates symptoms, functioning and clinical risk. The Kiddie Computerized Adaptive Test was used to evaluate seven different diagnoses and symptom severity. The Weiss Functional Impairment Rating Scale-Self was used to measure functional impairment. Measures were scored according to nationally developed norms. An algorithm was developed to aggregate symptom and function ratings into an overall score for clinical risk. The results are discussed with participants in a motivational interview designed to promote insight, followed by the opportunity for the participant to engage in an online intervention. Protocol changes necessitated by social distancing during the pandemic led to innovative methods including the use of a QR code for recruitment, integration of both online and offline participation, and expansion from in-person recruitment within the schools to virtual engagement with youth throughout the community. The final sample included disproportionately more Black or African American and Hispanic youth as compared to school and community statistics, suggesting that optimization of online and offline methods in research may facilitate the recruitment of diverse populations. Qualitative interviews indicated that the screening and feedback raised youth awareness of their wellbeing and/or distress, its impact on their functioning, and engagement with options for improved wellbeing. Conclusions: The emergence of innovative methods optimizing the advantages of both online and offline methods, developed as a necessity during the pandemic, proved advantageous to the feasibility and acceptability of community-based recruitment of at-risk, minoritized youth.
Background: Measurement-based care (MBC), including remote MBC, is increasingly being considered or implemented for mental health treatment and outcomes monitoring in routine clinical care. However, little is known about the health equity implications in real-world practice or the impact on patient-provider relationships in lower-resource systems that offer mental health treatment for diverse patients. Objective: This hypothesis-generating study examined the drivers of MBC implementation outcomes, the implications for health equity, and the impact of MBC on therapeutic alliance (TA). The study was conducted 1 year after the implementation of remote MBC at 3 outpatient adult clinics in a diverse, safety-net health system. Methods: This explanatory sequential mixed methods study used quantitative surveys and qualitative focus groups with mental health care providers. Repeated surveys were first used to understand mental health care provider experiences over a 6-month period, at least 1 year after MBC implementation. Surveys were analyzed to refine focus group prompts. Six mental health providers participated in repeated surveys over 6 months, after which the same 6 providers and 1 additional mental health provider took part in focus groups. Results: Surveys revealed stable acceptability and utility ratings, concerns that MBC was not equally benefiting patients, little endorsement that MBC improved TA, and slightly decreasing feasibility scores. In focus groups, mental health care providers shared concerns about the acceptability, appropriateness, feasibility, and equity of processes for collecting MBC data. These providers had less first-hand experience with sharing and acting upon the data but still voiced concerns about the processes for doing so. TA both impacted and was impacted by MBC in positive and negative ways. The potential drivers of the findings are discussed using qualitative data. Conclusions: More than 1 year after the implementation of remote MBC for mental health, mental health care providers had enduring concerns about its implications for health equity as well as its bidirectional relationship with TA. These findings suggest that further study is needed to identify system-level strategies to mitigate potential negative effects of real-world MBC implementations on health equity, particularly in low-resource settings with diverse populations.
Stigmatizing language in clinical documentation, which conveys negative stereotypes, attitudes, or judgments toward patients, is a recognized source of documentation bias and is associated with poorer care and adverse health outcomes. Although prior stigma-related research has focused on clinician-written EHR notes, the increasing use of large language model (LLM)-generated documentation in clinical workflows raises new concerns about its potential to reproduce or amplify bias and affect patient safety. In this study, we conducted a large-scale assessment of stigmatizing language in LLM-generated reasoning text on 35 real-world clinical tasks across 107 LLMs. We applied a psychiatrist-validated, natural language processing (NLP) system to detect stigma terms in LLM reasoning text and quantified stigma rates of LLM-generated reasoning texts across 3,745 model-task pairs. Results showed that stigma rates ranged from 0% to 33.33%, with 84.06% of pairs containing stigma terms. Open-source models and reasoning models showed statistically higher stigma rates than proprietary (1.97% vs. 1.60%; p < 0.01) and non-reasoning models (2.35% vs. 1.70%; p < 0.0001), while the stigma rate difference between the general and medical models is not statistically significant (2.00% vs. 1.80%; p = 0.26). Stigma rates of LLM outputs correlated negatively with task accuracy (r = -0.304; p < 0.001) and positively with input clinical-text stigma (r = 0.569; p < 0.001), with 19.76% of model-task pairs amplifying stigma in the original input notes. Applying prompt engineering as a destigmatizing approach helped reduce model stigma rates by as much as 91.91% without affecting the model performance. This study shows that stigmatizing language generation is common but reducible during LLMs’ reasoning traces, suggesting that well-implemented approaches for LLM monitoring and destigmatizing will be essential for healthcare systems to implement.
Objective: To explore the acceptability and feasibility of conducting comprehensive, community-based, hy-brid (in-person and virtual) mental health screening and feedback with diverse youth in the community. Methods: The Screening and Support for Youth intervention provides comprehensive assessment and thera-peutic feedback in community settings including symptoms, diagnoses, functional impairment, suicide, and clinical risk. Symptom severity, seven diagnoses and suicidality were assessed with the Kiddie Computer-ized Adaptive Test. Functional impairment was evaluated by youth self-report on the Weiss Functional Im-pairment Rating Scale. Measures were scored according to nationally developed norms and an algorithm was developed to aggregate symptoms and functioning to determine clinical risk. The results were discussed with participants in a motivational interview to promote insight and engagement in an online intervention. Results: Methodological innovations included using a QR code for recruitment, integrated in-person and virtual participation, and expansion from in-person recruitment within the schools to virtual engagement with youth throughout the community. The final sample included disproportionately more Black or African American and Hispanic youth as compared to school and community statistics, suggesting that hybrid re-search may facilitate recruitment of diverse populations. Qualitative interviews indicated that the screening and feedback raised youth awareness of their wellbeing and/or distress, its impact on their functioning, and engagement with options for improving wellbeing. Conclusion: Hybrid research, developed as a necessity during the pandemic, proved advantageous to the feasibility and acceptability of community-based recruit-ment of at risk, minoritized youth.