Steffen T. Eberhardt

Steffen T. Eberhardt

Auto-generated profile, based on publicly available information

Steffen T. Eberhardt

Department of Psychology, Trier University, Trier, Germany

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
17 February 2024 in Psychotherapy Research
Verified
Journal Article
Open access
SESteffen T. Eberhardt
Steffen T. Eberhardt
JSJana Schaffrath
Jana Schaffrath
DMDanilo Moggia
Danilo Moggia
BSBrian Schwartz
Brian Schwartz
MJMartin Jaehde
Martin Jaehde
WLWolfgang Lutz
Wolfgang Lutz
Given the importance of emotions in psychotherapy, valid measures are essential for research and practice. As emotions are expressed at different levels, multimodal measurements are needed for a nuanced assessment. Natural Language Processing (NLP) could augment the measurement of emotions. The study explores the validity of sentiment analysis in psychotherapy transcripts. We used a transformer-based NLP algorithm to analyze sentiments in 85 transcripts from 35 patients. Construct and criterion validity were evaluated using self- and therapist reports and process and outcome measures via correlational, multitrait-multimethod, and multilevel analyses. The results provide indications in support of the sentiments' validity. For example, sentiments were significantly related to self- and therapist reports of emotions in the same session. Sentiments correlated significantly with in-session processes (e.g., coping experiences), and an increase in positive sentiments throughout therapy predicted better outcomes after treatment termination. Sentiment analysis could serve as a valid approach to assessing the emotional tone of psychotherapy sessions and may contribute to the multimodal measurement of emotions. Future research could combine sentiment analysis with automatic emotion recognition in facial expressions and vocal cues via the Nonverbal Behavior Analyzer (NOVA). Limitations (e.g., exploratory study with numerous tests) and opportunities are discussed.

29 March 2024 in Administration and Policy in Mental Health and Mental Health Services Research
Verified
Journal Article
Open access
PDF file
CLChristopher Lalk
Christopher Lalk
TSTobias Steinbrenner
Tobias Steinbrenner
WKWeronika Kania
Weronika Kania
APAlexander Popko
Alexander Popko
RWRobin Wester
Robin Wester
JRJulian Rubel
Julian Rubel
We aim to use topic modeling, an approach for discovering clusters of related words (“topics”), to predict symptom severity and therapeutic alliance in psychotherapy transcripts, while also identifying the most important topics and overarching themes for prediction. We analyzed 552 psychotherapy transcripts from 124 patients. Using BERTopic (Grootendorst, 2022), we extracted 250 topics each for patient and therapist speech. These topics were used to predict symptom severity and alliance with various competing machine-learning methods. Sensitivity analyses were calculated for a model based on 50 topics, LDA-based topic modeling, and a bigram model. Additionally, we grouped topics into themes using qualitative analysis and identified key topics and themes with eXplainable Artificial Intelligence (XAI). Symptom severity could be predicted with highest accuracy by patient topics ( $$r$$ r =0.45, 95%-CI 0.40, 0.51), whereas alliance was better predicted by therapist topics ( $$r$$ r =0.20, 95%-CI 0.16, 0.24). Drivers for symptom severity were themes related to health and negative experiences. Lower alliance was correlated with various themes, especially psychotherapy framework, income, and everyday life. This analysis shows the potential of using topic modeling in psychotherapy research allowing to predict several treatment-relevant metrics with reasonable accuracy. Further, the use of XAI allows for an analysis of the individual predictive value of topics and themes. Limitations entail heterogeneity across different topic modeling hyperparameters and a relatively small sample size.

12 August 2025 in Scientific Reports
Verified
Journal Article
Open access
PDF file
SESteffen T. Eberhardt
Steffen T. Eberhardt
AVAntonia Vehlen
Antonia Vehlen
JSJana Schaffrath
Jana Schaffrath
BSBrian Schwartz
Brian Schwartz
TBTobias Baur
Tobias Baur
WLWolfgang Lutz
Wolfgang Lutz
Rating scales have shaped psychological research, but are resource-intensive and can burden participants. Large Language Models (LLMs) offer a tool to assess latent constructs in text. This study introduces LLM rating scales, which use LLM responses instead of human ratings. We demonstrate this approach with an LLM rating scale measuring patient engagement in therapy transcripts. Automatically transcribed videos of 1,131 sessions from 155 patients were analyzed using DISCOVER, a software framework for local multimodal human behavior analysis. Llama 3.1 8B LLM rated 120 engagement items, averaging the top eight into a total score. Psychometric evaluation showed a normal distribution, strong reliability (ω = 0.953), and acceptable fit (CFI = 0.968, SRMR = 0.022), except RMSEA = 0.108. Validity was supported by significant correlations with engagement determinants (e.g., motivation, r = .413), processes (e.g., between-session efforts, r = .390), and outcomes (e.g., symptoms, r = − .304). Results remained robust across bootstrap resampling and cross-validation, accounting for nested data. The LLM rating scale exhibited strong psychometric properties, demonstrating the potential of the approach as an assessment tool. Importantly, this automated approach uses interpretable items, ensuring clear understanding of measured constructs, while supporting local implementation and protecting confidential data.

4 December 2024 in Cognitive Therapy and Research
Verified
Journal Article
Open access
PDF file
CLChristopher Lalk
Christopher Lalk
TSTobias Steinbrenner
Tobias Steinbrenner
JPJuan S. Pena
Juan S. Pena
WKWeronika Kania
Weronika Kania
JSJana Schaffrath
Jana Schaffrath
JRJulian Rubel
Julian Rubel
Background: Based on previous work on the identification of cognitive distortions in language data, we aim to predict patient depression symptoms by identifying cognitive distortions in their psychotherapy transcripts. Further, using explainable AI we want to create a machine learning model that can be used to identify important distortions, allowing us to assess the most important distortions across the whole dataset and for individual patients. Methods: We identified 14 cognitive distortions by modifying lists of representative n-grams created by Bathina et al. (Nat Hum Behav 5(4):458–466, 2021, https://doi.org/10.1038/s41562-021-01050-7). Based on these n-grams, the relative frequency of the distortions was calculated across 552 transcripts of 124 patients and employed to predict patient depression symptoms. Further, we joined all distortions in an exploratory explainable AI model, combining various machine learning algorithms in a nested cross-validation framework for the prediction of depression symptoms. Results: Depression severity and occurrence were predicted by the distortions personalizing ( $$r=.13)$$ r = . 13 ) , dichotomous thinking ( $$r=.11)$$ r = . 11 ) , and overgeneralizing ( $$r=.10)$$ r = . 10 ) , while occurrence was additionally predicted by mental filtering. The joined machine learning model achieved a moderate performance of $$r=.29$$ r = . 29 . Using explainable AI, we identified the distortions with the highest feature impact in the combined model (i.e., dichotomous reasoning, minimization, personalizing, mindreading, and mental filtering) and were able to explain the prediction for individual transcripts. Conclusions: This approach illustrates how language-based measures can identify relevant processes that predict depression symptoms. This may improve our understanding of the effects of cognitive distortions and may be utilized to create feedback to therapists. Limitations prevail due to small effect sizes and the exploratory approach of this study.

15 December 2023 in Administration and Policy in Mental Health and Mental Health Services Research
Verified
Journal Article
Open access
PDF file
WLWolfgang Lutz
Wolfgang Lutz
JSJana Schaffrath
Jana Schaffrath
SESteffen T. Eberhardt
Steffen T. Eberhardt
MHMiriam I. Hehlmann
Miriam I. Hehlmann
BSBrian Schwartz
Brian Schwartz
DMDanilo Moggia
Danilo Moggia
Outcome measurement including data-informed decision support for therapists in psychological therapy has developed impressively over the past two decades. New technological developments such as computerized data assessment, and feedback tools have facilitated advanced implementation in several seetings. Recent developments try to improve the clinical decision-making process by connecting clinical practice better with empirical data. For example, psychometric data can be used by clinicians to personalize the selection of therapeutic programs, strategies or modules and to monitor a patient’s response to therapy in real time. Furthermore, clinical support tools can be used to improve the treatment for patients at risk for a negative outcome. Therefore, measurement-based care can be seen as an important and integral part of clinical competence, practice, and training. This is comparable to many other areas in the healthcare system, where continuous monitoring of health indicators is common in day-to-day clinical practice (e.g., fever, blood pressure). In this paper, we present the basic concepts of a data-informed decision support system for tailoring individual psychological interventions to specific patient needs, and discuss the implications for implementing this form of precision mental health in clinical practice.

1 October 2022 in Psychology of Men & Masculinities
Verified
Journal Article
Closed access
RMRyon C. McDermott
Ryon C. McDermott
MAMichael Addis
Michael Addis
DGDouglas Gazarian
Douglas Gazarian
SESteffen T. Eberhardt
Steffen T. Eberhardt
KBKyle M. Brasil
Kyle M. Brasil