Tingting Liu

Tingting Liu

Auto-generated profile, based on publicly available information

Tingting Liu

National Institute on Drug Abuse

Research Focus & Metrics

Academic Career Length

10Years (2017-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
24 April 2023 in Neuropsychopharmacology
Verified
Journal Article
Open access
PDF file
BCBrenda Curtis
Brenda Curtis
SGSalvatore Giorgi
Salvatore Giorgi
LULyle Ungar
Lyle Ungar
HVHuy Vu
Huy Vu
DYDavid Yaden
David Yaden
HSH. Andrew Schwartz
H. Andrew Schwartz
The reoccurrence of use (relapse) and treatment dropout is frequently observed in substance use disorder (SUD) treatment. In the current paper, we evaluated the predictive capability of an AI-based digital phenotype using the social media language of patients receiving treatment for substance use disorders (N = 269). We found that language phenotypes outperformed a standard intake psychometric assessment scale when predicting patients’ 90-day treatment outcomes. We also use a modern deep learning-based AI model, Bidirectional Encoder Representations from Transformers (BERT) to generate risk scores using pre-treatment digital phenotype and intake clinic data to predict dropout probabilities. Nearly all individuals labeled as low-risk remained in treatment while those identified as high-risk dropped out (risk score for dropout AUC = 0.81; p < 0.001). The current study suggests the possibility of utilizing social media digital phenotypes as a new tool for intake risk assessment to identify individuals most at risk of treatment dropout and relapse.

18 October 2022 in npj Mental Health Research
Verified
Journal Article
Open access
PDF file
TLTingting Liu
Tingting Liu
LULyle H. Ungar
Lyle H. Ungar
BCBrenda Curtis
Brenda Curtis
GSGarrick Sherman
Garrick Sherman
KYKenna Yadeta
Kenna Yadeta
SGSharath Chandra Guntuku
Sharath Chandra Guntuku
We study the language differentially associated with loneliness and depression using 3.4-million Facebook posts from 2986 individuals, and uncover the statistical associations of survey-based depression and loneliness with both dictionary-based (Linguistic Inquiry Word Count 2015) and open-vocabulary linguistic features (words, phrases, and topics). Loneliness and depression were found to have highly overlapping language profiles, including sickness, pain, and negative emotions as (cross-sectional) risk factors, and social relationships and activities as protective factors. Compared to depression, the language associated with loneliness reflects a stronger cognitive focus, including more references to cognitive processes (i.e., differentiation and tentative language, thoughts, and the observation of irregularities), and cognitive activities like reading and writing. As might be expected, less lonely users were more likely to reference social relationships (e.g., friends and family, romantic relationships), and use first-person plural pronouns. Our findings suggest that the mechanisms of loneliness include self-oriented cognitive activities (i.e., reading) and an overattention to the interpretation of information in the environment. These data-driven ecological findings suggest interventions for loneliness that target maladaptive social cognitions (e.g., through reframing the perception of social environments), strengthen social relationships, and treat other affective distress (i.e., depression).

11 April 2025 in Proceedings of the AAAI Conference on Artificial Intelligence
Verified
Journal Article
Open access
PDF file
TLTingting Liu
Tingting Liu
SGSalvatore Giorgi
Salvatore Giorgi
AAAnkit Aich
Ankit Aich
ALAllison Lahnala
Allison Lahnala
BCBrenda Curtis
Brenda Curtis
JSJoão Sedoc
João Sedoc
As AI chatbots increasingly incorporate empathy, understanding user-centered perceptions of chatbot empathy and its impact on conversation quality remains essential yet under-explored. This study examines how chatbot identity and perceived empathy influence users' overall conversation experience. Analyzing 155 conversations from two datasets, we found that while GPT-based chatbots were rated significantly higher in conversational quality, they were consistently perceived as less empathetic than human conversational partners. Empathy ratings from GPT-4o annotations aligned with user ratings, reinforcing the perception of lower empathy in chatbots compared to humans. Our findings underscore the critical role of perceived empathy in shaping conversation quality, revealing that achieving high-quality human-AI interactions requires more than simply embedding empathetic language; it necessitates addressing the nuanced ways users interpret and experience empathy in conversations with chatbots.

30 April 2023
Verified
Conference Paper
Open access
TLTingting Liu
Tingting Liu
DJDevansh Jain
Devansh Jain
SRShivani R Rapole
Shivani R Rapole
BCBrenda Curtis
Brenda Curtis
JEJohannes Eichstaedt
Johannes Eichstaedt
SGSharath Chandra Guntuku
Sharath Chandra Guntuku
Depression is known to have heterogeneous symptom manifestations. Investigating various symptoms of depression is essential to understanding underlying mechanisms and personalizing treatments. Reddit, an online peer-to-peer social media platform, contains varied communities (subreddits) where individuals discuss their detailed mental health experiences and seek support. The current paper has two aims. The first is to identify psycho-linguistic and open-vocabulary language markers associated with different symptoms using 1,318,749 posts from 43 subreddit communities (e.g., r/bingeeating) clustered into 13 expert-validated depression symptoms (e.g., disordered eating). The second aim is to develop prediction models based on the above linguistic features and RoBERTa embeddings to detect specific symptom discourse in contrast to control subreddit posts contributed by the same Reddit users. These predictive models are then validated on a second sample of individuals (N = 2,986) who shared their Facebook posts and completed self-report depression (PHQ-9), anxiety (GAD-7), and loneliness (UCLA-3) surveys. Based on the differential linguistic patterns that emerged across the various symptoms in our data, we identified three potential clusters, which could also be mapped to the Research Domain Criteria (RDoC) framework. RoBERTa embeddings demonstrated the highest accuracy at predicting most symptoms and were particularly robust at predicting the severity of suicidal thoughts and attempts, self-loathing, loneliness, and disordered eating. Our study demonstrates the potential of using large, pseudonymous online forums to train language-based symptom-estimation machine-learning models that can be applied to other text sources. Such technologies could be helpful in clinical psychology, population health, and other areas where early mental health monitoring could improve diagnosis, risk reduction, and treatment.

5 December 2022 in Social Science & Medicine
Verified
Journal Article
Closed access
XTXiangyu Tao
Xiangyu Tao
TLTingting Liu
Tingting Liu
CFCelia Fisher
Celia Fisher
SGSalvatore Giorgi
Salvatore Giorgi
BCBrenda Curtis
Brenda Curtis

19 July 2022 in The American Journal of Drug and Alcohol Abuse
Verified
Journal Article
Closed access
TLTingting Liu
Tingting Liu
SGSalvatore Giorgi
Salvatore Giorgi
KYKenna Yadeta
Kenna Yadeta
HSH. Andrew Schwartz
H. Andrew Schwartz
LULyle H. Ungar
Lyle H. Ungar
BCBrenda Curtis
Brenda Curtis
Background: Early indicators of who will remain in – or leave – treatment for substance use disorder (SUD) can drive targeted interventions to support long-term recovery. Objectives: To conduct a comprehensive study of linguistic markers of SUD treatment outcomes, the current study integrated features produced by machine learning models known to have social-psychology relevance. Methods: We extracted and analyzed linguistic features from participants’ Facebook posts (N = 206, 39.32% female; 55,415 postings) over the two years before they entered a SUD treatment program. Exploratory features produced by both Linguistic Inquiry and Word Count (LIWC) and Latent Dirichlet Allocation (LDA) topic modeling and the features from theoretical domains of religiosity, affect, and temporal orientation via established AI-based linguistic models were utilized. Results: Patients who stayed in the SUD treatment for over 90 days used more words associated with religion, positive emotions, family, affiliations, and the present, and used more first-person singular pronouns (Cohen’s d values: [−0.39, −0.57]). Patients who discontinued their treatment before 90 days discussed more diverse topics, focused on the past, and used more articles (Cohen’s d values: [0.44, 0.57]). All ps < .05 with Benjamini-Hochberg False Discovery Rate correction. Conclusions: We confirmed the literature on protective and risk social-psychological factors linking to SUD treatment in language analysis, showing that Facebook language before treatment entry could be used to identify the markers of SUD treatment outcomes. This reflects the importance of taking these linguistic features and markers into consideration when designing and recommending SUD treatment plans.