Lu He

Lu He

Auto-generated profile, based on publicly available information

Lu He

Zilber College of Public Health, University of Wisconsin-Milwaukee, Milwaukee, Wisconsin

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
20 March 2024 in medRxiv
Verified
Preprint
Open access
PDF file
LHLu He
Lu He
SOSeyedeh Samaneh Omranian
Seyedeh Samaneh Omranian
SMSusan McRoy
Susan McRoy
KZKai Zheng
Kai Zheng
Health-related social media data generated by patients and the public provide valuable insights into patient experiences and opinions toward health issues such as vaccination and medical treatments. Using Natural Language Processing (NLP) methods to analyze such data, however, often requires high-quality annotations that are difficult to obtain. The recent emergence of Large Language Models (LLMs) such as the Generative Pre-trained Transformers (GPTs) has shown promising performance on a variety of NLP tasks in the health domain with little to no annotated data. However, their potential in analyzing health-related social media data remains underexplored. In this paper, we report empirical evaluations of LLMs (GPT-3.5-Turbo, FLAN-T5, and BERT-based models) on a common NLP task of health-related social media data: sentiment analysis for identifying opinions toward health issues. We explored how different prompting and fine-tuning strategies affect the performance of LLMs on social media datasets across diverse health topics, including Healthcare Reform, vaccination, mask wearing, and healthcare service quality. We found that LLMs outperformed VADER, a widely used off-the-shelf sentiment analysis tool, but are far from being able to produce accurate sentiment labels. However, their performance can be improved by data-specific prompts with information about the context, task, and targets. The highest performing LLMs are BERT-based models that were fine-tuned on aggregated data. We provided practical tips for researchers to use LLMs on health-related social media data for optimal outcomes. We also discuss future work needed to continue to improve the performance of LLMs for analyzing health-related social media data with minimal annotations.

11 July 2025 in BioMedInformatics
Verified
Journal Article
Open access
PDF file
APApoorv Prasad
Apoorv Prasad
SSSetayesh Abiazi Shalmani
Setayesh Abiazi Shalmani
LHLu He
Lu He
YWYang Wang
Yang Wang
Susan McRoySusan McRoy
Susan McRoy
Background: Social media represents a unique opportunity to investigate the perspectives of people with eating disorders at scale. One forum alone, r/EatingDisorders, now has 113,000 members worldwide. In less than a day, where a manual analysis might sample a few dozen items, automatic classification using large language models (LLMs) can analyze thousands of posts. Methods: Here, we compare multiple strategies for invoking an LLM, including ones that include examples (few-shot) and annotation guidelines, to classify eating disorder content across 14 predefined themes using Llama3.1:8b on 6850 social media posts. In addition to standard metrics, we calculate four novel dimensions of classification quality: a Category Divergence Index, confidence scores (overall model certainty), focus scores (a measure of decisiveness for selected subsets of themes), and dominance scores (primary theme identification strength). Results: By every measure, invoking an LLM without extensive guidance and examples (zero-shot) is insufficient. Zero-shot had worse mean category divergence (7.17 versus 3.17). Whereas, few-shot yielded higher mean confidence, 0.42 versus 0.27, and higher mean dominance, 0.81 versus 0.46. Overall, a few-shot approach improved quality measures across nearly 90% of predictions. Conclusions: These findings suggest that LLMs, if invoked with expert instructions and helpful examples, can provide instantaneous high-quality annotation, enabling automated mental health content moderation systems or future clinical research.

19 March 2026 in medRxiv
Verified
Preprint
Open access
PDF file
RNRaisa Ntemenyi Nkweteyim
Raisa Ntemenyi Nkweteyim
VSVishesh Girish Shet
Vishesh Girish Shet
SISandra Iregbu
Sandra Iregbu
LHLu He
Lu He
Managing diabetes-related conditions is time-intensive and cognitively demanding for patients and caregivers, requiring ongoing glucose monitoring, dietary regulation, physical activity planning, and continuous lifestyle adaptation. With the emergence of large language models (LLMs), patients have increasingly turned to these tools for information, guidance, and support. However, there is limited empirical understanding of which diabetes-related medical tasks patients delegate to LLMs and what their experiences are. To address this gap, we combined qualitative thematic analysis with LLM-assisted analysis to examine patient attitudes and real-world use cases in using LLMs for diabetes-related tasks. Our analysis identified diverse application areas, ranging from clinical interpretation to nutrition and diet support, and disease management amongst others. LLMs functioned not only as information sources, but as interpretive, analytical, decision-support, emotional, and logistical aids supporting patients’ self-management. Last, we discuss implications for integrating LLMs into patients’ self-management support ecosystems and identify areas that require support and safeguards.

16 January 2026 in Research Square
Verified
Preprint
Open access
PDF file
LHLu He
Lu He
DDD. Phuong Do
D. Phuong Do
VSVishesh Girish Shet
Vishesh Girish Shet
OFOmar Farghaly
Omar Farghaly
PDPriya Deshpande
Priya Deshpande
MBMolly Beestrum
Molly Beestrum
Objective: To conduct a scoping review of bias assessment in studies applying Large Language Models (LLMs) to health data and to synthesize their prevailing conceptualization of bias. Material and methods: Following PRISMA guidelines, we queried PubMed and Scopus. Two annotators screened titles, abstracts, and full texts for eligibility, calibrating their assessments throughout the process. For included studies, we extracted and summarized data on LLMs (name and version, development domain, open- or closed- sourced status, and commercial or academic origin), NLP tasks (task formulation, gold standard dataset, evaluation metrics, prompting or fine-tuning strategies), and biases (type, assessment, and bias summary). Results: Of the 1,585 records retrieved, 76 papers met the eligibility criteria for full review. Among these, 59 reported identifying bias. Three major conceptualizations of bias emerged: behavioral output bias (non-stereotyping and stereotyping), predictive outcome bias, and representational bias. Studies generally adopted an observational approach (measuring bias using the existing dataset) or an experimental approach (altering prompts, e.g., with different demographic information, and comparing outputs). Discussion and Conclusion: Behavioral output bias and predictive outcome bias, both of which emphasize parity, dominate existing studies. Whether evaluated against external accuracy or internal equality benchmarks, these approaches often assume that equal performance across groups is inherently desirable. Treating all disparities as bias risks conflating poor model behavior with real-world disparities, and researchers should remain aware of potential trade-offs between parity and accuracy objectives. We introduce an integrated framework that combines parity and accuracy benchmarks and encourages transparent, context-aware interpretation of group differences.

18 November 2023 in arXiv
Verified
Preprint
Open access
PDF file
CHChangyang He
Changyang He
LHLu He
Lu He
WYWenjie Yang
Wenjie Yang
BLBo Li
Bo Li
Social media images, curated or casual, have become a crucial component of communicating situational information and emotions during health crises. Despite its prevalence and significance in informational dissemination and emotional connection, there lacks a comprehensive understanding of visual crisis communication in the aftermath of a pandemic which is characterized by uncertain local situations and emotional fatigue. To fill this gap, this work collected 345,423 crisis-related posts and 65,376 original images during the Xi'an COVID-19 local outbreak in China, and adopted a mixed-methods approach to understanding themes, goals, and strategies of crisis imagery. Image clustering captured the diversity of visual themes during the outbreak, such as text images embedding authoritative guidelines and ``visual diaries'' recording and sharing the quarantine life. Through text classification of the post that visuals were situated in, we found that different visual themes highly correlated with the informational and emotional goals of the post text, such as adopting text images to convey the latest policies and sharing food images to express anxiety. We further unpacked nuanced strategies of crisis image use through inductive coding, such as signifying authority and triggering empathy. We discuss the opportunities and challenges of crisis imagery and provide design implications to facilitate effective visual crisis communication.

18 November 2023 in arXiv
Verified
Preprint
Open access
PDF file
CHChangyang He
Changyang He
YDYue Deng
Yue Deng
LHLu He
Lu He
QGQingyu Guo
Qingyu Guo
YZYu Zhang
Yu Zhang
BLBo Li
Bo Li
Discussing research-sensemaking questions on Community Question and Answering (CQA) platforms has been an increasingly common practice for the public to participate in science communication. Nonetheless, how users strategically craft research-sensemaking questions to engage public participation and facilitate knowledge construction is a significant yet less understood problem. To fill this gap, we collected 837 science-related questions and 157,684 answers from Zhihu, and conducted a mixed-methods study to explore user-developed strategies in proposing research-sensemaking questions, and their potential effects on public engagement and knowledge construction. Through open coding, we captured a comprehensive taxonomy of question-crafting strategies, such as eyecatching narratives with counter-intuitive claims and rigorous descriptions with data use. Regression analysis indicated that these strategies correlated with user engagement and answer construction in different ways (e.g., emotional questions attracted more views and answers), yet there existed a general divergence between wide participation and quality knowledge establishment, when most questioning strategies could not ensure both. Based on log analysis, we further found that collaborative editing afforded unique values in refining research-sensemaking questions regarding accuracy, rigor, comprehensiveness and attractiveness. We propose design implications to facilitate accessible, accurate and engaging science communication on CQA platforms.