Cinoo Lee

Cinoo Lee

Auto-generated profile, based on publicly available information

Cinoo Lee

Stanford University

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
26 March 2026 in Science
Verified
Journal Article
Closed access
MCMyra Cheng
Myra Cheng
CLCinoo Lee
Cinoo Lee
PKPranav Khadpe
Pranav Khadpe
SYSunny Yu
Sunny Yu
DHDyllan Han
Dyllan Han
DJDan Jurafsky
Dan Jurafsky
Despite rising concerns about sycophancy—excessive agreement or flattery from artificial intelligence (AI) systems—little is known about its prevalence or consequences. We show that sycophancy is widespread and harmful. Across 11 state-of-the-art models, AI affirmed users’ actions 49% more often than humans, even when queries involved deception, illegality, or other harms. In three preregistered experiments ( N = 2405), even a single interaction with sycophantic AI reduced participants’ willingness to take responsibility and repair interpersonal conflicts, while increasing their conviction that they were right. Despite distorting judgment, sycophantic models were trusted and preferred. This creates perverse incentives for sycophancy to persist: The very feature that causes harm also drives engagement. Our findings underscore the need for design, evaluation, and accountability mechanisms to protect user well-being.

9 September 2024 in Proceedings of the National Academy of Sciences
Verified
Journal Article
Open access
CLCinoo Lee
Cinoo Lee
KGKristina Gligorić
Kristina Gligorić
PKPratyusha Ria Kalluri
Pratyusha Ria Kalluri
MHMaggie Harrington
Maggie Harrington
EDEsin Durmus
Esin Durmus
JEJennifer L. Eberhardt
Jennifer L. Eberhardt
Are members of marginalized communities silenced on social media when they share personal experiences of racism? Here, we investigate the role of algorithms, humans, and platform guidelines in suppressing disclosures of racial discrimination. In a field study of actual posts from a neighborhood-based social media platform, we find that when users talk about their experiences as targets of racism, their posts are disproportionately flagged for removal as toxic by five widely used moderation algorithms from major online platforms, including the most recent large language models. We show that human users disproportionately flag these disclosures for removal as well. Next, in a follow-up experiment, we demonstrate that merely witnessing such suppression negatively influences how Black Americans view the community and their place in it. Finally, to address these challenges to equity and inclusion in online spaces, we introduce a mitigation strategy: a guideline-reframing intervention that is effective at reducing silencing behavior across the political spectrum.

1 January 2025
Verified
Conference Paper
Open access
PDF file
KGKristina Gligoric
Kristina Gligoric
TZTijana Zrnic
Tijana Zrnic
CLCinoo Lee
Cinoo Lee
ECEmmanuel Candes
Emmanuel Candes
DJDan Jurafsky
Dan Jurafsky
Kristina Gligoric, Tijana Zrnic, Cinoo Lee, Emmanuel Candes, Dan Jurafsky. Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers). 2025.

30 March 2023 in arXiv
Verified
Preprint
Open access
PDF file
SSShibani Santurkar
Shibani Santurkar
EDEsin Durmus
Esin Durmus
FLFaisal Ladhak
Faisal Ladhak
CLCinoo Lee
Cinoo Lee
PLPercy Liang
Percy Liang
THTatsunori Hashimoto
Tatsunori Hashimoto
Language models (LMs) are increasingly being used in open-ended contexts, where the opinions reflected by LMs in response to subjective queries can have a profound impact, both on user satisfaction, as well as shaping the views of society at large. In this work, we put forth a quantitative framework to investigate the opinions reflected by LMs -- by leveraging high-quality public opinion polls and their associated human responses. Using this framework, we create OpinionsQA, a new dataset for evaluating the alignment of LM opinions with those of 60 US demographic groups over topics ranging from abortion to automation. Across topics, we find substantial misalignment between the views reflected by current LMs and those of US demographic groups: on par with the Democrat-Republican divide on climate change. Notably, this misalignment persists even after explicitly steering the LMs towards particular demographic groups. Our analysis not only confirms prior observations about the left-leaning tendencies of some human feedback-tuned LMs, but also surfaces groups whose opinions are poorly reflected by current LMs (e.g., 65+ and widowed individuals). Our code and data are available at https://github.com/tatsu-lab/opinions_qa.

1 October 2025 in arXiv
Verified
Preprint
Open access
PDF file
MCMyra Cheng
Myra Cheng
CLCinoo Lee
Cinoo Lee
PKPranav Khadpe
Pranav Khadpe
SYSunny Yu
Sunny Yu
DHDyllan Han
Dyllan Han
DJDan Jurafsky
Dan Jurafsky
Both the general public and academic communities have raised concerns about sycophancy, the phenomenon of artificial intelligence (AI) excessively agreeing with or flattering users. Yet, beyond isolated media reports of severe consequences, like reinforcing delusions, little is known about the extent of sycophancy or how it affects people who use AI. Here we show the pervasiveness and harmful impacts of sycophancy when people seek advice from AI. First, across 11 state-of-the-art AI models, we find that models are highly sycophantic: they affirm users' actions 50% more than humans do, and they do so even in cases where user queries mention manipulation, deception, or other relational harms. Second, in two preregistered experiments (N = 1604), including a live-interaction study where participants discuss a real interpersonal conflict from their life, we find that interaction with sycophantic AI models significantly reduced participants' willingness to take actions to repair interpersonal conflict, while increasing their conviction of being in the right. However, participants rated sycophantic responses as higher quality, trusted the sycophantic AI model more, and were more willing to use it again. This suggests that people are drawn to AI that unquestioningly validate, even as that validation risks eroding their judgment and reducing their inclination toward prosocial behavior. These preferences create perverse incentives both for people to increasingly rely on sycophantic AI models and for AI model training to favor sycophancy. Our findings highlight the necessity of explicitly addressing this incentive structure to mitigate the widespread risks of AI sycophancy.