Valerie Chen

Valerie Chen

Auto-generated profile, based on publicly available information

Valerie Chen

Carnegie Mellon University, Pittsburgh, Pennsylvania, USA

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
28 September 2023 in Proceedings of the ACM on Human-Computer Interaction
Verified
Journal Article
Open access
VCValerie Chen
Valerie Chen
QLQ. Vera Liao
Q. Vera Liao
JVJennifer Wortman Vaughan
Jennifer Wortman Vaughan
GBGagan Bansal
Gagan Bansal
AI explanations are often mentioned as a way to improve human-AI decision-making, but empirical studies have not found consistent evidence of explanations' effectiveness and, on the contrary, suggest that they can increase overreliance when the AI system is wrong. While many factors may affect reliance on AI support, one important factor is how decision-makers reconcile their own intuition---beliefs or heuristics, based on prior knowledge, experience, or pattern recognition, used to make judgments---with the information provided by the AI system to determine when to override AI predictions. We conduct a think-aloud, mixed-methods study with two explanation types (feature- and example-based) for two prediction tasks to explore how decision-makers' intuition affects their use of AI predictions and explanations, and ultimately their choice of when to rely on AI. Our results identify three types of intuition involved in reasoning about AI predictions and explanations: intuition about the task outcome, features, and AI limitations. Building on these, we summarize three observed pathways for decision-makers to apply their own intuition and override AI predictions. We use these pathways to explain why (1) the feature-based explanations we used did not improve participants' decision outcomes and increased their overreliance on AI, and (2) the example-based explanations we used improved decision-makers' performance over feature-based explanations and helped achieve complementary human-AI performance. Overall, our work identifies directions for further development of AI decision-support systems and explanation methods that help decision-makers effectively apply their intuition to achieve appropriate reliance on AI.


25 April 2025
Verified
Conference Paper
Open access
VCValerie Chen
Valerie Chen
AZAlan Zhu
Alan Zhu
SZSebastian Zhao
Sebastian Zhao
HMHussein Mozannar
Hussein Mozannar
DSDavid Sontag
David Sontag
ATAmeet Talwalkar
Ameet Talwalkar

23 June 2025
Verified
Conference Paper
Open access
SZSebastian Zhao
Sebastian Zhao
AZAlan Zhu
Alan Zhu
HMHussein Mozannar
Hussein Mozannar
DSDavid Sontag
David Sontag
ATAmeet Talwalkar
Ameet Talwalkar
VCValerie Chen
Valerie Chen

30 October 2023
Verified
Conference Paper
Open access
MBMatthew Barker
Matthew Barker
EKEmma Kallina
Emma Kallina
DADhananjay Ashok
Dhananjay Ashok
KCKatherine Collins
Katherine Collins
ACAshley Casovan
Ashley Casovan
UBUmang Bhatt
Umang Bhatt
As machine learning (ML) pipelines affect an increasing array of stakeholders, there is a growing need for documenting how input from stakeholders is recorded and incorporated. We propose FeedbackLogs, addenda to existing documentation of ML pipelines, to track the input of multiple stakeholders. Each log records important details about the feedback collection process, the feedback itself, and how the feedback is used to update the ML pipeline. In this paper, we introduce and formalise a process for collecting a FeedbackLog. We also provide concrete use cases where FeedbackLogs can be employed as evidence for algorithmic auditing and as a tool to record updates based on stakeholder feedback.