Emily Denton

Emily Denton

Auto-generated profile, based on publicly available information

Emily Denton

Google Research, USA

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 July 2021 in Big Data & Society
Verified
Journal Article
Open access
PDF file
EDEmily Denton
Emily Denton
AHAlex Hanna
Alex Hanna
RARazvan Amironesei
Razvan Amironesei
ASAndrew Smart
Andrew Smart
HNHilary Nicole
Hilary Nicole
In response to growing concerns of bias, discrimination, and unfairness perpetuated by algorithmic systems, the datasets used to train and evaluate machine learning models have come under increased scrutiny. Many of these examinations have focused on the contents of machine learning datasets, finding glaring underrepresentation of minoritized groups. In contrast, relatively little work has been done to examine the norms, values, and assumptions embedded in these datasets. In this work, we conceptualize machine learning datasets as a type of informational infrastructure, and motivate a genealogy as method in examining the histories and modes of constitution at play in their creation. We present a critical history of ImageNet as an exemplar, utilizing critical discourse analysis of major texts around ImageNet’s creation and impact. We find that assumptions around ImageNet and other large computer vision datasets more generally rely on three themes: the aggregation and accumulation of more data, the computational construction of meaning, and making certain types of data labor invisible. By tracing the discourses that surround this influential benchmark, we contribute to the ongoing development of the standards and norms around data development in machine learning and artificial intelligence research.

12 June 2023
Verified
Conference Paper
Open access
VGVinitha Gadiraju
Vinitha Gadiraju
SKShaun Kane
Shaun Kane
SDSunipa Dev
Sunipa Dev
ATAlex Taylor
Alex Taylor
DWDing Wang
Ding Wang
EDEmily Denton
Emily Denton
Large language models (LLMs) trained on real-world data can inadvertently reflect harmful societal biases, particularly toward historically marginalized communities. While previous work has primarily focused on harms related to age and race, emerging research has shown that biases toward disabled communities exist. This study extends prior work exploring the existence of harms by identifying categories of LLM-perpetuated harms toward the disability community. We conducted 19 focus groups, during which 56 participants with disabilities probed a dialog model about disability and discussed and annotated its responses. Participants rarely characterized model outputs as blatantly offensive or toxic. Instead, participants used nuanced language to detail how the dialog model mirrored subtle yet harmful stereotypes they encountered in their lives and dominant media, e.g., inspiration porn and able-bodied saviors. Participants often implicated training data as a cause for these stereotypes and recommended training the model on diverse identities from disability-positive resources. Our discussion further explores representative data strategies to mitigate harm related to different communities through annotation co-design with ML researchers and developers.

12 June 2023
Verified
Conference Paper
Open access
RQRida Qadri
Rida Qadri
RSRenee Shelby
Renee Shelby
CBCynthia L. Bennett
Cynthia L. Bennett
RDRemi Denton
Remi Denton
EDEmily Denton
Emily Denton
This paper presents a community-centered study of cultural limitations of text-to-image (T2I) models in the South Asian context. We theorize these failures using scholarship on dominant media regimes of representations and locate them within participants’ reporting of their existing social marginalizations. We thus show how generative AI can reproduce an outsiders gaze for viewing South Asian cultures, shaped by global and regional power inequities. By centering communities as experts and soliciting their perspectives on T2I limitations, our study adds rich nuance into existing evaluative frameworks and deepens our understanding of the culturally-specific ways AI technologies can fail in non-Western and Global South settings. We distill lessons for responsible development of T2I models, recommending concrete pathways forward that can allow for recognition of structural inequalities.

30 October 2023
Verified
Conference Paper
Open access
ECEric Corbett
Eric Corbett
RDRemi Denton
Remi Denton
SESheena Erete
Sheena Erete
EDEmily Denton
Emily Denton
The rapid growth of AI in contemporary life has outpaced the public participation necessary for society to determine how these technologies should be used. As scholars respond to this challenge by exploring new modes of public participation in AI, we help advance these efforts by introducing influential work from public planning scholarship, the Ladder of Citizen Participation, as an analytical lens to help compare and contrast power in this work. We used the ladder to analyze participatory approaches to AI development in recent scholarship, finding that most of this work informs or consults rather than partners with or delegates control to participants. We also found that papers frequently reflect a writing style that makes it difficult to ascertain the degree of power afforded. We discuss implications from our work for powerholders (developers, researchers, practitioners) offering participatory approaches to AI and for people (specific communities, stakeholders, general public) participating in those processes.

12 June 2023
Verified
Conference Paper
Open access
ECEric Corbett
Eric Corbett
RDRemi Denton
Remi Denton
EDEmily Denton
Emily Denton
Fairness, accountability, and transparency are the three conceptual foundations of the FAccT conference. Transparency, however, has yet to be scrutinized to the same degree as accountability and fairness. As a result, we don't know: What does this community mean when it talks about transparency? How are we doing transparency? And to what ends? What commitments does (or should) the T in FAccT signify? This paper interrogates the T in FAccT using perspectives from critical transparency literature. Subsequently, we argue that FAccT might be better off dropping the T from its title for two reasons: (1) transparency can often be counterproductive to FAccT's primary objectives and (2) it is misleading as FAccT is mainly preoccupied with explainability rather than actual transparency. If we want to keep the T, we need to reframe how we think about and do transparency by making transparency contingent, reclaiming it from explainability, and bringing people into transparency processes.

14 April 2023 in Proceedings of the ACM on Human-Computer Interaction
Verified
Journal Article
Open access
MSMorgan Klaus Scheuerman
Morgan Klaus Scheuerman
KWKaty Weathington
Katy Weathington
TMTarun Mugunthan
Tarun Mugunthan
RDRemi Denton
Remi Denton
CFCasey Fiesler
Casey Fiesler
EDEmily Denton
Emily Denton
Computer vision is a "data hungry" field. Researchers and practitioners who work on human-centric computer vision, like facial recognition, emphasize the necessity of vast amounts of data for more robust and accurate models. Humans are seen as a data resource which can be converted into datasets. The necessity of data has led to a proliferation of gathering data from easily available sources, including "public" data from the web. Yet the use of public data has significant ethical implications for the human subjects in datasets. We bridge academic conversations on the ethics of using publicly obtained data with concerns about privacy and agency associated with computer vision applications. Specifically, we examine how practices of dataset construction from public data-not only from websites, but also from public settings and public records-make it extremely difficult for human subjects to trace their images as they are collected, converted into datasets, distributed for use, and, in some cases, retracted. We discuss two interconnected barriers current data practices present to providing an ethics of traceability for human subjects: awareness and control. We conclude with key intervention points for enabling traceability for data subjects. We also offer suggestions for an improved ethics of traceability to enable both awareness and control for individual subjects in dataset curation practices.