Negar Rostamzadeh

Negar Rostamzadeh

Auto-generated profile, based on publicly available information

Negar Rostamzadeh

Google Research, Canada

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
8 August 2023
Verified
Conference Paper
Open access
RSRenee Shelby
Renee Shelby
SRShalaleh Rismani
Shalaleh Rismani
KHKathryn Henne
Kathryn Henne
AMAjung Moon
Ajung Moon
NRNegar Rostamzadeh
Negar Rostamzadeh
GVGurleen Virk
Gurleen Virk

19 April 2023
Verified
Conference Paper
Open access
SRShalaleh Rismani
Shalaleh Rismani
RSRenee Shelby
Renee Shelby
ASAndrew Smart
Andrew Smart
EJEdgar Jatho
Edgar Jatho
JKJoshua Kroll
Joshua Kroll
NRNegar Rostamzadeh
Negar Rostamzadeh
Inappropriate design and deployment of machine learning (ML) systems lead to negative downstream social and ethical impacts – described here as social and ethical risks – for users, society, and the environment. Despite the growing need to regulate ML systems, current processes for assessing and mitigating risks are disjointed and inconsistent. We interviewed 30 industry practitioners on their current social and ethical risk management practices and collected their first reactions on adapting safety engineering frameworks into their practice – namely, System Theoretic Process Analysis (STPA) and Failure Mode and Effects Analysis (FMEA). Our findings suggest STPA/FMEA can provide an appropriate structure for social and ethical risk assessment and mitigation processes. However, we also find nontrivial challenges in integrating such frameworks in the fast-paced culture of the ML industry. We call on the CHI community to strengthen existing frameworks and assess their efficacy, ensuring that ML systems are safer for all people.

11 May 2024
Verified
Conference Paper
Open access
RSRenee Shelby
Renee Shelby
SRShalaleh Rismani
Shalaleh Rismani
NRNegar Rostamzadeh
Negar Rostamzadeh
Understanding how communities experience algorithms is necessary to mitigate potential harmful impacts. This paper presents folk theories of text-to-image (T2I) models to enrich understanding of how artist communities experience creative machine learning systems. This research draws on data collected from a workshop with 15 artists from 10 countries who incorporate T2I models in their creative practice. Through reflexive thematic analysis of workshop data, we highlight artist folk theories of T2I use, harm, and harm reduction. Folk theories of use envision T2I models as an artistic medium, a mundane tool, and locate true creativity as rising above model affordances. Theories of harm articulate T2I models as harmed by engineering efforts to eliminate glitches and product policy efforts to limit functionality. Theories of harm-reduction orient towards protecting T2I models for creative practice through transparency and distributed governance. We examine how these theories relate, and conclude by discussing how folk theorization informs responsible AI efforts.

27 October 2024
Verified
Conference Paper
Open access
CBCynthia L Bennett
Cynthia L Bennett
RSRenee Shelby
Renee Shelby
NRNegar Rostamzadeh
Negar Rostamzadeh
SKShaun K Kane
Shaun K Kane
Generative AI (GAI) is proliferating, and among its many applications are to support creative work (e.g., generating text, images, music) and to enhance accessibility (e.g., captions of images and audio). As GAI evolves, creatives must consider how (or how not) to incorporate these tools into their practices. In this paper, we present interviews at the intersection of these applications. We learned from 10 creatives with disabilities who intentionally use and do not use GAI in and around their creative work. Their mediums ranged from audio engineering to leatherwork, and they collectively experienced a variety of disabilities, from sensory to motor to invisible disabilities. We share cross-cutting themes of their access hacks, how creative practice and access work become entangled, and their perspectives on how GAI should and should not fit into their workflows. In turn, we offer qualities of accessible creativity with responsible AI that can inform future research.

29 October 2024
Verified
Conference Paper
Open access
MAMercy Nyamewaa Asiedu
Mercy Nyamewaa Asiedu
ADAwa Dieng
Awa Dieng
IHIskandar Haykel
Iskandar Haykel
NRNegar Rostamzadeh
Negar Rostamzadeh
SPStephen Pfohl
Stephen Pfohl
KHKatherine Heller
Katherine Heller
With growing application of machine learning (ML) technologies in healthcare, there have been calls for developing techniques to understand and mitigate biases these systems may exhibit. Fairness considerations in the development of ML-based solutions for health have particular implications for Africa, which already faces inequitable power imbalances between the Global North and South. This paper seeks to explore fairness for global health, with Africa as a case study. We conduct a scoping review to propose axes of disparities for fairness consideration in the African context and delineate where they may come into play in different ML-enabled medical modalities. We then conduct qualitative research studies with 672 general population study participants and 30 experts in ML, health, and policy focused on Africa to obtain corroborative evidence on the proposed axes of disparities. Our analysis focuses on colonialism as the attribute of interest and examines the interplay between artificial intelligence (AI), health, and colonialism. Among the pre-identified attributes, we found that colonial history, country of origin, and national income level were specific axes of disparities that participants believed would cause an AI system to be biased. However, there was also divergence of opinion between experts and general population participants. Whereas experts generally expressed a shared view about the relevance of colonial history for the development and implementation of AI technologies in Africa, the majority of the general population participants surveyed did not think there was a direct link between AI and colonialism. Based on these findings, we provide practical recommendations for developing fairness-aware ML solutions for health in Africa.

1 January 2025 in NEJM AI
Verified
Journal Article
Closed access
JAJoseph E. Alderman
Joseph E. Alderman
JPJoanne Palmer
Joanne Palmer
ELElinor Laws
Elinor Laws
MMMelissa D. McCradden
Melissa D. McCradden
JOJohan Ordish
Johan Ordish
XLXiaoxuan Liu
Xiaoxuan Liu