Jessica Hammer

Jessica Hammer

Auto-generated profile, based on publicly available information

Jessica Hammer

Human-Computer Interaction Institute, Carnegie Mellon University, Pittsburgh, Pennsylvania, USA

Research Focus & Metrics

Academic Career Length

12Years (2015-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
28 September 2023 in Proceedings of the ACM on Human-Computer Interaction
Verified
Journal Article
Open access
JSJaemarie Solyst
Jaemarie Solyst
EYEllia Yang
Ellia Yang
SXShixian Xie
Shixian Xie
AOAmy Ogan
Amy Ogan
JHJessica Hammer
Jessica Hammer
MEMotahhare Eslami
Motahhare Eslami
Youth regularly use technology driven by artificial intelligence (AI). However, it is increasingly well-known that AI can cause harm on small and large scales, especially for those underrepresented in tech fields. Recently, users have played active roles in surfacing and mitigating harm from algorithmic bias. Despite being frequent users of AI, youth have been under-explored as potential contributors and stakeholders to the future of AI. We consider three notions that may be at the root of youth facing barriers to playing an active role in responsible AI, which are youth (1) cannot understand the technical aspects of AI, (2) cannot understand the ethical issues around AI, and (3) need protection from serious topics related to bias and injustice. In this study, we worked with youth (N = 30) in first through twelfth grade and parents (N = 6) to explore how youth can be part of identifying algorithmic bias and designing future systems to address problematic technology behavior. We found that youth are capable of identifying and articulating algorithmic bias, often in great detail. Participants suggested different ways users could give feedback for AI that reflects their values of diversity and inclusion. Youth who may have less experience with computing or exposure to societal structures can be supported by peers or adults with more of this knowledge, leading to critical conversations about fairer AI. This work illustrates youths' insights, suggesting that they should be integrated in building a future of responsible AI.

19 April 2023
Verified
Conference Paper
Open access
JSJaemarie Solyst
Jaemarie Solyst
SXShixian Xie
Shixian Xie
EYEllia Yang
Ellia Yang
ASAngela E.B. Stewart
Angela E.B. Stewart
MEMotahhare Eslami
Motahhare Eslami
AOAmy Ogan
Amy Ogan
Artificial intelligence (AI) literacy is especially important for those who may not be well-represented in technology design. We worked with ten Black girls in fifth and sixth grade from a predominantly Black school to understand their perceptions around fair and accountable AI and how they can have an empowered role in the creation of AI. Thematic analysis of discussions and activity artifacts from a summer camp and after-school session revealed a number of findings around how Black girls: perceive AI, primarily consider fairness as niceness and equality (but may need support considering other notions, such as equity), consider accountability, and envision a just future. We also discuss how the learners can be positioned as decision-making designers in creating AI technology, as well as how AI literacy learning experiences can be empowering.

23 June 2025
Verified
Conference Paper
Open access
JSJaemarie Solyst
Jaemarie Solyst
CPCindy Peng
Cindy Peng
WDWesley Hanwen Deng
Wesley Hanwen Deng
PPPraneetha Pratapa
Praneetha Pratapa
AOAmy Ogan
Amy Ogan
MEMotahhare Eslami
Motahhare Eslami

1 December 2018 in International Journal of Artificial Intelligence in Education
Verified
Journal Article
Open access
PDF file
JUJudith Uchidiuno
Judith Uchidiuno
KKKen Koedinger
Ken Koedinger
JHJessica Hammer
Jessica Hammer
EYEvelyn Yarzebinski
Evelyn Yarzebinski
AOAmy Ogan
Amy Ogan
English Language Learners (ELLs) are a substantial portion of the students who enroll in MOOCs. In order to fulfill the promise of MOOCs – i.e., making higher education accessible to everyone with an internet connection – appropriate interventions should be offered to students who struggle with the language of course content. Through the analysis of clickstream log data gathered from two MOOC courses deployed on Coursera, Introduction to Psychology and Statistical Thermodynamics, we show that compared to native English speakers, ELL students have distinct behavioral patterns in how they engage with MOOC content including increased interaction with content that contains text, increased seeking away from content without visual support, and decreased video play rates. These patterns are expressed differently in response to different types of course content and domains. Our findings not only suggest more fine-grained methods for automatically identifying students who need language interventions, but also have further implications for the design of language support interventions and MOOC videos.

28 September 2023 in Proceedings of the ACM on Human-Computer Interaction
Verified
Journal Article
Open access
KMKatelyn Morrison
Katelyn Morrison
MJMayank Jain
Mayank Jain
JHJessica Hammer
Jessica Hammer
APAdam Perer
Adam Perer
Recent developments in explainable AI (XAI) aim to improve the transparency of black-box models. However, empirically evaluating the interpretability of these XAI techniques is still an open challenge. The most common evaluation method is algorithmic performance, but such an approach may not accurately represent how interpretable these techniques are to people. A less common but growing evaluation strategy is to leverage crowd-workers to provide feedback on multiple XAI techniques to compare them. However, these tasks often feel like work and may limit participation. We propose a novel, playful, human-centered method for evaluating XAI techniques: a Game With a Purpose (GWAP), Eye into AI, that allows researchers to collect human evaluations of XAI at scale. We provide an empirical study demonstrating how our GWAP supports evaluating and comparing the agreement between three popular XAI techniques (LIME, Grad-CAM, and Feature Visualization) and humans, as well as evaluating and comparing the interpretability of those three XAI techniques applied to a deep learning model for image classification. The data collected from Eye into AI offers convincing evidence that GWAPs can be used to evaluate and compare XAI techniques. Eye into AI is available to the public: https://dig.cmu.edu/eyeintoai/.

19 May 2022 in JMIR Serious Games
Verified
Journal Article
Open access
RWRina R Wehbe
Rina R Wehbe
CWColin Whaley
Colin Whaley
YEYasaman Eskandari
Yasaman Eskandari
ASAlly Suarez
Ally Suarez
LNLennart Nacke
Lennart Nacke
ELEdward Lank
Edward Lank
Background: Although in many contexts unsuccessful games targeting learning, social interaction, or behavioral change have few downsides, when covering a sensitive domain such as mental health (MH), care must be taken to avoid harm and stigmatization of people who live with MH conditions. As a result, evaluation of the game to identify benefits and risks is crucial in understanding the game’s success; however, assessment of these apps is often compared with the nongame control condition, resulting in findings specifically regarding entertainment value and user preferences. Research exploring the design process, integrating field experts, and guidelines for designing a successful serious game for sensitive topics is limited. Objective: The aim of this study is to understand which elements of game design can guide a designer when designing a game for sensitive topics. Methods: To carefully probe the design space of serious games for MH, we present Above Water (AbW), a game targeting the reduction of stigma surrounding MH, now in its second iteration. The game, AbW, serves as a consistent research probe to solicit expert feedback. Experts were recruited from a range of topic domains related to MH and wellness, game design, and user experience. Results: By using this deployment as a research probe, this study demonstrates how to synthesize gained insights from multiple expert perspectives and create actionable guidelines for successful design of serious games targeting sensitive topics. Conclusions: Our work contributes to a better understanding of how to design specialized games to address sensitive topics. We present a set of guidelines for designing games for sensitive subjects, and for each guideline, we present an example of how to apply the finding to the sample game (AbW). Furthermore, we demonstrate the generalizability to other sensitive topics by providing an additional example of a game that could be designed with the presented guidelines.