14 April 2023 in Proceedings of the ACM on Human-Computer Interaction
Prior work has identified a resilient phenomenon that threatens the performance of human-AI decision-making teams: overreliance, when people agree with an AI, even when it is incorrect. Surprisingly, overreliance does not reduce when the AI produces explanations for its predictions, compared to only providing predictions. Some have argued that overreliance results from cognitive biases or uncalibrated trust, attributing overreliance to an inevitability of human cognition. By contrast, our paper argues that people strategically choose whether or not to engage with an AI explanation, demonstrating empirically that there are scenarios where AI explanations reduce overreliance. To achieve this, we formalize this strategic choice in a cost-benefit framework, where the costs and benefits of engaging with the task are weighed against the costs and benefits of relying on the AI. We manipulate the costs and benefits in a maze task, where participants collaborate with a simulated AI to find the exit of a maze. Through 5 studies (N = 731), we find that costs such as task difficulty (Study 1), explanation difficulty (Study 2, 3), and benefits such as monetary compensation (Study 4) affect overreliance. Finally, Study 5 adapts the Cognitive Effort Discounting paradigm to quantify the utility of different explanations, providing further support for our framework. Our results suggest that some of the null effects found in literature could be due in part to the explanation not sufficiently reducing the costs of verifying the AI's prediction.
7 November 2024 in Proceedings of the ACM on Human-Computer Interaction
Voice-first ambient interfaces (VFAIs), such as Alexa, can uniquely meet the health needs of older adults. However, inequitable technology may worsen health disparities and decrease independence, calling for participatory methods to increase the agency of older adults in the design processes of these technologies. We adapt and conduct a participatory design workshop to focus on ambient interfaces for home health with 13 diverse older adults in San Francisco's Tenderloin neighborhood. Using the prototypes they made as discussion catalyzers, participants shared different perspectives entailing stigmatized topics that can be difficult to discuss, such as drug use, sex, isolation, and dementia. They deliberated on the negative implications of VFAIs, such as a justified concern for surveillance, in conjunction with their positive implications, such as receiving always-available ''non-judgmental'' support. Similarly, the risk of leaking drug use data was considered alongside the benefits of sharing important medical information with clinicians. We synthesize our findings into design considerations, such as how we might address varying levels of trust in different stakeholders and reduce stigma that may hinder users from fully benefiting from VFAIs' capabilities.
17 April 2024 in Proceedings of the ACM on Human-Computer Interaction
Work-nonwork balance is an important aspect of workplace well-being with associations to improved physical and mental health, job performance, and quality of life. However, realizing work-nonwork balance goals is challenging due to competing demands and limited resources within organizational and interpersonal contexts. These challenges are compounded by technologies that blur the boundaries of work and nonwork in the always-on work cultures. At an individual level, such challenges can be subsided through the effective application of self-regulation techniques, such as implementation intentions and mental contrasting (IIMC). Further supporting these techniques through reflection on personal data, we implement the idea of data-driven IIMC into a self-tracking and behavior planning system and evaluate it in a three-week between-participant study with 43 information workers who used our system for improving work-nonwork balance. We find evidence that reflection on personal data improves awareness of behavior plan compliance and rescheduling, which are important in realizing work-nonwork balance goals. We also observe the value of micro-reflection, reflection on limited data of the very recent past, for IIMC. Our findings highlight opportunities for automation in data collection and sense-making and for further exploring the role of data-driven IIMC as boundary negotiating artifacts in support of work-nonwork balance goals.