Human-AI collaborative decision-making tools are being increasingly applied in critical domains such as healthcare. However, these tools are often seen as closed and intransparent for human decision-makers. An essential requirement for their success is the ability to provide explanations about themselves that are understandable and meaningful to the users. While explanations generally have positive connotations, studies showed that the assumption behind users interacting and engaging with these explanations could introduce trust calibration errors such as facilitating irrational or less thoughtful agreement or disagreement with the AI recommendation. In this paper, we explore how to help trust calibration through explanation interaction design. Our research method included two main phases. We first conducted a think-aloud study with 16 participants aiming to reveal main trust calibration errors concerning explainability in AI-Human collaborative decision-making tools. Then, we conducted two co-design sessions with eight participants to identify design principles and techniques for explanations that help trust calibration. As a conclusion of our research, we provide five design principles: Design for engagement, challenging habitual actions, attention guidance, friction and support training and learning. Our findings are meant to pave the way towards a more integrated framework for designing explanations with trust calibration as a primary goal.
Autonomous vehicles (AV) offer promising benefits to society in terms of safety, environmental impact and increased mobility. However, acute challenges persist with any novel technology, inlcuding the perceived risks and trust underlying public acceptance. While research examining the current state of AV public perceptions and future challenges related to both societal and individual barriers to trust and risk perceptions is emerging, it is highly fragmented across disciplines. To address this research gap, by using the Web of Science database, our study undertakes a bibliometric and performance analysis to identify the conceptual and intellectual structures of trust and risk narratives within the AV research field by investigating engineering, social sciences, marketing, and business and infrastructure domains to offer an interdisciplinary approach. Our analysis provides an overview of the key research area across the search categories of ‘trust’ and ‘risk’. Our results show three main clusters with regard to trust and risk, namely, behavioural aspects of AV interaction; uptake and acceptance; and modelling human–automation interaction. The synthesis of the literature allows a better understanding of the public perception of AV and its historical conception and development. It further offers a robust model of public perception in AV, outlining the key themes found in the literature and, in turn, offers critical directions for future research.
31 January 2025 in Journal of Technology in Behavioral Science
Artificial intelligence (AI) is revolutionizing society, yet its widespread adoption is accompanied by significant ethical and societal concerns. Through a large survey, this study explores the complex interplay between self-efficacy, AI competency, cultural factors, and attitudes towards AI among UK and Arab participants. We investigate how these factors influence individual’s attitudes toward AI and its impact on well-being. Our findings reveal that self-efficacy plays a crucial role in shaping attitudes towards AI, with higher levels of self-efficacy associated with more positive attitudes and enhanced well-being. Moreover, our results show that AI competency serves as a mediator, with increased competence fostering greater confidence and positivity towards AI. Our results also show gender disparities in AI attitudes within the UK sample, with males exhibiting higher positive attitudes and lower negative attitudes compared to females. Cultural differences were evident, with the Arab sample showing higher AI competency, positive attitudes, and overall well-being compared to the UK sample. Our results emphasize the need for culturally sensitive design and implementation of AI to ensure responsible development and implementation of AI for diverse populations.
26 January 2024 in Journal of Responsible Technology
The increased adoption of collaborative human-artificial intelligence decision-making tools triggered a need to explain recommendations for safe and effective collaboration. We explore how users interact with explanations and why trust-calibration errors occur, taking clinical decision-support systems as a case study.