Many guidelines for responsible AI have been suggested to help AI practitioners in the development of ethical and responsible AI systems. However, these guidelines are often neither grounded in regulation nor usable by different roles, from developers to decision makers. To bridge this gap, we developed a four-step method to generate a list of responsible AI guidelines; these steps are: (1) manual coding of 17 papers on responsible AI; (2) compiling an initial catalog of responsible AI guidelines; (3) refining the catalog through interviews and expert panels; and (4) finalizing the catalog. To evaluate the resulting 22 guidelines, we incorporated them into an interactive tool and assessed them in a user study with 14 AI researchers, engineers, designers, and managers from a large technology company. Through interviews with these practitioners, we found that the guidelines were grounded in current regulations and usable across roles, encouraging self-reflection on ethical considerations at early stages of development. This significantly contributes to the concept of 'Responsible AI by Design'- a design-first approach that embeds responsible AI values throughout the development lifecycle and across various business roles.
With the upcoming AI regulations (e.g., EU AI Act) and rapid advancements in generative AI, new challenges emerge in the area of Human-Centered Responsible Artificial Intelligence (HCR-AI). As AI becomes more ubiquitous, questions around decision-making authority, human oversight, accountability, sustainability, and the ethical and legal responsibilities of AI and their creators become paramount. Addressing these questions requires a collaborative approach. By involving stakeholders from various disciplines in the 2nd edition of the HCR-AI Special Interest Group (SIG) at CHI 2024, we aim to discuss the implications of regulations in HCI research, develop new theories, evaluation frameworks, and methods to navigate the complex nature of AI ethics, steering AI development in a direction that is beneficial and sustainable for all of humanity.
24 September 2024 in Proceedings of the ACM on Human-Computer Interaction
Integrating Artificial Intelligence (AI) into mobile and wearables offers numerous benefits at individual, societal, and environmental levels. Yet, it also spotlights concerns over emerging risks. Traditional assessments of risks and benefits have been sporadic, and often require costly expert analysis. We developed a semi-automatic method that leverages Large Language Models (LLMs) to identify AI uses in mobile and wearables, classify their risks based on the EU AI Act, and determine their benefits that align with globally recognized long-term sustainable development goals; a manual validation of our method by two experts in mobile and wearable technologies, a legal and compliance expert, and a cohort of nine individuals with legal backgrounds who were recruited from Prolific, confirmed its accuracy to be over 85%. We uncovered that specific applications of mobile computing hold significant potential in improving well-being, safety, and social equality. However, these promising uses are linked to risks involving sensitive data, vulnerable groups, and automated decision-making. To avoid rejecting these risky yet impactful mobile and wearable uses, we propose a risk assessment checklist for the Mobile HCI community.
Impact assessment reports for high-risk AI systems will be legally required but challenging to complete, especially for smaller companies. That is because the current process is complex, costly, and relies on guidebooks with limited assistance. We propose AI Design , a semi-automatic framework for populating these reports. It consists of two components: (A) StakeLinker , an interactive tool combining various stakeholders’ perspectives; and (B) FillGen , an LLM-based tool processing stakeholders’ perspectives and producing the report to be reviewed by regulatory experts. We conducted two user studies: the first with 13 AI practitioners who confirmed StakeLinker’s effectiveness in gathering comprehensive input for impact assessment; the second with 8 additional practitioners who successfully evaluated a report for a crime analysis system pre-populated by FillGen . For generalizability purposes, we provide reports for two other AI systems.
13 October 2020 in IEEE Transactions on Visualization and Computer Graphics
A biological understanding is key for managing medical conditions, yet psychological and social aspects matter too. The main problem is that these two aspects are hard to quantify and inherently difficult to communicate. To quantify psychological aspects, this work mined around half a million Reddit posts in the sub-communities specialised in 14 medical conditions, and it did so with a new deep-learning framework. In so doing, it was able to associate mentions of medical conditions with those of emotions. To then quantify social aspects, this work designed a probabilistic approach that mines open prescription data from the National Health Service in England to compute the prevalence of drug prescriptions, and to relate such a prevalence to census data. To finally visually communicate each medical condition's biological, psychological, and social aspects through storytelling, we designed a narrative-style layered Martini Glass visualization. In a user study involving 52 participants, after interacting with our visualization, a considerable number of them changed their mind on previously held opinions: 10% gave more importance to the psychological aspects of medical conditions, and 27% were more favourable to the use of social media data in healthcare, suggesting the importance of persuasive elements in interactive visualizations.
Change acts as an inherent characteristic of the landscape, and expresses dynamic interactions between its tangible and intangible elements. While the documentation and analysis of spatiotemporal patterns have been broadly discussed, major challenges concern the design of task-oriented, user-friendly landscape visualizations. Geographic information system (GIS) techniques and approaches from visual analytics may bring solutions to those questions. This paper considers the milestone documents for the representation of cultural heritage, and proposes a workflow for assessing the feasibility of the space–time cube concept in landscape representation. The usability of the visualization was examined during the interview with domain experts and potential interdisciplinary users. The evaluation session covered benchmark tasks, feedback, and eye-tracking. The performance of the space–time cube was compared with another spatiotemporal visualization technique and measured in terms of correctness, response time, and satisfaction. The Royal Castle in Warsaw, which was registered in 1980 as a part of Warsaw’s World Heritage Site of United Nations Educational, Scientific and Cultural Organization (UNESCO), served as the case study. The user tests show that the designed space–time cube excels for the completion rate; however, more time is required to provide answers to question tasks focusing on comparisons. Together, the case study and feedback from domain experts and participants demonstrate the benefit of the space–time cube concept in designing landscape visualizations.