Although numerous ethical principles and guidelines have been proposed to guide the development of artificial intelligence (AI) systems, it has proven difficult to translate these principles into actionable practices beyond mere adherence to ethical ideas. This is particularly challenging in the context of AI systems for healthcare, which requires balancing the potential benefits of the solution against the risks to patients and the wider community, including minorities and underserved populations. To address this challenge, we propose a shift from one-size-fits-all ethical principles to contextualized case-based ethical frameworks. This study uses an AI-enabled mHealth application as a case study. Our framework is built on existing ethical guidelines and principles, including the AI4People framework, the EU High-Level Expert Group on trustworthy AI, and wider human rights considerations. Additionally, we incorporate relational perspectives to address human value concerns and moral tensions between individual rights and public health. Our approach is based on ”ethics by design,” where ethical principles are integrated throughout the entire AI development pipeline, ensuring that ethical considerations are not an afterthought but implemented from the beginning. For our case study, we identified 7 ethical principles: fairness, agility, precision, safeguarding humanity, respect for others, trust and accountability, and robustness and reproducibility. We believe that the best way to mitigate and address ethical consequences is by implementing ethical principles in the software development processes that developers commonly use. Finally, we provide examples of how our case-based framework can be applied in practice, using examples of AI-driven mobile applications in healthcare.
The growing awareness of the influence of “what we eat” on lifestyle and health has led to an increase in the use of embedded food analysis and recognition systems. These solutions aim to effectively monitor daily food consumption, and therefore provide dietary recommendations to enable and support lifestyle changes. Mobile applications, due to their high accessibility, are ideal for real-life food recognition, volume estimation and calorific estimation. In this study, we conducted a systematic review based on articles that proposed mobile computer vision-based solutions for food recognition, volume estimation and calorific estimation. In addition, we assessed the extent to which these applications provide explanations to aid the users to understand the related classification and/or predictions. Our results show that 90.9% of applications do not distinguish between food and non-food. Similarly, only one study that proposed a mobile computer vision-based application for dietary intake attempted to provide explanations of features that contribute towards classification. Mobile computer vision-based applications are attracting a lot of interest in healthcare. They have the potential to assist in the management of chronic illnesses such as diabetes, ensuring that patients eat healthily and reducing complications associated with unhealthy food. However, to improve trust, mobile computer vision-based applications in healthcare should provide explanations of how they derive their classifications or volume and calorific estimations.
As we look towards the future of healthcare, integrating Care Robots (CRs) into health systems is a practical approach to address challenges such as an ageing population and caregiver shortages. However, ethical discussions about the impact of CRs on patients, caregivers, healthcare systems, and society are crucial. This normative research seeks to define an integrative and comprehensive ethical framework for CRs, encompassing a wide range of AI-related issues in healthcare. To build the framework, we combine principles of beneficence, non-maleficence, autonomy, justice, and explainability by integrating the AI4People framework for a Good AI Society and the traditional bioethics perspective. Using the integrated framework, we conduct an ethical assessment of CRs. Next, we identify three key ethical trade-offs and propose remediation strategies for the technology. Finally, we offer design recommendations for responsible development and usage of CRs. In conclusion, our research highlights the critical need for sector-specific ethical discussions in healthcare to fully grasp the potential implications of integrating AI technology.
9 December 2024 in International Journal of Ethics and Systems
Purpose: Social robotics is a rapidly growing application of artificial intelligence (AI) in society, encompassing an expanding range of applications. This paper aims to contribute to the ongoing integration of psychology into social robotics ethics by reviewing current theories and empirical findings related to human–robot interaction (HRI) and addressing critical points of contention within the ethics discourse. Design/methodology/approach: The authors will explore the factors influencing the acceptance of social robots, explore the development of relationships between humans and robots and delve into three prominent controversies: deception, dehumanisation and violence. Findings: The authors first propose design factors allowing for a positive interaction with the robot, and further discuss precise dimensions to evaluate when designing a social robot to ensure ethical design technology, building on the four ethical principles for trustworthy AI. The final section of this paper will outline and offer explicit recommendations for future research endeavours. Originality/value: This paper provides originality and value to the field of social robotics ethics by integrating psychology into the ethical discourse and offering a comprehensive understanding of HRI. It introduces three ethical dimensions and provides recommendations for implementing them, contributing to the development of ethical design in social robots and trustworthy AI.
Artificial Intelligence (AI) algorithms are transforming healthcare by advancing the capabilities of medical devices. These algorithms can now analyze X-ray images to help detect and interpret medical conditions, particularly in radiology and pathology. The growing use of AI in medicine highlights the importance of strict regulations to prioritize patient safety during the development and deployment of AI in medical devices. Despite extensive research, there are limited empirical studies on stakeholders’ perspectives regarding the challenges of implementing AI regulatory frameworks alongside existing legally binding regulations specific to medical devices. This study uses semi-structured interviews to explore the perspectives of key stakeholders, such as regulatory bodies and medical device manufacturers, to understand the potential implications of integrating the European Union Artificial Intelligence Act with the Medical Device Regulation to certify AI-embedded medical devices. Through inductive-thematic analysis and adopting activity theory to further synthesize the interviews, the findings reveal stakeholders’ challenges, including uncertainty about implementing different regulations, resource limitations, and the potential impact of complex regulations on healthcare quality. Additionally, the results indicate that key stakeholders did not explicitly identify the absence of a comprehensive ethical framework for AI-enabled medical devices in both regulations as a major challenge. This underscores the need to develop a harmonized ethical framework for certifying AI used in healthcare.
The growing perceived risk of AI to the foundational principles of societies and human rights has shaped a political debate on how to regulate the development and use of this technology. This debate has been taken seriously by key institutions in the European Union (EU), resulting in the much debated “AI Act”. The chosen course adopted by the EU is the product of two overarching questions: (1) what are the origins of the norms, principles and rights that influence the EU AI Act and determine the purpose of the legislation and (2) how does the EU AI Act fits into the larger landscape of different normative, but not legislated, frameworks articulated by international parties? This chapter explores these topics in an analysis of the EU AI Act, with a particular focus on its risk classification of different AI solutions and proposed mitigation and prevention measures.