Yves Saint James Aquino

Yves Saint James Aquino

Auto-generated profile, based on publicly available information

Yves Saint James Aquino

University of Wollongong

Research Focus & Metrics

Academic Career Length

11Years (2016-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
31 October 2022 in International Journal of Medical Informatics
Verified
Journal Article
Open access
YAYves Saint James Aquino
Yves Saint James Aquino
WRWendy A. Rogers
Wendy A. Rogers
ABAnnette Braunack-Mayer
Annette Braunack-Mayer
HFHelen Frazer
Helen Frazer
KWKhin Than Win
Khin Than Win
SCStacy M. Carter
Stacy M. Carter
Alongside the promise of improving clinical work, advances in healthcare artificial intelligence (AI) raise concerns about the risk of deskilling clinicians. This purpose of this study is to examine the issue of deskilling from the perspective of diverse group of professional stakeholders with knowledge and/or experiences in the development, deployment and regulation of healthcare AI. We conducted qualitative, semi-structured interviews with 72 professionals with AI expertise and/or professional or clinical expertise who were involved in development, deployment and/or regulation of healthcare AI. Data analysis using combined constructivist grounded theory and framework approach was performed concurrently with data collection. Our analysis showed participants had diverse views on three contentious issues regarding AI and deskilling. The first involved competing views about the proper extent of AI-enabled automation in healthcare work, and which clinical tasks should or should not be automated. We identified a cluster of characteristics of tasks that were considered more suitable for automation. The second involved expectations about the impact of AI on clinical skills, and whether AI-enabled automation would lead to worse or better quality of healthcare. The third tension implicitly contrasted two models of healthcare work: a human-centric model and a technology-centric model. These models assumed different values and priorities for healthcare work and its relationship to AI-enabled automation. Our study shows that a diverse group of professional stakeholders involved in healthcare AI development, acquisition, deployment and regulation are attentive to the potential impact of healthcare AI on clinical skills, but have different views about the nature and valence (positive or negative) of this impact. Detailed engagement with different types of professional stakeholders allowed us to identify relevant concepts and values that could guide decisions about AI algorithm development and deployment.

23 February 2023 in Journal of Medical Ethics
Verified
Journal Article
Open access
PDF file
YAYves Saint James Aquino
Yves Saint James Aquino
SCStacy M. Carter
Stacy M. Carter
NHNehmat Houssami
Nehmat Houssami
ABAnnette Braunack-Mayer
Annette Braunack-Mayer
KWKhin Than Win
Khin Than Win
WRWendy A Rogers
Wendy A Rogers
Background There is a growing concern about artificial intelligence (AI) applications in healthcare that can disadvantage already under-represented and marginalised groups (eg, based on gender or race). Objectives Our objectives are to canvas the range of strategies stakeholders endorse in attempting to mitigate algorithmic bias, and to consider the ethical question of responsibility for algorithmic bias. Methodology The study involves in-depth, semistructured interviews with healthcare workers, screening programme managers, consumer health representatives, regulators, data scientists and developers. Results Findings reveal considerable divergent views on three key issues. First, views on whether bias is a problem in healthcare AI varied, with most participants agreeing bias is a problem (which we call the bias-critical view), a small number believing the opposite (the bias-denial view), and some arguing that the benefits of AI outweigh any harms or wrongs arising from the bias problem (the bias-apologist view). Second, there was a disagreement on the strategies to mitigate bias, and who is responsible for such strategies. Finally, there were divergent views on whether to include or exclude sociocultural identifiers (eg, race, ethnicity or gender-diverse identities) in the development of AI as a way to mitigate bias. Conclusion/significance Based on the views of participants, we set out responses that stakeholders might pursue, including greater interdisciplinary collaboration, tailored stakeholder engagement activities, empirical studies to understand algorithmic bias and strategies to modify dominant approaches in AI development such as the use of participatory methods, and increased diversity and inclusion in research teams and research participant recruitment and selection.

19 February 2025 in Journal of Medical Internet Research
Verified
Journal Article
Open access
GSGeorg Starke
Georg Starke
FGFelix Gille
Felix Gille
ATAlberto Termine
Alberto Termine
YAYves Saint James Aquino
Yves Saint James Aquino
RCRicardo Chavarriaga
Ricardo Chavarriaga
MIMarcello Ienca
Marcello Ienca
Background: The integration of artificial intelligence (AI) into health care has become a crucial element in the digital transformation of health systems worldwide. Despite the potential benefits across diverse medical domains, a significant barrier to the successful adoption of AI systems in health care applications remains the prevailing low user trust in these technologies. Crucially, this challenge is exacerbated by the lack of consensus among experts from different disciplines on the definition of trust in AI within the health care sector. Objective: We aimed to provide the first consensus-based analysis of trust in AI in health care based on an interdisciplinary panel of experts from different domains. Our findings can be used to address the problem of defining trust in AI in health care applications, fostering the discussion of concrete real-world health care scenarios in which humans interact with AI systems explicitly. Methods: We used a combination of framework analysis and a 3-step consensus process involving 18 international experts from the fields of computer science, medicine, philosophy of technology, ethics, and social sciences. Our process consisted of a synchronous phase during an expert workshop where we discussed the notion of trust in AI in health care applications, defined an initial framework of important elements of trust to guide our analysis, and agreed on 5 case studies. This was followed by a 2-step iterative, asynchronous process in which the authors further developed, discussed, and refined notions of trust with respect to these specific cases. Results: Our consensus process identified key contextual factors of trust, namely, an AI system’s environment, the actors involved, and framing factors, and analyzed causes and effects of trust in AI in health care. Our findings revealed that certain factors were applicable across all discussed cases yet also pointed to the need for a fine-grained, multidisciplinary analysis bridging human-centered and technology-centered approaches. While regulatory boundaries and technological design features are critical to successful AI implementation in health care, ultimately, communication and positive lived experiences with AI systems will be at the forefront of user trust. Our expert consensus allowed us to formulate concrete recommendations for future research on trust in AI in health care applications. Conclusions: This paper advocates for a more refined and nuanced conceptual understanding of trust in the context of AI in health care. By synthesizing insights into commonalities and differences among specific case studies, this paper establishes a foundational basis for future debates and discussions on trusting AI in health care.

1 July 2023 in Australian Journal of General Practice
Verified
Journal Article
Closed access
YAYves Saint James Aquino
Yves Saint James Aquino
This paper provides a brief overview of ‘algorithmic bias’, which refers to the tendency of some AI systems to perform poorly for disadvantaged or marginalised groups.

26 October 2021 in Health Care Analysis
Verified
Journal Article
Open access
PDF file
YAYves Saint James Aquino
Yves Saint James Aquino
WRWendy A. Rogers
Wendy A. Rogers
JSJackie Leach Scully
Jackie Leach Scully
FMFarah Magrabi
Farah Magrabi
SCStacy M. Carter
Stacy M. Carter
This article provides a critical comparative analysis of the substantive and procedural values and ethical concepts articulated in guidelines for allocating scarce resources in the COVID-19 pandemic. We identified 21 local and national guidelines written in English, Spanish, German and French; applicable to specific and identifiable jurisdictions; and providing guidance to clinicians for decision making when allocating critical care resources during the COVID-19 pandemic. US guidelines were not included, as these had recently been reviewed elsewhere. Information was extracted from each guideline on: 1) the development process; 2) the presence and nature of ethical, medical and social criteria for allocating critical care resources; and 3) the membership of and decision-making procedure of any triage committees. Results of our analysis show the majority appealed primarily to consequentialist reasoning in making allocation decisions, tempered by a largely pluralistic approach to other substantive and procedural values and ethical concepts. Medical and social criteria included medical need, co-morbidities, prognosis, age, disability and other factors, with a focus on seemingly objective medical criteria. There was little or no guidance on how to reconcile competing criteria, and little attention to internal contradictions within individual guidelines. Our analysis reveals the challenges in developing sound ethical guidance for allocating scarce medical resources, highlighting problems in operationalising ethical concepts and principles, divergence between guidelines, unresolved contradictions within the same guideline, and use of naïve objectivism in employing widely used medical criteria for allocating ICU resources.

17 March 2016 in Medicine, Health Care and Philosophy
Verified
Journal Article
Closed access
PDF file
YAYves Saint James Aquino
Yves Saint James Aquino
NSNorbert Steinkamp
Norbert Steinkamp