7 April 2020 in npj Digital Medicine
Artificial intelligence (AI) and Machine learning (ML) systems in medicine are poised to significantly improve health care, for example, by offering earlier diagnoses of diseases or recommending optimally individualized treatment plans. However, the emergence of AI/ML in medicine also creates challenges, which regulators must pay attention to. Which medical AI/ML-based products should be reviewed by regulators? What evidence should be required to permit marketing for AI/ML-based software as a medical device (SaMD)? How can we ensure the safety and effectiveness of AI/ML-based SaMD that may change over time as they are applied to new data? The U.S. Food and Drug Administration (FDA), for example, has recently proposed a discussion paper to address some of these issues. But it misses an important point: we argue that regulators like the FDA need to widen their scope from evaluating medical AI/ML-based products to assessing systems. This shift in perspective—from a product view to a system view—is central to maximizing the safety and efficacy of AI/ML in health care, but it also poses significant challenges for agencies like the FDA who are used to regulating products, not systems. We offer several suggestions for regulators to make this challenging but important transition.
17 February 2022 in PLOS Digital Health
HCHelle Collatz Christensen
Helle Collatz Christensen
OIOn Behalf Of The Z-Inspection Initiative
On Behalf Of The Z-Inspection Initiative
+9
Explainability for artificial intelligence (AI) in medicine is a hotly debated topic. Our paper presents a review of the key arguments in favor and against explainability for AI-powered Clinical Decision Support System (CDSS) applied to a concrete use case, namely an AI-powered CDSS currently used in the emergency call setting to identify patients with life-threatening cardiac arrest. More specifically, we performed a normative analysis using socio-technical scenarios to provide a nuanced account of the role of explainability for CDSSs for the concrete use case, allowing for abstractions to a more general level. Our analysis focused on three layers: technical considerations, human factors, and the designated system role in decision-making. Our findings suggest that whether explainability can provide added value to CDSS depends on several key questions: technical feasibility, the level of validation in case of explainable algorithms, the characteristics of the context in which the system is implemented, the designated role in the decision-making process, and the key user group(s). Thus, each CDSS will require an individualized assessment of explainability needs and we provide an example of how such an assessment could look like in practice.
10 July 2020 in npj Digital Medicine
Reimbursement is a key challenge for many new digital health solutions, whose importance and value have been highlighted and expanded by the current COVID-19 pandemic. Germany’s new Digital Healthcare Act (Digitale–Versorgung–Gesetz or DVG) entitles all individuals covered by statutory health insurance to reimbursement for certain digital health applications (i.e., insurers will pay for their use). Since Germany, like the United States (US), is a multi-payer health care system, the new Act provides a particularly interesting case study for US policymakers. We first provide an overview of the new German DVG and outline the landscape for reimbursement of digital health solutions in the US, including recent changes to policies governing telehealth during the COVID-19 pandemic. We then discuss challenges and unanswered questions raised by the DVG, ranging from the limited scope of the Act to privacy issues. Lastly, we highlight early lessons and opportunities for other countries.
3 March 2021 in Advances in Health Sciences Education