Ignacio Sanchez

Dr. Ignacio Sanchez


Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
12 June 2023
Verified
Conference Paper
Open access
CPCecilia Panigutti
Cecilia Panigutti
RHRonan Hamon
Ronan Hamon
IHIsabelle Hupont
Isabelle Hupont
David Fernández-LlorcaDavid Fernández-Llorca
David Fernández-Llorca
DYDelia Fano Yela
Delia Fano Yela
EGEmilia Gómez
Emilia Gómez
The proposed EU regulation for Artificial Intelligence (AI), the AI Act, has sparked some debate about the role of explainable AI (XAI) in high-risk AI systems. Some argue that black-box AI models will have to be replaced with transparent ones, others argue that using XAI techniques might help in achieving compliance. This work aims to bring some clarity as regards XAI in the context of the AI Act and focuses in particular on the AI Act requirements for transparency and human oversight. After outlining key points of the debate and describing the current limitations of XAI techniques, this paper carries out an interdisciplinary analysis of how the AI Act addresses the issue of opaque AI systems. In particular, we argue that neither does the AI Act mandate a requirement for XAI, which is the subject of intense scientific research and is not without technical limitations, nor does it ban the use of black-box AI systems. Instead, the AI Act aims to achieve its stated policy objectives with the focus on transparency (including documentation) and human oversight. Finally, in order to concretely illustrate our findings and conclusions, a use case on AI-based proctoring is presented.

30 July 2025 in European Transport Research Review
Verified
Journal Article
Open access
PDF file
David Fernández-LlorcaDavid Fernández-Llorca
David Fernández-Llorca
RHRonan Hamon
Ronan Hamon
HJHenrik Junklewitz
Henrik Junklewitz
KGKathrin Grosse
Kathrin Grosse
LKLars Kunze
Lars Kunze
AKAkos Kriston
Akos Kriston
This study aims to comprehensively explore the complexities of integrating Artificial Intelligence (AI) into Autonomous Vehicles (AVs), examining the challenges introduced by AI components and their impact on testing procedures. The research focuses on essential requirements for trustworthy AI, including cybersecurity, transparency, robustness, and fairness. We first analyse the role of AI at the most relevant operational layers of AVs, and discuss the implications of the EU’s AI Act on AVs, highlighting the importance of the concept of a safety component. Using an expert opinion-based methodology, involving an interdisciplinary workshop with 21 academics and a subsequent in-depth analysis by a smaller group of experts, this study provides a state-of-the-art overview of the current landscape of vehicle regulation and standards, including ex-ante, post-hoc, and accident investigation processes, highlighting the need for new testing methodologies for both Advanced Driver Assistance Systems (ADAS) and Automated Driving Systems (ADS). The study also provides a detailed analysis of cybersecurity audits, explainability in AI decision-making processes and protocols for assessing the robustness and ethical behaviour of predictive systems in AVs. The analysis highlights significant challenges and suggests future directions for research and development of AI in AV technology, emphasising the need for multidisciplinary expertise. The study’s conclusions have relevant implications for the development of trustworthy AI systems, vehicle regulations, and the safe deployment of AVs.

22 April 2024 in IEEE Access
Verified
Journal Article
Open access
RHRonan Hamon
Ronan Hamon
HJHenrik Junklewitz
Henrik Junklewitz
JGJosep Soler Garrido
Josep Soler Garrido
ISIgnacio Sanchez
Ignacio Sanchez
This article examines the interplay between artificial intelligence (AI) and cybersecurity in light of future regulatory requirements on the security of AI systems, specifically focusing on the robustness of high-risk AI systems against cyberattacks in the context of the European Union’s AI Act. The paper identifies and analyses three challenges to achieve compliance of AI systems with the cybersecurity requirement: accounting for the diversity and the complexity of AI technologies, assessing AI-specific risks, and developing secure-by-design AI systems. The contribution of the article consists in providing an overview of AI cybersecurity practices and identifying gaps in current approaches to security conformity assessment for AI systems. Our analysis highlights the unique vulnerabilities present in AI systems and the absence of established cybersecurity practices tailored to these systems, and emphasises the need for continuous alignment between legal requirements and technological capabilities, acknowledging the necessity for further research and development to address the challenges. It concludes that comprehensive cybersecurity practices must evolve to accommodate the unique aspects of AI, with a collaborative effort from various sectors to ensure effective implementation and standardisation.

9 August 2024 in Artificial Intelligence and Law
Verified
Journal Article
Open access
PDF file
David Fernández-LlorcaDavid Fernández-Llorca
David Fernández-Llorca
EGEmilia Gómez
Emilia Gómez
ISIgnacio Sanchez
Ignacio Sanchez
GMGabriele Mazzini
Gabriele Mazzini
The European Union’s Artificial Intelligence Act (AI Act) is a groundbreaking regulatory framework that integrates technical concepts and terminology from the rapidly evolving ecosystems of AI research and innovation into the legal domain. Precise definitions accessible to both AI experts and lawyers are crucial for the legislation to be effective. This paper provides an interdisciplinary analysis of the concepts of AI system , general purpose AI system , foundation model and generative AI across the different versions of the legal text (Commission proposal, Parliament position and Council General Approach) before the final political agreement. The goal is to help bridge the understanding of these key terms between the technical and legal communities and contribute to a proper implementation of the AI Act. We provide an analysis of the concept of AI system considering its scientific foundation and the crucial role that it plays in the regulation, which requires a sound definition both from legal and technical standpoints. We connect the outcomes of this discussion with the analysis of the concept of general purpose AI system and its evolution during the negotiations. We also address the distinct conceptual meanings of AI system vs AI model and explore the technical nuances of the term foundation model . We conclude that rooting the definition of foundation model to its general purpose capabilities following standardised evaluation methodologies appears to be most appropriate approach. Lastly, we tackle the concept of generative AI , arguing that definitions of AI system that include “content” as one of the system’s outputs already captures it, and concluding that not all generative AI is based on foundation models .

1 January 2024
Verified
Conference Paper
Open access
PDF file
EBElias Bassani
Elias Bassani
ISIgnacio Sanchez
Ignacio Sanchez
Elias Bassani, Ignacio Sanchez. Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing. 2024.

17 June 2025 in AI
Verified
Journal Article
Open access
PDF file
BLBertrand De Longueville
Bertrand De Longueville
ISIgnacio Sanchez
Ignacio Sanchez
SKSnezha Kazakova
Snezha Kazakova
SLStefano Luoni
Stefano Luoni
FZFabrizio Zaro
Fabrizio Zaro
MIMarco Inchingolo
Marco Inchingolo
This paper presents the key results of a large-scale empirical study on the adoption of Generative AI (GenAI) by the Joint Research Centre (JRC), the European Commission’s science-for-policy department. Since spring 2023, the JRC has developed and deployed GPT@JRC, a platform providing safe and compliant access to state-of-the-art Large Language Models for over 10,000 knowledge workers. While the literature highlighting the potential of GenAI to enhance productivity for knowledge-intensive tasks is abundant, there is a scarcity of empirical evidence on impactful use case types and success factors. This study addresses this gap and proposes the JRC GenAI Compass conceptual framework based on the lessons learnt from the JRC’s GenAI adoption journey. It includes the concept of AI-IQ, which reflects the complexity of a given GenAI system. This paper thus draws on a case study of enterprise-scale AI implementation in European public institutions to provide approaches to harness GenAI’s potential while mitigating the risks.