Fabio Petroni

Fabio Petroni

Auto-generated profile, based on publicly available information

Fabio Petroni

Samaya AI, London, United Kingdom

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
19 October 2023 in Nature Machine Intelligence
Verified
Journal Article
Open access
PDF file
FPFabio Petroni
Fabio Petroni
SBSamuel Broscheit
Samuel Broscheit
APAleksandra Piktus
Aleksandra Piktus
PLPatrick Lewis
Patrick Lewis
GIGautier Izacard
Gautier Izacard
SRSebastian Riedel
Sebastian Riedel
Verifiability is a core content policy of Wikipedia: claims need to be backed by citations. Maintaining and improving the quality of Wikipedia references is an important challenge and there is a pressing need for better tools to assist humans in this effort. We show that the process of improving references can be tackled with the help of artificial intelligence (AI) powered by an information retrieval system and a language model. This neural-network-based system, which we call SIDE, can identify Wikipedia citations that are unlikely to support their claims, and subsequently recommend better ones from the web. We train this model on existing Wikipedia references, therefore learning from the contributions and combined wisdom of thousands of Wikipedia editors. Using crowdsourcing, we observe that for the top 10% most likely citations to be tagged as unverifiable by our system, humans prefer our system’s suggested alternatives compared with the originally cited reference 70% of the time. To validate the applicability of our system, we built a demo to engage with the English-speaking Wikipedia community and find that SIDE’s first citation recommendation is preferred twice as often as the existing Wikipedia citation for the same top 10% most likely unverifiable claims according to SIDE. Our results indicate that an AI-based system could be used, in tandem with humans, to improve the verifiability of Wikipedia.

10 July 2024
Verified
Conference Paper
Open access
FPFabio Petroni
Fabio Petroni
FSFederico Siciliano
Federico Siciliano
FSFabrizio Silvestri
Fabrizio Silvestri
GTGiovanni Trappolini
Giovanni Trappolini
In recent years, Retrieval Augmented Generation (RAG) systems have emerged as a pivotal component in the field of artificial intelligence, gaining significant attention and importance across various domains. These systems, which combine the strengths of information retrieval and generative models, have shown promise in enhancing the capabilities and performance of machine learning applications. However, despite their growing prominence, RAG systems are not without their limitations and continue to be in need of exploration and improvement. This workshop seeks to focus on the critical aspect of information retrieval and its integral role within RAG frameworks. We argue that current efforts have undervalued the role of Information Retrieval (IR) in the RAG and have concentrated their attention on the generative part. As the cornerstone of these systems, IR's effectiveness dramatically influences the overall performance and outcomes of RAG models. We call for papers that will seek to revisit and emphasize the fundamental principles underpinning RAG systems. At the end of the workshop, we aim to have a clearer understanding of how robust information retrieval mechanisms can significantly enhance the capabilities of RAG systems. The workshop will serve as a platform for experts, researchers, and practitioners. We intend to foster discussions, share insights, and encourage research that underscores the vital role of Information Retrieval in the future of generative systems.

13 July 2025
Verified
Conference Paper
Open access
NANegar Arabzadeh
Negar Arabzadeh
ZCZiheng Chen
Ziheng Chen
FPFabio Petroni
Fabio Petroni
FSFederico Siciliano
Federico Siciliano
FSFabrizio Silvestri
Fabrizio Silvestri
GTGiovanni Trappolini
Giovanni Trappolini

4 September 2026 in bioRxiv
Verified
Preprint
Open access
PDF file
FCFrancesco Carli
Francesco Carli
PRPolina Rusina
Polina Rusina
LALun Ai
Lun Ai
LKLeonie Küchenhoff
Leonie Küchenhoff
PTPaul Ka Po To
Paul Ka Po To
JSJulio Saez-Rodriguez
Julio Saez-Rodriguez
Language models and agents are increasingly used in biomedicine, but current benchmarks reward correct answers even when the underlying reasoning is flawed. Here we introduce Karenina, an open-source framework that turns expert knowledge into multi-dimensional evaluations of questions, conversations and autonomous agents. Illustrated in Question-Answer pairs, multi-turn conversations and autonomous data-analysis, these dimensions together moves evaluation beyond scoring, enabling trustworthy decision-making with AI in biomedicine.