Yoelle Maarek

Yoelle Maarek

Auto-generated profile, based on publicly available information

Yoelle Maarek

Technology Innovation Institute (TII), Haifa, Israel

Research Focus & Metrics

Representative Publications

View All Publications
10 July 2024
Verified
Conference Paper
Open access
FCFlorin Cuconasu
Florin Cuconasu
GTGiovanni Trappolini
Giovanni Trappolini
FSFederico Siciliano
Federico Siciliano
SFSimone Filice
Simone Filice
CCCesare Campagnano
Cesare Campagnano
FSFabrizio Silvestri
Fabrizio Silvestri
Retrieval-Augmented Generation (RAG) has recently emerged as a method to extend beyond the pre-trained knowledge of Large Language Models by augmenting the original prompt with relevant passages or documents retrieved by an Information Retrieval (IR) system. RAG has become increasingly important for Generative AI solutions, especially in enterprise settings or in any domain in which knowledge is constantly refreshed and cannot be memorized in the LLM. We argue here that the retrieval component of RAG systems, be it dense or sparse, deserves increased attention from the research community, and accordingly, we conduct the first comprehensive and systematic examination of the retrieval strategy of RAG systems. We focus, in particular, on the type of passages IR systems within a RAG solution should retrieve. Our analysis considers multiple factors, such as the relevance of the passages included in the prompt context, their position, and their number. One counter-intuitive finding of this work is that the retriever's highest-scoring documents that are not directly relevant to the query (e.g., do not contain the answer) negatively impact the effectiveness of the LLM. Even more surprising, we discovered that adding random documents in the prompt improves the LLM accuracy by up to 35%. These results highlight the need to investigate the appropriate strategies when integrating retrieval with LLMs, thereby laying the groundwork for future research in this area.

10 July 2024
Verified
Conference Paper
Open access
OHOz Huly
Oz Huly
IPIdan Pogrebinsky
Idan Pogrebinsky
DCDavid Carmel
David Carmel
OKOren Kurland
Oren Kurland
YMYoelle Maarek
Yoelle Maarek
Retrieval augmented generation (RAG) is an important approach to provide large language models (LLMs) with context pertaining to the text generation task: given a prompt, passages are retrieved from external corpora to ground the generation with more relevant and/or fresher data. Most previous studies used dense retrieval methods for applying RAG in question answering scenarios. However, recent work showed that traditional information retrieval methods (a.k.a. sparse methods) can do as well as or even better than dense retrieval ones. In particular, it was shown that Okapi BM25 outperforms dense retrieval methods, in terms of perplexity, for the fundamental text completion task in LLMs. We extend this study and show, using two popular LLMs, that a broad set of sparse retrieval methods achieve better results than all the dense retrieval methods we experimented with, for varying lengths of queries induced from the prompt. Furthermore, we found that Okapi BM25 is substantially outperformed by a term-proximity retrieval method (MRF), which is in turn outperformed by a pseudo-feedback-based bag-of-terms approach (relevance model). Additional exploration sheds some light on the effectiveness of lexical retrieval methods for RAG. Our findings call for further study of classical retrieval methods for RAG.

13 July 2025
Verified
Conference Paper
Open access
DCDavid Carmel
David Carmel
SFSimone Filice
Simone Filice
GHGuy Horowitz
Guy Horowitz
YMYoelle Maarek
Yoelle Maarek
OSOren Somekh
Oren Somekh
RTRan Tavory
Ran Tavory

14 September 2023
Verified
Conference Paper
Open access
EHElad Haramaty
Elad Haramaty
ZKZohar Karnin
Zohar Karnin
ALArnon Lazerson
Arnon Lazerson
LLLiane Lewin-Eytan
Liane Lewin-Eytan
YMYoelle Maarek
Yoelle Maarek

8 February 2016
Verified
Conference Paper
Open access
YMYoelle Maarek
Yoelle Maarek

19 July 2026
Verified
Conference Paper
Open access
DCDavid Carmel
David Carmel
SFSimone Filice
Simone Filice
GHGuy Horowitz
Guy Horowitz
YMYoelle Maarek
Yoelle Maarek
ASAlexander Shtoff
Alexander Shtoff
RTRan Tavory
Ran Tavory