Oz Huly

Oz Huly

Auto-generated profile, based on publicly available information

Oz Huly

Technion, Haifa, Israel

Research Focus & Metrics

Representative Publications

View All Publications
10 July 2024
Verified
Conference Paper
Open access
OHOz Huly
Oz Huly
IPIdan Pogrebinsky
Idan Pogrebinsky
DCDavid Carmel
David Carmel
OKOren Kurland
Oren Kurland
YMYoelle Maarek
Yoelle Maarek
Retrieval augmented generation (RAG) is an important approach to provide large language models (LLMs) with context pertaining to the text generation task: given a prompt, passages are retrieved from external corpora to ground the generation with more relevant and/or fresher data. Most previous studies used dense retrieval methods for applying RAG in question answering scenarios. However, recent work showed that traditional information retrieval methods (a.k.a. sparse methods) can do as well as or even better than dense retrieval ones. In particular, it was shown that Okapi BM25 outperforms dense retrieval methods, in terms of perplexity, for the fundamental text completion task in LLMs. We extend this study and show, using two popular LLMs, that a broad set of sparse retrieval methods achieve better results than all the dense retrieval methods we experimented with, for varying lengths of queries induced from the prompt. Furthermore, we found that Okapi BM25 is substantially outperformed by a term-proximity retrieval method (MRF), which is in turn outperformed by a pseudo-feedback-based bag-of-terms approach (relevance model). Additional exploration sheds some light on the effectiveness of lexical retrieval methods for RAG. Our findings call for further study of classical retrieval methods for RAG.

13 July 2025
Verified
Conference Paper
Open access
OHOz Huly
Oz Huly
DCDavid Carmel
David Carmel
OKOren Kurland
Oren Kurland