Shahbaz Syed

Shahbaz Syed

Auto-generated profile, based on publicly available information

Shahbaz Syed

Leipzig University, Leipzig, Germany

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
10 July 2024
Verified
Conference Paper
Open access
LGLukas Gienapp
Lukas Gienapp
HSHarrisen Scells
Harrisen Scells
NDNiklas Deckers
Niklas Deckers
JBJanek Bevendorff
Janek Bevendorff
SWShuai Wang
Shuai Wang
MPMartin Potthast
Martin Potthast
Recent advances in large language models have enabled the development of viable generative retrieval systems. Instead of a traditional document ranking, generative retrieval systems often directly return a grounded generated text as a response to a query. Quantifying the utility of the textual responses is essential for appropriately evaluating such generative ad hoc retrieval. Yet, the established evaluation methodology for ranking-based ad hoc retrieval is not suited for the reliable and reproducible evaluation of generated responses. To lay a foundation for developing new evaluation methods for generative retrieval systems, we survey the relevant literature from the fields of information retrieval and natural language processing, identify search tasks and system architectures in generative retrieval, develop a new user model, and study its operationalization.

1 January 2023
Verified
Conference Paper
Open access
PDF file
KKKhalid Al Khatib
Khalid Al Khatib
MVMichael Voelske
Michael Voelske
ALAnh Le
Anh Le
SSShahbaz Syed
Shahbaz Syed
MPMartin Potthast
Martin Potthast
BSBenno Stein
Benno Stein
Khalid Al Khatib, Michael Voelske, Anh Le, Shahbaz Syed, Martin Potthast, Benno Stein. Proceedings of the 24th Meeting of the Special Interest Group on Discourse and Dialogue. 2023.