Björn Engelmann

Björn Engelmann

Auto-generated profile, based on publicly available information

Björn Engelmann

TH Köln, Cologne, Germany

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
8 December 2024
Verified
Conference Paper
Open access
LALeif Azzopardi
Leif Azzopardi
TBTimo Breuer
Timo Breuer
BEBjörn Engelmann
Björn Engelmann
CKChristin Kreutz
Christin Kreutz
SMSean MacAvaney
Sean MacAvaney
SZSaber Zerhoudi
Saber Zerhoudi
Evaluating the interactions between users and systems presents many challenges. Simulation offers a reliable, re-usable, and repeatable methodology to explore how different users, user behaviours and/or retrieval systems impact performance. With Large Language Models and Generative AI now widely available and accessible, new affordances are possible. These allow researchers to create more ''realistic'' simulated users that can generate queries and judge items like humans, and to develop new retrieval systems where responses and interactions are conversational and based on retrieval augmented generation. This resource paper presents a community-led initiative to update the Simulation of Interactive Information Retrieval (SimIIR) Framework to enable the simulation of conversational search using LLMs. The largest update provides a conversational search workflow which involves a number of new possible interactions with a search system or agent -- enabling a host of new development and evaluation opportunities. Other developments include the Markovian Users, Cognitive States, LLM-based components for assessing snippets/documents/responses, generating queries, deciding on when to stop/continue, and PyTerrier integration. This paper aims to mark the release of SimIIR 3.0 and invites the community to build, extend, and use the resource.

16 March 2024
Verified
Book Chapter
Closed access
PDF file
BEBjörn Engelmann
Björn Engelmann
TBTimo Breuer
Timo Breuer
JFJana Isabelle Friese
Jana Isabelle Friese
PSPhilipp Schaer
Philipp Schaer
Norbert FuhrNorbert Fuhr
Norbert Fuhr

21 October 2023
Verified
Conference Paper
Open access
BEBjörn Engelmann
Björn Engelmann
TBTimo Breuer
Timo Breuer
PSPhilipp Schaer
Philipp Schaer

1 January 2024
Verified
Conference Paper
Open access
PDF file
BEBjörn Engelmann
Björn Engelmann
CKChristin Katharina Kreutz
Christin Katharina Kreutz
FHFabian Haak
Fabian Haak
PSPhilipp Schaer
Philipp Schaer
Björn Engelmann, Christin Katharina Kreutz, Fabian Haak, Philipp Schaer. Findings of the Association for Computational Linguistics: EMNLP 2024. 2024.

21 May 2024
Verified
Conference Paper
Open access
FHFabian Haak
Fabian Haak
BEBjörn Engelmann
Björn Engelmann
CKChristin Katharina Kreutz
Christin Katharina Kreutz
PSPhilipp Schaer
Philipp Schaer
Search query suggestions affect users’ interactions with search engines, which then influences the information they encounter. Thus, bias in search query suggestions can lead to exposure to biased search results and can impact opinion formation. This is especially critical in the political domain. Detecting and quantifying bias in web search engines is difficult due to its topic dependency, complexity, and subjectivity. The lack of context and phrasality of query suggestions emphasizes this problem. In a multi-step approach, we combine the benefits of large language models, pairwise comparison, and Elo-based scoring to identify and quantify bias in English search query suggestions. We apply our approach to the U.S. political news domain and compare bias in Google and Bing.

1 January 2024
Verified
Conference Paper
Open access
PDF file
CKChristin Kreutz
Christin Kreutz
FHFabian Haak
Fabian Haak
BEBjörn Engelmann
Björn Engelmann
PSPhilipp Schaer
Philipp Schaer
Christin Kreutz, Fabian Haak, Björn Engelmann, Philipp Schaer. Findings of the Association for Computational Linguistics ACL 2024. 2024.