Henning Wachsmuth

Henning Wachsmuth

Auto-generated profile, based on publicly available information

Henning Wachsmuth

Leibniz University Hannover

Research Focus & Metrics

Academic Career Length

9Years (2018-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
9 August 2023
Verified
Conference Paper
Open access
GFGuglielmo Faggioli
Guglielmo Faggioli
LDLaura Dietz
Laura Dietz
CCCharles L. A. Clarke
Charles L. A. Clarke
GDGianluca Demartini
Gianluca Demartini
MHMatthias Hagen
Matthias Hagen
HWHenning Wachsmuth
Henning Wachsmuth
When asked, large language models~(LLMs) like ChatGPT claim that they can assist with relevance judgments but it is not clear whether automated judgments can reliably be used in evaluations of retrieval systems. In this perspectives paper, we discuss possible ways for~LLMs to support relevance judgments along with concerns and issues that arise. We devise a human--machine collaboration spectrum that allows to categorize different relevance judgment strategies, based on how much humans rely on machines. For the extreme point of 'fully automated judgments', we further include a pilot experiment on whether LLM-based relevance judgments correlate with judgments from trained human assessors. We conclude the paper by providing opposing perspectives for and against the use of~LLMs for automatic relevance judgments, and a compromise perspective, informed by our analyses of the literature, our preliminary experimental evidence, and our experience as IR~researchers.

1 January 2020
Verified
Conference Paper
Open access
PDF file
HWHenning Wachsmuth
Henning Wachsmuth
TWTill Werner
Till Werner
Henning Wachsmuth, Till Werner. Proceedings of the 28th International Conference on Computational Linguistics. 2020.

1 January 2024
Verified
Conference Paper
Open access
PDF file
TZTimon Ziegenbein
Timon Ziegenbein
GSGabriella Skitalinskaya
Gabriella Skitalinskaya
AMAlireza Bayat Makou
Alireza Bayat Makou
HWHenning Wachsmuth
Henning Wachsmuth
Timon Ziegenbein, Gabriella Skitalinskaya, Alireza Bayat Makou, Henning Wachsmuth. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2024.

1 January 2023
Verified
Conference Paper
Open access
PDF file
MAMilad Alshomary
Milad Alshomary
HWHenning Wachsmuth
Henning Wachsmuth
Milad Alshomary, Henning Wachsmuth. Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics. 2023.

1 January 2023
Verified
Conference Paper
Open access
PDF file
GSGabriella Skitalinskaya
Gabriella Skitalinskaya
MSMaximilian Spliethöver
Maximilian Spliethöver
HWHenning Wachsmuth
Henning Wachsmuth
Gabriella Skitalinskaya, Maximilian Spliethöver, Henning Wachsmuth. Proceedings of the 16th International Natural Language Generation Conference. 2023.

1 January 2024
Verified
Conference Paper
Open access
PDF file
MSMaja Stahl
Maja Stahl
NMNadine Michel
Nadine Michel
SKSebastian Kilsbach
Sebastian Kilsbach
JSJulian Schmidtke
Julian Schmidtke
SRSara Rezat
Sara Rezat
HWHenning Wachsmuth
Henning Wachsmuth
Maja Stahl, Nadine Michel, Sebastian Kilsbach, Julian Schmidtke, Sara Rezat, Henning Wachsmuth. Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers). 2024.