Andrew Parry

Andrew Parry

Auto-generated profile, based on publicly available information

Andrew Parry

University of Glasgow, Glasgow, United Kingdom

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
8 December 2024
Verified
Conference Paper
Open access
LALeif Azzopardi
Leif Azzopardi
TBTimo Breuer
Timo Breuer
BEBjörn Engelmann
Björn Engelmann
CKChristin Kreutz
Christin Kreutz
SMSean MacAvaney
Sean MacAvaney
SZSaber Zerhoudi
Saber Zerhoudi
Evaluating the interactions between users and systems presents many challenges. Simulation offers a reliable, re-usable, and repeatable methodology to explore how different users, user behaviours and/or retrieval systems impact performance. With Large Language Models and Generative AI now widely available and accessible, new affordances are possible. These allow researchers to create more ''realistic'' simulated users that can generate queries and judge items like humans, and to develop new retrieval systems where responses and interactions are conversational and based on retrieval augmented generation. This resource paper presents a community-led initiative to update the Simulation of Interactive Information Retrieval (SimIIR) Framework to enable the simulation of conversational search using LLMs. The largest update provides a conversational search workflow which involves a number of new possible interactions with a search system or agent -- enabling a host of new development and evaluation opportunities. Other developments include the Markovian Users, Cognitive States, LLM-based components for assessing snippets/documents/responses, generating queries, deciding on when to stop/continue, and PyTerrier integration. This paper aims to mark the release of SimIIR 3.0 and invites the community to build, extend, and use the resource.

10 July 2024
Verified
Conference Paper
Open access
APAndrew Parry
Andrew Parry
DGDebasis Ganguly
Debasis Ganguly
MCManish Chandra
Manish Chandra
With the increasing ability of large language models (LLMs), in-context learning (ICL) has evolved as a new paradigm for natural language processing (NLP), where instead of fine- tuning the parameters of an LLM specific to a downstream task with labeled examples,a small number of such examples is appended to a prompt instruction for controlling the decoder's generation process. ICL, thus, is conceptually similar to a non-parametric approach, such as k-NN,where the prediction for each instance essentially depends on the local topology, i.e., on a localised set of similar instances and their labels (called few-shot examples). This suggests that a test instance in ICL is analogous to a query in IR, and similar examples in ICL retrieved from a training set relate to a set of documents retrieved from a collection in IR. While standard unsupervised ranking models can be used to retrieve these few-shot examples from a training set, the effectiveness of the examples can potentially be improved by re-defining the notion of relevance specific to its utility for the downstream task, i.e., considering an example to be relevant if including it in the prompt instruction leads to a correct prediction. With this task-specific notion of relevance, it is possible to train a supervised ranking model (e.g., a bi-encoder or cross-encoder), which potentially learns to optimally select the few-shot examples. We believe that the recent advances in neural rankers can potentially find a use case for this task of optimally choosing examples for more effective downstream ICL predictions.

16 March 2024
Verified
Book Chapter
Closed access
PDF file
APAndrew Parry
Andrew Parry
MFMaik Fröbe
Maik Fröbe
SMSean MacAvaney
Sean MacAvaney
MPMartin Potthast
Martin Potthast
MHMatthias Hagen
Matthias Hagen

13 July 2025
Verified
Conference Paper
Open access
MFMaik Fröbe
Maik Fröbe
APAndrew Parry
Andrew Parry
FSFerdinand Schlatt
Ferdinand Schlatt
SMSean MacAvaney
Sean MacAvaney
BSBenno Stein
Benno Stein
MHMatthias Hagen
Matthias Hagen

13 July 2025
Verified
Conference Paper
Open access
APAndrew Parry
Andrew Parry
MFMaik Fröbe
Maik Fröbe
HSHarrisen Scells
Harrisen Scells
FSFerdinand Schlatt
Ferdinand Schlatt
GFGuglielmo Faggioli
Guglielmo Faggioli
EYEugene Yang
Eugene Yang

13 July 2025
Verified
Conference Paper
Open access
CMCraig Macdonald
Craig Macdonald
JFJinyuan Fang
Jinyuan Fang
APAndrew Parry
Andrew Parry
Zaiqiao MengZaiqiao Meng
Zaiqiao Meng