Hannah Rose Kirk

Hannah Rose Kirk

Auto-generated profile, based on publicly available information

Hannah Rose Kirk

University of Oxford

Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
30 May 2023 in AI and Ethics
Verified
Journal Article
Open access
JMJakob Mökander
Jakob Mökander
JSJonas Schuett
Jonas Schuett
HKHannah Rose Kirk
Hannah Rose Kirk
LFLuciano Floridi
Luciano Floridi
Large language models (LLMs) represent a major advance in artificial intelligence (AI) research. However, the widespread use of LLMs is also coupled with significant ethical and social challenges. Previous research has pointed towards auditing as a promising governance mechanism to help ensure that AI systems are designed and deployed in ways that are ethical, legal, and technically robust. However, existing auditing procedures fail to address the governance challenges posed by LLMs, which display emergent capabilities and are adaptable to a wide range of downstream tasks. In this article, we address that gap by outlining a novel blueprint for how to audit LLMs. Specifically, we propose a three-layered approach, whereby governance audits (of technology providers that design and disseminate LLMs), model audits (of LLMs after pre-training but prior to their release), and application audits (of applications based on LLMs) complement and inform each other. We show how audits, when conducted in a structured and coordinated manner on all three levels, can be a feasible and effective mechanism for identifying and managing some of the ethical and social risks posed by LLMs. However, it is important to remain realistic about what auditing can reasonably be expected to achieve. Therefore, we discuss the limitations not only of our three-layered approach but also of the prospect of auditing LLMs at all. Ultimately, this article seeks to expand the methodological toolkit available to technology providers and policymakers who wish to analyse and evaluate LLMs from technical, ethical, and legal perspectives.

23 April 2024 in Nature Machine Intelligence
Verified
Journal Article
Closed access
PDF file
HKHannah Rose Kirk
Hannah Rose Kirk
BVBertie Vidgen
Bertie Vidgen
PRPaul Röttger
Paul Röttger
SHScott A. Hale
Scott A. Hale

28 May 2025 in Humanities and Social Sciences Communications
Verified
Journal Article
Open access
PDF file
HKHannah Rose Kirk
Hannah Rose Kirk
IGIason Gabriel
Iason Gabriel
CSChris Summerfield
Chris Summerfield
BVBertie Vidgen
Bertie Vidgen
SHScott A. Hale
Scott A. Hale
Humans strive to design safe AI systems that align with our goals and remain under our control. However, as AI capabilities advance, we face a new challenge: the emergence of deeper, more persistent relationships between humans and AI systems. We explore how increasingly capable AI agents may generate the perception of deeper relationships with users, especially as AI becomes more personalised and agentic. This shift, from transactional interaction to ongoing sustained social engagement with AI, necessitates a new focus on socioaffective alignment—how an AI system behaves within the social and psychological ecosystem co-created with its user, where preferences and perceptions evolve through mutual influence. Addressing these dynamics involves resolving key intrapersonal dilemmas, including balancing immediate versus long-term well-being, protecting autonomy, and managing AI companionship alongside the desire to preserve human social bonds. By framing these challenges through a notion of basic psychological needs, we seek AI systems that support, rather than exploit, our fundamental nature as social and emotional beings.

1 January 2023
Verified
Conference Paper
Open access
PDF file
HKHannah Kirk
Hannah Kirk
ABAndrew Bean
Andrew Bean
BVBertie Vidgen
Bertie Vidgen
PRPaul Rottger
Paul Rottger
SHScott Hale
Scott Hale
Hannah Kirk, Andrew Bean, Bertie Vidgen, Paul Rottger, Scott Hale. Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing. 2023.

24 June 2024 in Journal of Computational Social Science
Verified
Journal Article
Open access
PDF file
COCailean Osborrne
Cailean Osborrne
JDJennifer Ding
Jennifer Ding
HKHannah Rose Kirk
Hannah Rose Kirk
Open model developers have emerged as key actors in the political economy of artificial intelligence (AI), but we still have a limited understanding of collaborative practices in the open AI ecosystem. This paper responds to this gap with a three-part quantitative analysis of development activity on the Hugging Face (HF) Hub, a popular platform for building, sharing, and demonstrating models. First, various types of activity across 348,181 model, 65,761 dataset, and 156,642 space repositories exhibit right-skewed distributions. Activity is extremely imbalanced between repositories; for example, over 70% of models have 0 downloads, while 1% account for 99% of downloads. Furthermore, licenses matter: there are statistically significant differences in collaboration patterns in model repositories with permissive, restrictive, and no licenses. Second, we analyse a snapshot of the social network structure of collaboration in model repositories, finding that the community has a core-periphery structure, with a core of prolific developers and a majority of isolate developers (89%). Upon removing these isolates from the network, collaboration is characterised by high reciprocity regardless of developers’ network positions. Third, we examine model adoption through the lens of model usage in spaces, finding that a minority of models, developed by a handful of companies, are widely used on the HF Hub. Overall, the findings show that various types of activity across the HF Hub are characterised by Pareto distributions, congruent with open source software development patterns on platforms like GitHub. We conclude with recommendations for researchers, and practitioners to advance our understanding of open AI development.

4 September 2024
Verified
Conference Paper
Open access
KKKhyati Khandelwal
Khyati Khandelwal
MTManuel Tonneau
Manuel Tonneau
ABAndrew M. Bean
Andrew M. Bean
HKHannah Rose Kirk
Hannah Rose Kirk
SHScott A. Hale
Scott A. Hale
Large Language Models (LLMs), now used daily by millions, can encode societal biases, exposing their users to representational harms. A large body of scholarship on LLM bias exists but it predominantly adopts a Western-centric frame and attends comparatively less to bias levels and potential harms in the Global South. In this paper, we quantify stereotypical bias in popular LLMs according to an Indian-centric frame through Indian-BhED, a first of its kind dataset, containing stereotypical and anti-stereotypical examples in the context of caste and religious stereotypes in India. We find that the majority of LLMs tested have a strong propensity to output stereotypes in the Indian context, especially when compared to axes of bias traditionally studied in the Western context, such as gender and race. Notably, we find that GPT-2, GPT-2 Large, and GPT 3.5 have a particularly high propensity for preferring stereotypical outputs as a percent of all sentences for the axes of caste (63–79%) and religion (69–72%). We finally investigate potential causes for such harmful behaviour in LLMs, and posit intervention techniques to reduce both stereotypical and anti-stereotypical biases. The findings of this work highlight the need for including more diverse voices when researching fairness in AI and evaluating LLMs.