Jacqueline Church

Jacqueline Church

Auto-generated profile, based on publicly available information

Jacqueline Church

Duolingo, Pittsburgh, PA, USA

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
25 April 2023
Verified
Report
Closed access
GLGeoffrey LaFlair
Geoffrey LaFlair
ARAndrew Runge
Andrew Runge
YAYigal Attali
Yigal Attali
YPYena Park
Yena Park
JCJacqueline Church
Jacqueline Church
SGSarah Goodwin
Sarah Goodwin
This paper introduces a new integrated task type on the Duolingo English Test called Interactive Listening and grounds the task within the Duolingo English Test’s theoretical language assessment design framework and its assessment ecosystem. The task and automated item generation methods contribute to measurement of the constructs of L2 listening, reading, and writing, thereby strengthening the validity claims of the Duolingo English Test.

27 July 2026 in Language Testing
Verified
Journal Article
Open access
YPYena Park
Yena Park
YAYigal Attali
Yigal Attali
XZXiaowan Zhang
Xiaowan Zhang
JCJacqueline Church
Jacqueline Church
KLKai-Ling Lo
Kai-Ling Lo
GLGeoffrey T. LaFlair
Geoffrey T. LaFlair
Despite task interactivity eliciting different aspects of language use, more interactive, adaptive speaking tasks have been challenging to implement in computer-delivered large-scale high-stakes contexts. Recent advances in large language models (LLMs) offer a potential means to address this tension through spoken dialogue systems (SDSs) but fall short of full adaptivity. To enhance adaptivity in an LLM-enhanced SDS-delivered interview task, this article proposes two solutions: (1) LLM-driven response evaluation using question-specific task completion rubrics for adaptive follow-up question selection and (2) item response theory (IRT) scoring accounting for prompt variability. We examined the extent to which these solutions functioned to simulate adaptivity, from 5,909 test takers’ responses to an adaptive speaking task with an avatar and a non-adaptive monologic task. Automated task completion evaluations were comparable to expert ratings, though follow-up question evaluation showed low agreement both among human raters and between raters and the system. IRT scoring yielded higher test–retest reliability, and the adaptive task elicited more reciprocal language use than the monologic task. Unlike earlier SDSs that prioritized consistency over adaptivity, the real-time meaning-level evaluation with IRT modeling strikes a balance between standardization and adaptivity. These findings support the viability of adaptive speaking tasks in computer-based standardized assessments.