Rebecca Yeager

Rebecca Yeager

Auto-generated profile, based on publicly available information

Rebecca Yeager

University of Illinois Urbana-Champaign

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
3 February 2022 in International Journal of Listening
Verified
Journal Article
Closed access
RYRebecca Yeager
Rebecca Yeager
ZMZachary Meyer
Zachary Meyer
This study investigates the effects of adding stem preview to an English for Academic Purposes (EAP) multiple-choice listening assessment. In stem preview, listeners may view the item stems, but not response options, before listening. Previous research indicates that adding preview to an exam typically decreases difficulty, but raises concerns about score interpretation. Concerningly, no previous studies have explored the impact of preview on item discrimination, a key assumption of a validity argument. Our study utilized a Latin square design controlling for group, lecture, and preview condition to explore the impact of stem preview on difficulty, item type, and discrimination. Analysis indicated no significant effects of preview condition on difficulty or item type overall at our chosen alpha level. However, comparisons of total scores revealed a bimodal distribution in the no-preview condition, but not in the preview condition, indicating lower-scoring students received a boost from stem preview. Additionally, preview significantly increased facility on one of the trivial items. Results for discrimination were more complicated. On two of the five discrimination indices in the study, preview significantly decreased item discrimination, but for the other three indices, effects were not significant. Implications for assessment developers and researchers are discussed.

28 January 2024 in Journal of English for Academic Purposes
Verified
Journal Article
Closed access
RYRebecca Yeager
Rebecca Yeager
GPGoMee Park
GoMee Park
JLJui-Teng Liao
Jui-Teng Liao

7 July 2025 in Language Testing
Verified
Journal Article
Closed access
RYRebecca Yeager
Rebecca Yeager
AMAlfonso J. Martinez
Alfonso J. Martinez
Integrated assessment remains comparatively underused in local placement testing contexts despite attracting increasing attention in the language testing community. Two practical difficulties have been noted: First, rating integrated tasks can be time-consuming, and second, integrated assessments may not offer sufficient diagnostic information about receptive language skills. This Brief Report describes a validation study of an integrated placement test designed to maximize efficiency by minimizing rating bottlenecks that arise from attending to copying, source details, and citation conventions, while at the same time maximizing information about receptive skills by triangulating data from analytic subscores, multiple integrated tasks, and a handful of selected-response items. Internal validation measures of the resulting placement test, including rater agreement metrics and many-facet Rasch measurement, indicate that the test meaningfully distinguishes between test-takers of different ability levels and exhibits strong rater consistency. Diagnostic intake checklists indicate that the test supports student learning and results in few misclassifications, with similar accuracy for productive and receptive skills. These innovations on the placement test were accomplished without perceptibly lengthening testing or rating time. Despite some continuing friction points, the test illustrates the potential of adapting integrated assessment to accommodate local resource constraints.

1 September 2026 in Studies in Language Assessment
Verified
Journal Article
Closed access
RYRebecca Yeager
Rebecca Yeager
GPGoMee Park
GoMee Park
JPJunhee Park
Junhee Park
This study examines the cognitive validity of a listen-to-summarize task on a university placement test. Cognitive validity is underinvestigated in listening assessment, especially for higher-order listening processes (Holzknecht et al., 2017; Rukthong, 2021). However, student notes from listening tests can record evidence of these processes (Yeager et al., 2024; Cushing, 1991). This study employed an exploratory sequential mixed-methods design to investigate the higher-order listening processes elicited by an integrated listen-to-summarize task. First, notes from two administrations of the same test form – one with notetaking scaffolding (n = 25) and one without (n = 25) – were analyzed qualitatively. Second, qualitative codes informed the development of a rubric to quantify higher-order listening processes across administrations, enabling comparison with summary and multiple-choice scores on another test form (n = 118). Qualitative analysis revealed substantial evidence of higher-order discourse construction processes in student notes, including Selecting, Integrating, Monitoring, and Structure-Building (Field, 2013), especially when scaffolding was provided. Linear regression models indicated that Selecting processes significantly predicted test scores for both the integrated task and the multiple-choice task, while Structure-Building processes were significant only for the integrated task. Results support the cognitive validity of the listen-to-summarize task and inform improved test design and score interpretation.