Russell Swinburne Romine

Dr. Russell Swinburne Romine

orcid

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
3 April 2019 in International Journal of Testing
Verified
Journal Article
Closed access
SBSue Bechard
Sue Bechard
ACAmy K. Clark
Amy K. Clark
RRRussell Swinburne Romine
Russell Swinburne Romine
MKMeagan Karvonen
Meagan Karvonen
NKNeal Kingston
Neal Kingston
KEKaren Erickson
Karen Erickson
Evidence-based approaches to assessment design, development, and administration provide a strong foundation for an assessment’s validity argument but can be time consuming, resource intensive, and complex to implement. This article describes an evidence-based approach used for one assessment that addresses these challenges. Evidence-centered design principles were applied to create a task template to support test development for a new, instructionally embedded, large-scale alternate assessment system used for accountability purposes in 18 US states. Example evidence from the validity argument is presented to evaluate the effectiveness of the template as an evidence-based method for test development. Lessons learned, including strengths and challenges, are shared to inform test-development efforts for other programs.

14 March 2025 in Education Sciences
Verified
Journal Article
Open access
PDF file
RRRussell Swinburne Romine
Russell Swinburne Romine
JSJonathan Schuster
Jonathan Schuster
MKMeagan Karvonen
Meagan Karvonen
W. Jake ThompsonW. Jake Thompson
W. Jake Thompson
KEKaren Erickson
Karen Erickson
SBSue Bechard
Sue Bechard
This paper describes large, fine-grained, intentionally inclusive, research-based cognitive models called learning maps. Learning maps are the product of an intensive research synthesis process to develop formal learning models that better reflect the diversity of how learners can learn and be assessed on academic content. Students begin at different places and learn at different rates, and they may have cognitive disabilities or may face a variety of barriers that pose challenges when learning content. Learning maps provide numerous starting points and pathways by which students can acquire and demonstrate knowledge, skills, and understandings. Our work in developing learning maps relies on principles of Universal Design for Learning (UDL), which provides a foundation of flexibility and inclusivity to accommodate students with a wide range of cognitive, linguistic, physical, and sensory profiles. In this paper, we describe learning map design, development, and both qualitative and quantitative methods for the evaluation of map structure. In addition, we offer reflections on our experiences with implementing learning maps as the cognitive architecture for assessments and educational interventions through our work on a variety of projects. With examples from these projects, we describe evidence that shows how learning maps can be useful tools for improving instruction and assessment for all learners. We identify areas where further research and inquiry could prove fruitful and conclude with a discussion of potential areas of extension and offer suggestions for the ongoing refinement of learning maps.

22 May 2026 in Educational Measurement: Issues and Practice
Verified
Journal Article
Open access
BNBrooke Nash
Brooke Nash
MKMeagan Karvonen
Meagan Karvonen
CFClaudia Flowers
Claudia Flowers
ACAmy K. Clark
Amy K. Clark
RRRussell Swinburne Romine
Russell Swinburne Romine
SBSue Bechard
Sue Bechard
Traditional alignment studies that are narrowly focused on content standards and assessment items and are conducted postadministration often lack the timeliness and utility needed to improve assessment systems. This paper introduces a flexible alignment framework centered on assessment‐system coherence. Our framework broadens alignment evaluation to include all interconnected elements, from domain definition to score use. We advocate for proactive alignment evaluation by defining expectations in advance and gathering both procedural and empirical evidence throughout the assessment life cycle. By addressing three guiding questions regarding system elements that need to be aligned, the purpose of the alignment evidence, and the types of evidence to use, developers can create customized evaluation plans to enhance alignment during development. The paper provides example alignment questions and an example application of the framework. We discuss the framework's potential to enhance the coherence of assessment systems in the service of meaningful policy and practice.