This project aimed to develop an engaging formative assessment that simulates the social and dialogic processes that are often missing in traditional instruction and assessment of argumentation. In this article, we describe the design of an argumentative reasoning task within a scenario-based assessment enhanced with game elements (Seaball—Semester at Sea). This Seaball task requires students to classify foods as “junk food” or not, by identifying relevant evidence to support their decisions and evaluating reasoning errors in others’ arguments. Data from a small-scale study of 42 middle school students revealed that students performed significantly better on questions requiring selection of appropriate evidence than questions requiring identification of logical fallacies. Additionally, students’ total scores were significantly correlated with external measures of argumentation skills, and with teacher’s ratings of their argumentative writing skills. Survey indicated that students perceived the game-enhanced scenario-based assessment as engaging. Implications for formative assessment are discussed.
30 March 2023 in Diaspora, Indigenous, and Minority Education
Drawing on a scoping-review methodology, this study aimed to map extant literature to conceptualize cultural validity in assessment. Three themes emerged from this review: (a) conceptualization of cultural validity, (b) promoting cultural validity in assessment, and (c) challenges to cultural validity in assessment. The review showed that culturally valid assessment ensures that assessment instruments and practices, assessment decision-making processes, and use of assessment scores in instructional and eligibility decisions are culturally responsive. Cultural validity should be considered as a core component of validity issues in the initial assessment-development process. To promote cultural validity in assessment, teachers/assessment developers should (a) develop awareness of cultural diversities, (b) leverage students’ everyday-life experiences, (c) allow students’ agency in assessment, (d) use collaborative-/participatory-assessment design, and (e) pay critical attention to language use. Standardization, lack of awareness of available research, paucity of resources on culturally responsive assessment practices, and limited professional-development-training opportunities on culturally responsive assessment were found to be the major threats to implementation of culturally responsive assessment practices. This review provides a foundation for better supporting teachers and assessment developers to effectively implement and engage in culturally responsive assessment.