Evidence-centered design (ECD) is an assessment framework tailored to provide structure and rigor to the assessment development process, and also to generate evidence of assessment validity by tightly coupling assessment tasks with focal knowledge, skills, and abilities (FKSAs). This framework is particularly well-suited to FKSAs that are complex and multi-part (Mislevy and Haertel, 2006), as is the case with much of the focal content within the computer science (CS) domain. This paper presents an applied case of ECD used to guide assessment development in the context of a redesigned introductory CS curriculum. In order to measure student learning of CS skills and content taught through the curriculum, knowledge assessments were written and piloted. The use of ECD provided an organizational framework for assessment development efforts, offering assessment developers a clear set of steps with accompanying documentation and decision points, as well as providing robust validity evidence for the assessment. The description of an application of ECD for assessment development within the context of an introductory CS course illustrates its utility and effectiveness, and also provides a guide for researchers carrying out related work.
8 November 2023 in ACM Transactions on Computing Education
Objectives. The goal of this paper is to introduce and describe a new introductory computer science course. Research results from the implementation of this curriculum will be presented to demonstrate the nature of teachers’ experiences with the curriculum. Participants. Participants are teachers implementing the new curriculum at two schools in the metro Atlanta area. Study Method. This paper is partly descriptive, presenting the theory underlying the newly developed curriculum as well as its various features. An organizing framework, the Teacher Accessibility, Equity, and Content (TEC) rubric from Weintrop et al. (2019) [ 1 ], is used to structure the curriculum description. Teacher perceptions were gathered via both structured interviews and short online enactment surveys. These perceptions are summarized and presented thematically, corresponding to the features of the curriculum. Findings. A newly developed introductory computer science (CS) curriculum, Student-Centered Computing (SCC), utilizes project-based learning (PBL) and culturally authentic practices (CAPs) to help promote a sense of belonging and intent to persist within computer science among all students. Teachers successfully implemented the curriculum and generally found it to be beneficial for their students, though they struggled with some of the pedagogical demands of project-based learning as well as some of the most advanced technical content associated with the music coding and app development platforms. Conclusions. This paper provides a detailed overview of a year-long introductory computer science curriculum focused on the creation of culturally relevant digital artifacts. The curriculum represents a strong effort to make CS content relevant and appealing to the full range of students by relating it to their lives and experiences. Teacher surveys and interviews revealed that both teachers and students had positive views of the course. However, teaching using inclusive PBL pedagogy and culturally authentic practices takes skill and practice by teachers, supporting the need for CS teachers to have good pedagogical training as well as a strong knowledge of computer science to create a classroom environment that promotes success for all students.
4 July 2018 in International Journal of STEM Education
A redesigned curriculum for teaching engineering graphics was adopted in an introductory mechanical engineering course. The rollout of this curriculum was staggered, allowing for comparisons of student perceptions across the newly revised and previous instructional approaches. The new curriculum borrows from content and pedagogy traditionally employed in industrial design courses. The discipline-based education research (DBER) framework was used to investigate the manner in which the new curriculum was implemented and student reactions to this change. By using this approach, the researchers were able to incorporate and emphasize the unique aspects of the subject matter itself, as well as the attributes of the engineering discipline in which the course was embedded. Results indicated that students exhibited positive reactions to the sketching instruction, as well as various other aspects of the course, and that reactions were generally more positive among students in the redesigned course. The contributions of this paper are twofold: illustrating the application of a specific research framework and providing results of an investigation of a redesigned curriculum. The redesigned curriculum was generally received well by students, and the partnership between the education researchers and faculty proved fruitful in allowing for nuanced investigation of the course redesign. Practical considerations for undertaking this type of research are also outlined.