30 August 2023 in Science Education
Lesson planning is a core part of teachers' professional competence. Written lesson plans play a significant role in science teacher education as a preparation for demonstration lessons during the final teacher certification exam. However, the few existing scoring rubrics on lesson plans are not particularly theoretically sound and are barely tested for the validity of score interpretations. In response to the demand for transparent and applicable criteria, we developed therubric to assess science lesson plans(RALP) to assess science teachers' lesson plan quality. We employed a mixed‐methods approach: First, we present multiple sources of validity evidence (based ontest content,internal structure,relations to other variables, andconsequences of testing) as mainly quantitative indicators for the quality of the RALP. Based upon that, we applied the RALP to lesson plans written by preservice and trainee science teachers (N = 100) and provided a qualitative analysis of six cases to illustrate common patterns in these lesson plans. Results indicate that teacher educators consider the RALP criteria (N = 24) relevant and objectively applicable. Correlation analyses of the scores and two teacher educators' holistic quality assessment of all lesson plans provide convincing evidence that the RALP can discriminate lesson plan quality levels. Moreover, comparisons between preservice science teachers and trainee science teachers reveal that trainee teachers score significantly higher than preservice teachers, indicating that the RALP is sensitive to differences in teaching and planning experience. The application and in‐depth analysis of three criteria of the RALP illustrate these differences in levels of planning quality. We discuss possible applications of the RALP in science teacher education and research in science teaching.
4 November 2020 in International Journal of Science Education
Scientific reasoning competencies are relevant science competencies and therefore the development of assessment instruments for scientific reasoning competencies has become an integral part of science education research. However, some authors have questioned the validity of the instruments available so far, since their psychometric quality has not been evaluated satisfactorily. In this study, an established German multiple-choice instrument to assess scientific reasoning competencies has been translated into English and Spanish and the translated versions were evaluated based on the translation, review, adjudication, pretesting and documentation (TRAPD) approach. Based on samples of German (N = 497), Australian (N = 103), and Chilean (N = 135) pre-service science teachers, statistical analyses (e.g. dimensionality and DIF analyses) provide psychometric evidence for test equivalence between the German and the translated versions of the instrument. Known groups comparisons provide evidence for the valid interpretation of the test scores as measures of scientific reasoning competencies. It is discussed that further studies might evaluate additional sources of validity evidence for the translated versions of the instrument, particularly focusing on cultural specificities. Independent of this need for further research, it is suggested that the three versions can be used to assess the scientific reasoning competencies of pre-service science teachers whose first language is English, German, or Spanish.
25 January 2022 in Research in Science Education
Scientific reasoning competencies (SRC) are one part of science teachers’ professional competencies. This study examines the contribution of three factors to the development of pre-service science teachers’ SRC: the amount of science education classes, the amount of science classes and the pre-service science teachers’ age. The factors amount of science education classes and amount of science classes have been operationalised in terms of ECTS credit points. N = 438 pre-service science teachers from six universities in Germany, Chile and Canada voluntarily and anonymously responded to an established multiple-choice instrument for assessing SRC, which has been developed by the authors and is available in German, Spanish and English. Multiple linear regression analyses show that the included factors explain a proportion of about 9% of the pre-service science teachers’ SRC. The factor amount of science classes is the only significant predictor and can be seen as an indicator of learning science content knowledge. These findings support the assumption of science content knowledge being a prerequisite for developing pre-service science teachers’ SRC.