It has been widely documented that accountability systems, including school inspections, bring with them unintended side effects. These unintended effects are often negative and have the potential to undo the intended positive effects. However the empirical evidence is limited. Through a European comparative study we have had the rare opportunity to collect empirical evidence and study the effects (both intended and unintended) of school inspections (a key system of accountability) in a systematic way, across seven countries. We present the findings of the unintended effects in this paper. Survey self-report responses from school principals in each country, with differing school inspection systems, are analysed to measure the prevalence of these unintended effects and to investigate the part played by pressure to do well in inspections. A key finding is that increasing pressure in school inspection systems is associated with the undesired effect of the narrowing and refocusing of the curriculum and instructional strategies. We also show that a proportion of school principals admit to misrepresenting the school in data sent to the inspectorate and show evidence for formalisation/proceduralisation (excessive focus on records) and ossification (fear of experimentation in teaching), although these factors are less related to changes in pressure.
Because negative findings have less chance of getting published, available studies tend to be a biased sample. This leads to an inflation of effect size estimates to an unknown degree. To see how meta-analyses in education account for publication bias, we surveyed all meta-analyses published in the last five years in the Review of Educational Research and Educational Research Review. The results show that meta-analyses usually neglect publication bias adjustment. In the minority of meta-analyses adjusting for bias, mostly non-principled adjustment methods were used, and only rarely were the conclusions based on corrected estimates, rendering the adjustment inconsequential. It is argued that appropriate state-of-the-art adjustment (e.g., selection models) should be attempted by default, yet one needs to take into account the uncertainty inherent in any meta-analytic inference under bias. We conclude by providing practical recommendations on dealing with publication bias.
Educational effectiveness research has provided evidence about the importance of teacher beliefs and attitudes for teaching and learning. This study builds on the concept of academic optimism, which combines 3 aspects of a teacher’s professional creed: self-efficacy, trust, and academic emphasis. The study explores the functioning of the collective and individual measures of academic optimism in the Czech environment and studies its impact on students’ outcomes. The analyses are based on pilot data from 39 schools, 325 teachers, and 1,316 Grade 9 students and on the data from the Czech Longitudinal Study in Education (CLoSE), covering 163 schools, 1,469 teachers, and 4,798 students. The individual measure was selected for further studies based on 2-level confirmatory factor analysis. Two-level structural equation modelling showed a significant impact of a school’s academic optimism on students’ achievement even after controlling for prior achievement and socioeconomic status at both the student and the school level.
26 August 2016 in International Studies in Sociology of Education
The Czech education system is characterised by early tracking and high educational inequalities. The most controversial element of the system is the academic track, which is attended by students after the completion of primary school. The paper focuses on fifth graders’ application process and their success in entrance examinations. The process is examined by binary logistic regression and descriptive analyses of the data collected in the Trends in International Mathematics and Science Study conducted in 2011 in grade 4, and in a survey of students attending grade 5 implemented on the same sample within the Czech Longitudinal Study in Education. The analyses show that students’ family background has a significant effect on both application and success during admission procedures. The paper discusses the role of the family in the application process and in preparation for the entrance examinations, and compares the situation in the Czech Republic with that in other countries.