7 July 2016 in Educational Administration Quarterly
Purpose: New teacher evaluation systems have expanded the role of principals as instructional leaders, but little is known about principals’ ability to promote teacher development through the evaluation process. We conducted a case study of principals’ perspectives on evaluation and their experiences implementing observation and feedback cycles to better understand whether principals feel as though they are able to promote teacher development as evaluators. Research Method: We conducted interviews with a stratified random sample of 24 principals in an urban district that recently implemented major reforms to its teacher evaluation system. We analyzed these interviews by drafting thematic summaries, coding interview transcripts, creating data-analytic matrices, and writing analytic memos. Findings: We found that the evaluation reforms provided a common framework and language that helped facilitate principals’ feedback conversations with teachers. However, we also found that tasking principals with primary responsibility for conducting evaluations resulted in a variety of unintended consequences which undercut the quality of evaluation feedback they provided. We analyze five broad solutions to these challenges: strategically targeting evaluations, reducing operational responsibilities, providing principal training, hiring instructional coaches, and developing peer evaluation systems. Implications: The quality of feedback teachers receive through the evaluation process depends critically on the time and training evaluators have to provide individualized and actionable feedback. Districts that task principals with primary responsibility for conducting observation and feedback cycles must attend to the many implementation challenges associated with this approach in order for next-generation evaluation systems to successfully promote teacher development.
1 June 2017 in Educational Researcher
In 2009, the New Teacher Project’s The Widget Effect documented the failure of U.S. public school districts to recognize and act on differences in teacher effectiveness. We revisit these findings by compiling teacher performance ratings across 24 states that adopted major reforms to their teacher evaluation systems. In the vast majority of these states, the percentage of teachers rated unsatisfactory remains less than 1%. However, the full distributions of ratings vary widely across states, with 0.7% to 28.7% rated below proficient and 6% to 62% rated above proficient. We present original survey data from an urban district illustrating that evaluators perceive more than 3 times as many teachers in their schools to be below proficient than they rate as such. Interviews with principals reveal several potential explanations for these patterns.
14 September 2018 in Exceptional Children
Federal policies have aimed to improve access to grade-level curriculum for students with disabilities (SWD). Current conceptualizations of access posit that it is evidenced by students’ academic outcomes. In a meta-analysis of 180 effect sizes from 23 studies, we examined access as outcomes by estimating the size of the gap in reading achievement between students with and without disabilities. Findings indicated that SWDs performed 1.17 standard deviations, or more than 3 years, below typically developing peers. The reading gap varied by disability label but not by other student and assessment characteristics. We discuss implications for access to grade-level curriculum and potential reasons for why the achievement gap is so large despite existing policies.
1 July 2020 in Journal of Educational Psychology
9 July 2018 in Reading and Writing
29 July 2020 in Journal of Positive Behavior Interventions
Self-monitoring is one of the most widely used and widely researched strategies for improving student behavior. However, specific research-based guidance about how to design effective self-monitoring interventions and to whom they should be delivered does not yet exist. To this end, we examined how various treatment components and participant characteristics moderated response to self-monitoring interventions. We included 66 single-case studies on academic engagement and 21 single-case studies on disruptive behavior. These studies included 290 participants with challenging behavior, 183 of whom had a disability. After extracting raw data from original studies, we analyzed data using multilevel modeling for each dependent variable (i.e., academic engagement, disruptive behavior). Across both dependent variables, student age and educational setting impacted treatment effects, as did the inclusion of goal-setting, feedback, and reinforcement. Based on our findings, we describe implications related to designing self-monitoring interventions. We also discuss limitations and future directions.