30 November 2021 in PLOS ONE
Evidence-based teaching practices are associated with improved student academic performance. However, these practices encompass a wide range of activities and determining which type, intensity or duration of activity is effective at improving student exam performance has been elusive. To address this shortcoming, we used a previously validated classroom observation tool, Practical Observation Rubric to Assess Active Learning (PORTAAL) to measure the presence, intensity, and duration of evidence-based teaching practices in a retrospective study of upper and lower division biology courses. We determined the cognitive challenge of exams by categorizing all exam questions obtained from the courses using Bloom’s Taxonomy of Cognitive Domains. We used structural equation modeling to correlate the PORTAAL practices with exam performance while controlling for cognitive challenge of exams, students’ GPA at start of the term, and students’ demographic factors. Small group activities, randomly calling on students or groups to answer questions, explaining alternative answers, and total time students were thinking, working with others or answering questions had positive correlations with exam performance. On exams at higher Bloom’s levels, students explaining the reasoning underlying their answers, students working alone, and receiving positive feedback from the instructor also correlated with increased exam performance. Our study is the first to demonstrate a correlation between the intensity or duration of evidence-based PORTAAL practices and student exam performance while controlling for Bloom’s level of exams, as well as looking more specifically at which practices correlate with performance on exams at low and high Bloom’s levels. This level of detail will provide valuable insights for faculty as they prioritize changes to their teaching. As we found that multiple PORTAAL practices had a positive association with exam performance, it may be encouraging for instructors to realize that there are many ways to benefit students’ learning by incorporating these evidence-based teaching practices.
30 May 2024 in To Improve the Academy: A Journal of Educational Development
We sought to identify which aspects of our professional development program, the Consortium for the Advancement of Undergraduate STEM Education (CAUSE), were most useful for the participants. CAUSE was designed to support STEM faculty as they implement evidence-based teaching practices. We interviewed six faculty participants (Fellows) to address two questions: (1) Which aspects of CAUSE were useful for participants? and (2) What factors influenced implementation of evidencebased teaching? We conducted a qualitative thematic analysis of the interviews by iteratively coding the transcripts and organizing final codes into themes. We found five themes. Two themes addressed the social and educational value CAUSE offered. Fellows valued curated references with empirical evidence of the impact of teaching practices on student learning and valued the strong social support from interacting with a consistent cohort of faculty over time. Three themes identified factors that influenced faculty to implement evidence-based teaching. Fellows explained that class context and their teaching experience or motivation influenced how they implemented teaching practices. A final theme showed Fellows’ strong concern and respect for students as partners in the learning process during their journey of change. Our qualitative analysis of faculty interviews found that change is a complex process that is as varied as the individuals engaging in change.