Research and development in learning analytics has established viable solutions for scaling personalised feedback to all students. However, questions remain regarding how such feedback is perceived, interpreted and acted upon by stakeholders. The present study reports on the analysis of focus group data from four courses to understand students’ sensemaking of personalised, learning analytics-based feedback. Deductive analysis and epistemic network analysis were carried out to identify students’ perceptions and associated emotional responses to the feedback. The results demonstrate that students mostly held positive perceptions of their feedback – especially in regard to quality, task-focus and instructor care. While emotions to feedback were often negative, students also noted this increased their motivation to invest more effort in the learning tasks. The results of the study provide further evidence of the interpersonal communication variables influencing students’ proactive recipience of feedback. Importantly, the findings show that students were mostly actively engaged with their personalised feedback, and that the instructor-mediated approach to feedback based on learning analytics is aligned to the principles of effective feedback.
23 December 2020 in Australasian Journal of Educational Technology
Although technological advances have brought about new opportunities for scaling feedback to students, there remain challenges in how such feedback is presented and interpreted. There is a need to better understand how students make sense of such feedback to adapt self-regulated learning processes. This study examined students’ sense-making of learning analytics–based personalised feedback across four courses. Results from a combination of thematic analysis and epistemic network analysis show an association between student perceptions of their personalised feedback and how these map to subsequent self-described self-regulated learning processes. Most notably, the results indicate that personalised feedback, elaborated by personal messages from course instructors, helps students refine or strengthen important forethought processes of goal-setting, as well as to reduce procrastination. The results highlight the need for instructors to increase the dialogic element in personalised feedback in order to reduce defensive reactions from students who hold to their own learning strategies. This approach may prompt reflection on the suitability of students’ current learning strategies and achievement of associated learning goals. Implications for practice or policy: Personalised feedback based on learning analytics should be informed by an understanding of students’ self-regulated learning. Instructors implementing personalised feedback should align this closely with the course curriculum. Instructors implementing personalised feedback in their courses should consider the relational element of feedback by using a positive tone. Personalised feedback can be further enhanced by increasing the dialogic element and by including more information about learning strategies.
Effective learning depends on effective feedback, which in turn requires a set of skills, dispositions and practices on the part of both students and teachers which have been termed feedback literacy. A previously published teacher feedback literacy competency framework has identified what is needed by teachers to implement feedback well. While this framework refers in broad terms to the potential uses of educational technologies, it does not examine in detail the new possibilities of automated feedback (AF) tools, especially those that are open by offering varying degrees of transparency and control to teachers. Using analytics and artificial intelligence, open AF tools permit automated processing and feedback with a speed, precision and scale that exceeds that of humans. This raises important questions about how human and machine feedback can be combined optimally and what is now required of teachers to use such tools skillfully. The paper addresses two research questions: Which teacher feedback competencies are necessary for the skilled use of open AF tools? and What does the skilled use of open AF tools add to our conceptions of teacher feedback competencies? We conduct an analysis of published evidence concerning teachers’ use of open AF tools through the lens of teacher feedback literacy, which produces summary matrices revealing relative strengths and weaknesses in the literature, and the relevance of the feedback literacy framework. We conclude firstly, that when used effectively, open AF tools exercise a range of teacher feedback competencies. The paper thus offers a detailed account of the nature of teachers’ feedback literacy practices within this context. Secondly, this analysis reveals gaps in the literature, signalling opportunities for future work. Thirdly, we propose several examples of automated feedback literacy, that is, distinctive teacher competencies linked to the skilled use of open AF tools.