This paper presents a systematic literature review of learning analytics dashboards (LADs) research that reports empirical findings to assess the impact on learning and teaching. Several previous literature reviews identified self-regulated learning as a primary focus of LADs. However, there has been much less understanding how learning analytics are grounded in the literature on self-regulated learning and how self-regulated learning is supported. To address this limitation, this review analyzed the existing empirical studies on LADs based on the well-known model of self-regulated learning proposed by Winne and Hadwin. The results show that existing LADs i) are rarely grounded in learning theory; ii) cannot be suggested to support metacognition; iii) do not offer any information about effective learning tactics and strategies; and iv) have significant limitations in how their evaluation is conducted and reported. Based on the findings of the study and through the synthesis of the literature, the paper proposes that future research and development should not make any a priori design decisions about representation of data and analytic results in learning analytics systems such as LADs. To formalize this proposal, the paper defines the model for user-centered learning analytics systems (MULAS). MULAS consists of the four dimensions that are cyclically and recursively inter-connected including: theory, design, feedback, and evaluation.
10 October 2019 in Journal of Computer Assisted Learning
Generalizability of the value of methods based on learning analytics remains one of the big challenges in the field of learning analytics. One approach to testing generalizability of a method is to apply it consistently in different learning contexts. This study extends a previously published work by examining the generalizability of a learning analytics method proposed for detecting learning tactics and strategies from trace data. The method was applied to the datasets collected in three different course designs and delivery modalities, including flipped classroom, blended learning, and massive open online course. The proposed method combines process mining and sequence analysis. The detected learning strategies are explored in terms of their association with academic performance. The results indicate the applicability of the proposed method across different learning contexts. Moreover, the findings contribute to the understanding of the learning tactics and strategies identified in the trace data: learning tactics proved to be responsive to the course design, whereas learning strategies were found to be more sensitive to the delivery modalities than to the course design. These findings, well aligned with self-regulated learning theory, highlight the association of learning contexts with the choice of learning tactics and strategies.
Preparatory learning tasks are considered critical for student success in flipped classroom courses. However, less is known regarding which learning strategies students use and when they use those strategies in a flipped classroom course. In this study, we aimed to address this research gap. In particular, we investigated mutual connections between learning strategies and time management, and their combined effects on students’ performance in flipped classrooms. To this end, we harnessed a network analytic approach based on epistemic network analysis (ENA) to analyze student trace data collected in an undergraduate engineering course (N = 290) with a flipped classroom design. Our findings suggest that high-performing students effectively used their study time and enacted learning strategies mainly linked to formative and summative assessment tasks. The students in the low-performing group enacted less diverse learning strategies and typically focused on video watching. We discuss several implications for research and instructional practice.