22 July 2019 in Journal of Learning Analytics
The value of technology lies not only with the service or functionality of the tool, but also with its subsequent value to the people who use it. New learning analytics (LA) software and platforms for capturing data and improving student learning are frequently introduced; however, they suffer from issues of adoption and continued usage by stakeholders. Scholars have previously suggested that it is not enough to introduce stakeholders (e.g., teachers and students) to LA technologies; they must also be a part of the LA creation and design process. In this paper, we will continue the ongoing work to clarify and compare different approaches of human-centred design through an overview of participatory frameworks in LA (co-design, co-creation). We will also present a case study using an LA tool used and developed within several Australian universities that was utilized over six years as an example of how LA designers can co-create dynamic platforms with teachers. Implications of participatory design frameworks in LA will also be presented through a discussion of the costs, challenges, and benefits of adopting human-centred design.
14 March 2024 in Journal of the Learning Sciences
15 November 2024 in Australasian Journal of Educational Technology
Assessing group work formatively in higher education poses a significant challenge. The complexity of evaluating individual contributions is compounded by the lack of efficient and effective methods for tracking, analysing and assessing individual engagement and contributions, which can impede timely feedback and the development of group work skills. This paper contributes to the growing body of research on collaboration analytics, which focuses on learning analytics (LA) in collaborative settings, and formative assessment while providing practical guidance for educators seeking to enhance formative assessment practices. The potential enhancement lies at the intersection between analytics technology and assessment design. In this paper, we present a conceptual framework that can harness multimodal data collection as well as LA to formatively assess and provide feedback on individual engagement and contributions to group work across physical and digital spaces. Drawing on research that considers design for learning, conjecture mapping, assessment design, multimodal LA and feedback, we outline a structured approach to developing formative assessment of group work skills in collaborative projects and higher education contexts. Implications for practice or policy: Practical guidance is provided for educators to enhance formative assessment practices with LA. The integrated framework and process offers a guide for formative assessment in group work scenarios, providing tools for monitoring student progress, informing pedagogical decision-making and enhancing learning experiences. The integration of the activity-centred analysis and design framework and LA allows educators to harness the power of both data-driven decision-making and learner-centred pedagogical approaches to better support learner development in group work settings.
21 March 2025 in Journal of Higher Education Policy and Management
6 November 2024 in Research in Science Education