13 May 2024 in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Ambient classroom sensing systems offer a scalable and non-intrusive way to find connections between instructor actions and student behaviors, creating data that can improve teaching and learning. While these systems effectively provide aggregate data, getting reliable individual student-level information is difficult due to occlusion or movements. Individual data can help in understanding equitable student participation, but it requires identifiable data or individual instrumentation. We propose ClassID, a data attribution method for within a class session and across multiple sessions of a course without these constraints. For within-session, our approach assigns unique identifiers to 98% of students with 95% accuracy. It significantly reduces multiple ID assignments compared to the baseline approach (3 vs. 167) based on our testing on data from 15 classroom sessions. For across-session attributions, our approach, combined with student attendance, shows higher precision than the state-of-the-art approach (85% vs. 44%) on three courses. Finally, we present a set of four use cases to demonstrate how individual behavior attribution can enable a rich set of learning analytics, which is not possible with aggregate data alone.
16 September 2024 in ACM Journal on Computing and Sustainable Societies
Communities of practice can improve teachers’ professional development through informal in-person discussions among community members. However, infrastructural challenges pose difficulties in fostering in-person connections, particularly in rural communities in the Global South. The emergence of social media and chatbots has presented an avenue for creating virtual communities for teachers, especially those in rural areas. An unanswered question is the potential impact of a chatbot-supported virtual teacher community on teachers’ professional development. To answer this question, we conducted a longitudinal quasi-experiment involving 313 teachers participating in a new training program in rural Côte d’Ivoire by deploying a chatbot on Facebook Messenger. Our experiment had two chatbot versions for two regions, i.e., one version supporting virtual community and one control. Our findings indicate that teachers in the virtual community condition exhibited modest enhancements in motivation and knowledge indicators. We make a case for implementing virtual communities of practice facilitated by chatbots to bolster the professional development of teachers in rural African contexts.
4 August 2024 in Journal of Learning Analytics
Classroom sensing systems can capture data on teacher-student behaviours and interactions at a scale far greater than human observers can. These data, translated to multi-modal analytics, can provide meaningful insights to educational stakeholders. However, complex data can be difficult to make sense of. In addition, analyses done on these data are often limited by the organization of the underlying sensing system, and translating sensing data into meaningful insights often requires custom analyses across different modalities. We present Edulyze, an analytics engine that processes complex, multi-modal sensing data and translates them into a unified schema that is agnostic to the underlying sensing system or classroom configuration. We evaluate Edulyze’s performance by integrating three sensing systems (Edusense, ClassGaze, and Moodoo) and then present data analyses of five case studies of relevant pedagogical research questions across these sensing systems. We demonstrate how Edulyze’s flexibility and customizability allow us to answer a broad range of research questions made possible by Edulyze’s translation of a breadth of raw sensing data from different sensing systems into relevant classroom analytics.