Multimodal emotion recognition aims to identify emotions by integrating multimodal features derived from spoken utterances. However, existing work often neglects the calibration of conversational entities, focusing mainly on extracting potential intra- or cross-modal information. This leads to the underutilization of utterance information that is essential for accurately characterizing emotion. Additionally, the lack of effective modeling of conversational patterns limits the ability to capture emotional pathways across contexts, modalities and speakers, impacting the overall emotional understanding. In this study, we propose the modality-calibrated hypergraph fusion network (MATCH), which leverages multimodal fusion and hypergraph learning techniques to address these challenges. In particular, we introduce an entity calibration strategy that refines the representations of conversational entities both at the modality and context levels, allowing for deeper insights into emotion-related cues. Furthermore, we present an emotion-aligned hypergraph fusion method that incorporates a line graph to explore conversational patterns, facilitating flexible knowledge transfer across modalities through hyperedge-level and graph-level alignments. Experiments demonstrate that MATCH outperforms state-of-the-art approaches on two benchmark datasets.
The ability to communicate effectively in writing and produce clear and cohesive text is a necessary skill in both educational settings and the workplace, yet many young students struggle to organize their thoughts and engage in deep thinking. To address these challenges, an augmented reality (AR) application titled “Explore Wild Animals” has been used to help students organize information; however, it may not accommodate different cognitive styles. Integrating formative peer assessment (FPA) strategy into AR-based instruction can enhance knowledge construction and address diverse cognitive needs. This study, conducted from May to June 2023, empirically investigates the effects of FPA in an AR environment on the writing performance of learners with field-independent (FI) and field-dependent (FD) cognitive styles. A total of 89 fifth-grade pupils from China were randomly assigned to two groups: one group adopting FPA in an AR environment (AR-FPA), and the other group adopting FPA in a conventional PowerPoint (PPT) version 2410 environment (FPA). The results of a two-way analysis of covariance (ANCOVA) indicate that the AR-FPA group outperformed the FPA group in writing performance. Specifically, FI learners benefitted more from the AR-FPA approach, while FD learners performed better with the FPA approach. However, multiple linear regression analysis reveals that the peer feedback quality and features showed little to no significant correlation with feedback providers’ writing performance, regardless of cognitive style. These results highlight the effectiveness of integrating AR and FPA in enhancing educational outcomes, providing practical insights for promoting the sustainability of technology-enhanced learning and teaching practices.
In the competitive landscape of online learning, developing robust and effective learning resource recommendation systems is paramount, yet the field faces challenges due to high-dimensional, sparse matrices and intricate user–resource interactions. Our study focuses on geometric matrix completion (GMC) and introduces a novel approach, graph-based truncated norm regularization (GBTNR) for problem solving. GBTNR innovatively incorporates truncated Dirichlet norms for both user and item graphs, enhancing the model’s ability to handle complex data structures. This method synergistically combines the benefits of truncated norm regularization with the insightful analysis of user–user and resource–resource graph relationships, leading to a significant improvement in recommendation performance. Our model’s unique application of truncated Dirichlet norms distinctively positions it to address the inherent complexities in user and item data structures more effectively than existing methods. By bridging the gap between theoretical robustness and practical applicability, the GBTNR approach offers a substantial leap forward in the field of learning resource recommendations. This advancement is particularly critical in the realm of online education, where understanding and adapting to diverse and intricate user–resource interactions is key to developing truly personalized learning experiences. Moreover, our work includes a thorough theoretical analysis, complete with proofs, to establish the convergence property of the GMC-GBTNR model, thus reinforcing its reliability and effectiveness in practical applications. Empirical validation through extensive experiments on diverse real-world datasets affirms the model’s superior performance over existing methods, marking a groundbreaking advancement in personalized education and deepening our understanding of the dynamics in learner–resource interactions.