19 September 2024 in Expert Systems with Applications
16 November 2023 in IEEE Transactions on Learning Technologies
Higher education is rapidly growing in the online learning landscape. However, current personalized recommendation techniques struggle with precise extraction of complex mathematical semantics, hindering accurate perception of learners' cognitive states and relevance of recommendations. This paper proposes a framework for extracting complex mathematical semantics and providing personalized exercise recommendations. We design a tree-based position encoding method to enhance the accuracy of positional representation for mathematical expressions in pre-trained model, aiming to improve the performance of downstream tasks. We propose an automatic method for extracting knowledge attributes based on expert annotations, enabling interpretable cognitive diagnosis. Furthermore, we employ sequential pattern mining to discover the knowledge usage patterns in exercises, generate learning paths using a multi-layer knowledge graph, and leverage cognitive diagnostic results to enhance the relevance of recommendations. Experimental results show a 2.0% improvement in mathematical symbol embedding on mathematical formula retrieval tasks, and knowledge attribute extraction accuracy ranging from 66.5% to 81.7%. Learners' post-test scores significantly improve during group testing, with good consistency between online cognitive diagnosis and self-diagnosis.
11 June 2025 in Applied Soft Computing
19 June 2025 in IEEE Transactions on Computational Social Systems
To effectively support lifelong learning, personalized e-learning systems aim to provide customized educational services tailored to individual learners’ needs. A crucial aspect for enabling these intelligent services is knowledge tracing, which involves dynamically modeling learners’ knowledge acquisition based on their past learning records. Traditional deep knowledge tracing models primarily focus on learners’ responses and the knowledge components covered in exercises, often neglecting other valuable multimodal learning features. In response to this limitation, our contribution is the introduction of the multimodal knowledge tracing (MMKT) model, which leverages four distinct learning modalities: textual, image, cognitive parametric, and knowledge association modalities. MMKT initially employs a combination of pretrained models and fine-tuning to obtain representations for text and image modalities. Using the EM algorithm, it acquires the cognitive parameter modality for exercises and learners. Subsequently, a multimodal fusion is applied to obtain a comprehensive exercise representation. In the next step, the model explores knowledge impact weights through the knowledge association modality. This information is combined with the cognitive parameter modality of the learner and the hidden states tracked by the gated recurrent unit, resulting in a multimodal representation of the learner’s knowledge state. Experiments conducted on publicly available datasets demonstrate the significant improvement of the proposed MMKT model. The proposed model outperforms the widely used baselines, deep knowledge tracing and dynamic key–value memory networks, achieving relative AUC gains of 3.57% and 6.37%, respectively, in predicting student learning performance. This study provides valuable insights that assist learners in understanding their knowledge mastery and contribute to the realization of lifelong learning from a technical standpoint.
15 April 2025 in Knowledge-Based Systems