Transferring knowledge from one domain to another has gained a lot of attention among scientists in recent years. Transfer learning is a machine learning approach aiming to exploit the knowledge retrieved from one problem for improving the predictive performance of a learning model for a different but related problem. This is particularly the case when there is a lack of data regarding a problem, but there is plenty of data about another related one. To this end, the present study intends to investigate the effectiveness of transfer learning from deep neural networks for the task of students’ performance prediction in higher education. Since building predictive models in the Educational Data Mining field through transfer learning methods has been poorly studied so far, we consider this study as an important step in this direction. Therefore, a plethora of experiments were conducted based on data originating from five compulsory courses of two undergraduate programs. The experimental results demonstrate that the prognosis of students at risk of failure can be achieved with satisfactory accuracy in most cases, provided that datasets of students who have attended other related courses are available.
Educational Data Mining (EDM) has emerged over the last two decades, concerning with the development and implementation of data mining methods in order to facilitate the analysis of vast amounts of data originating from a wide variety of educational contexts. Predicting students’ progression and learning outcomes, such as dropout, performance and course grades, is regarded among the most important tasks of the EDM field. Therefore, applying appropriate machine learning algorithms for building accurate predictive models is of outmost importance for both educators and data scientists. Considering the high-dimensional input space and the complexity of machine learning algorithms, the process of building accurate and robust learning models requires advanced data science skills, while is time-consuming and error-prone in most cases. In addition, choosing the proper method for a given problem formulation and configuring the optimal parameters’ values for a specific model is a demanding task, whilst it is often very difficult to understand and explain the produced results. In this context, the main purpose of the present study is to examine the potential use of advanced machine learning strategies on educational settings from the perspective of hyperparameter optimization. More specifically, we investigate the effectiveness of automated Machine Learning (autoML) for the task of predicting students’ learning outcomes based on their participation in online learning platforms. At the same time, we limit the search space to tree-based and rule-based models in order to achieving transparent and interpretable results. To this end, a plethora of experiments were carried out, revealing that autoML tools achieve consistently superior results. Hopefully our work will help nonexpert users (e.g., educators and instructors) in the field of EDM to conduct experiments with appropriate automated parameter configurations, thus achieving highly accurate and comprehensible results.
12 May 2021 in Journal of Computing in Higher Education
Student performance prediction is a critical research challenge in the field of educational data mining. To address this issue, various machine learning methods have been employed with significant success, including instance-based algorithms, decision trees, neural networks, and ensemble methods, among others. In this study, we introduce an innovative approach that leverages the Regularized Greedy Forest (RGF) algorithm within an active learning framework to enhance student performance prediction. Active learning is a powerful paradigm that utilizes both labeled and unlabeled data, while RGF serves as an effective decision forest learning algorithm acting as the base learner. This synergy aims to improve the predictive performance of the model while minimizing the labeling effort, making the approach both efficient and scalable. Moreover, applying the active learning framework for predicting student performance focuses on the early and accurate identification of students at risk of failure. This enables targeted interventions and personalized learning strategies to support low-performing students and improve their outcomes. The experimental results demonstrate the potential of our proposed approach as it outperforms well-established supervised methods using a limited pool of labeled examples, achieving an accuracy of 81.60%.