Complex thinking is a desired competency in 21st-century university students, so technology-based teaching and learning strategies must be carefully considered when training them in complex reasoning skills. This systematic review aims to map research on the use of teaching and learning strategies supported by technology to enhance complex thinking skills in university students. This review reports results according to PRISMA (preferred reporting items for systematic reviews and meta-analyses) guidelines. The search strategy was performed in June 2022 in Scopus and Web of Science databases. Of 151 records initially identified between 2018 and 2022, 32 papers were included in the final synthesis per the inclusion and exclusion criteria. The results of this review indicate that (1) tech-based strategies for complex thinking development are based on active learning approaches including problem-based learning, case-based learning, collaboration-driven and discussion-based learning, project-based learning, assessment- and feedback-oriented activities, and mind mapping techniques; (2) most of the documented strategies were implemented in hybrid contexts; (3) traditional instructional materials commonly used for promoting higher order thinking skills such as reading assignments, videos, and eliciting/reflexive questions are still effective in fostering complex thinking when delivered through technology; and (4) custom-built technological development for complex thinking development software that incorporates emerging technologies is scarce at present. Further research is needed to document the interventions that train students interactively in complex thinking skills using Education 4.0 technologies.
This article aims to study open education competency data through machine learning models to determine whether models can be built on decision rules using the features from the students' perceptions and classify them by the level of competency. Data was collected from a convenience sample of 326 students from 26 countries using the eOpen instrument. Based on a quantitative research approach, we analyzed the eOpen data using two machine learning models considering these findings: 1) derivation of decision rules from students' perceptions of knowledge, skills, and attitudes or values related to open education to predict their competence level using Decision Trees and Random Forests models, 2) analysis of the prediction errors in the machine learning models to find bias, and 3) description of decision trees from the machine learning models to understand the choices that both models made to predict the competency levels. The results confirmed our hypothesis that the students' perceptions of their knowledge, skills, and attitudes or values related to open education and its sub-competencies produced satisfactory data for building machine learning models to predict the participants' competency levels.
13 June 2023 in Education and Information Technologies
This article aims to study machine learning models to determine their performance in classifying students by gender based on their perception of complex thinking competency. Data were collected from a convenience sample of 605 students from a private university in Mexico with the eComplexity instrument. In this study, we consider the following data analyses: 1) predict students’ gender based on their perception of complex thinking competency and sub-competencies from a 25 items questionnaire, 2) analyze models’ performance during training and testing stages, and 3) study the models’ prediction bias through a confusion matrix analysis. Our results confirm the hypothesis that the four machine learning models (Random Forest, Support Vector Machines, Multi-layer Perception, and One-Dimensional Convolutional Neural Network) can find sufficient differences in the eComplexity data to classify correctly up to 96.94% and 82.14% of the students’ gender in the training and testing stage, respectively. The confusion matrix analysis revealed partiality in gender prediction among all machine learning models, even though we have applied an oversampling method to reduce the imbalance dataset. It showed that the most frequent error was to predict Male students as Female class. This paper provides empirical support for analyzing perception data through machine learning models in survey research. This work proposed a novel educational practice based on developing complex thinking competency and machine learning models to facilitate educational itineraries adapted to the training needs of each group to reduce social gaps existing due to gender.
29 November 2023 in IEEE Transactions on Learning Technologies
This article aims to study the performance of machine learning models in forecasting gender based on the students' open education competency perception. Data were collected from a convenience sample of 326 students from 26 countries using the eOpen instrument. The analysis comprises 1) a study of the students' perceptions of knowledge, skills, and attitudes or values related to open education and its sub-competencies from a 30-item questionnaire using machine learning models to forecast participants' gender, 2) validation of performance through cross-validation methods, 3) statistical analysis to find significant differences between machine learning models, and 4) an analysis from explainable machine learning models to find relevant features to forecast gender. The results confirm our hypothesis that the performance of machine learning models can effectively forecast gender based on the student's perceptions of knowledge, skills, and attitudes or values related to open education competency.
The rapid integration of computational thinking (CT) into STEM education highlights its importance as a critical skill for problem-solving in the digital age, equipping students with the cognitive tools needed to address complex challenges systematically. This study evaluates CT skills among Engineering and Computer Science students using a multi-method approach by combining quantitative methods (CTT scores and CTS responses) with qualitative methods (thematic analysis of open-ended questions), integrating objective assessments, self-perception scales, and qualitative insights. The Computational Thinking Test (CTT) measures proficiency in core CT sub-competencies, abstraction, decomposition, algorithmic thinking, and pattern recognition through objective tests. The Computational Thinking Scale (CTS) captures students’ perceived CT skills. At the same time, open-ended questions elicit perspectives on the practical applications of CT in academic and professional contexts. Data from 196 students across two Mexican universities were analyzed through quantitative and thematic methods. The results show that students excel in pattern recognition and abstraction but face decomposition and algorithmic thinking challenges. Cross-sectional analyses were conducted between CTT, CTS and the open-ended part to compare CT skills across different demographic groups (e.g., age, gender, academic disciplines), showing clear differences based on age, gender, and academic disciplines, with Computer Science students performing better than engineering students. These findings highlight the importance of CT in preparing students for modern challenges and provide a foundation for improving teaching methods and integrating these skills into university programs.
3 August 2023 in International Journal of Science Education