For various reasons, students receive less formative feedback at post-secondary institutions compared to secondary school. Considering feedback as one of the most important influencing factors on learning processes, formative feedback is a promising approach to improving students’ performances. In this context, new technologies, such as learning management systems (LMS) or intelligent tutoring systems (ITS), can make a valuable contribution to improving higher education teaching by providing automated and individualized error-specific just-in-time (JIT) feedback. However, the digitalization especially of paper-based open-ended tasks that can be used by LMS is currently still associated with a loss of quality. In this paper, we present an approach that allows us to transfer open-ended paper-based tasks in the field of chemistry into online tasks without losing quality and provide large university courses with automated and individualized error-specific JIT feedback. Results of a study of 238 first-year chemistry students reveal that the automated individualized error-specific JIT feedback had a significant positive influence on students’ performance.
Cognitive load studies are mostly centered on information on perceived cognitive load. Single-item subjective rating scales are the dominant measurement practice to investigate overall cognitive load. Usually, either invested mental effort or perceived task difficulty is used as an overall cognitive load measure. However, the extent to which the results of these two single-items differ has not yet been sufficiently investigated. Although subjective rating scales are widely used, they are criticized and questioned as their validity is doubted. This study examines construct validity of both cognitive load rating scales (invested mental effort, perceived task difficulty) using relative task difficulty and task demands (cognitive processes and availability of possible answer options) as criteria, adds further evidence supporting the validity of single-item subjective ratings as an indicator for overall cognitive load, and shows how ratings of cognitive load differ when the invested mental effort or the perceived task difficulty item is used. The results indicate that self-ratings might be influenced by the availability of possible answer options as well as cognitive processes necessary to work on a task. The findings also confirm the idea that self-ratings for perceived task difficulty and invested mental effort do not measure the same but different aspects of overall cognitive load. Furthermore, our findings clearly advise to precisely examine at which point and how frequently cognitive load is measured as delayed ratings are closely related to more demanding items within a set of items. Considering advantages of single-item subjective ratings (easy to implement even in huge samples, low time exposure, and suitableness for repeated measures) and disadvantages of alternative ways to measure cognitive load (regarding cost and time efficiency and problem of additional load), current results confirm the use of these items to get an impression of the overall cognitive load. However, the results also suggest that both items do not measure the same thing and researchers should therefore discuss carefully which item they use and how this may limit the results of their study.
Including motivational variables such as interest in the cognitive load framework is an ongoing process. Of particular interest is the question of how motivational variables influence the investment of mental effort. In this study, we investigated how topic interest affects the investment of mental effort in simple tasks. A total of 1543 students’ judgments regarding invested mental effort, perceived task difficulty, and topic interest for 32 tasks of a chemistry test were analyzed at the task level based on item response theory parameters. Additionally, objective task difficulty was calculated. The Rasch parameters were used for correlation and moderated regression analyses. The results indicated that when perceived task difficulty was low, students invested more mental effort in solving tasks of low topic interest compared to tasks of high topic interest. With increasing perceived task difficulty, the amount of invested mental effort rose for tasks of low as well as high topic interest. However, the difference between tasks of low and high topic interest in the amount of invested mental effort decreased as perceived task difficulty increased and even vanished when perceived task difficulty roughly corresponded to students’ performance capability. These results are in line with flow theory and the expectancy-value-cost model of motivation. When solving tasks that match their performance capability, students can experience a flow situation. However, when solving rather easy tasks of low interest, students can experience motivational costs in terms of additional effort, such as an increased need for motivational self-regulation. The results of this study provide a basis for systematically investigating and better understanding the relationship between interest, task difficulty, invested mental effort, flow experience, and emotional costs.
22 September 2024 in International Journal of Science Education