Cognitive load studies are mostly centered on information on perceived cognitive load. Single-item subjective rating scales are the dominant measurement practice to investigate overall cognitive load. Usually, either invested mental effort or perceived task difficulty is used as an overall cognitive load measure. However, the extent to which the results of these two single-items differ has not yet been sufficiently investigated. Although subjective rating scales are widely used, they are criticized and questioned as their validity is doubted. This study examines construct validity of both cognitive load rating scales (invested mental effort, perceived task difficulty) using relative task difficulty and task demands (cognitive processes and availability of possible answer options) as criteria, adds further evidence supporting the validity of single-item subjective ratings as an indicator for overall cognitive load, and shows how ratings of cognitive load differ when the invested mental effort or the perceived task difficulty item is used. The results indicate that self-ratings might be influenced by the availability of possible answer options as well as cognitive processes necessary to work on a task. The findings also confirm the idea that self-ratings for perceived task difficulty and invested mental effort do not measure the same but different aspects of overall cognitive load. Furthermore, our findings clearly advise to precisely examine at which point and how frequently cognitive load is measured as delayed ratings are closely related to more demanding items within a set of items. Considering advantages of single-item subjective ratings (easy to implement even in huge samples, low time exposure, and suitableness for repeated measures) and disadvantages of alternative ways to measure cognitive load (regarding cost and time efficiency and problem of additional load), current results confirm the use of these items to get an impression of the overall cognitive load. However, the results also suggest that both items do not measure the same thing and researchers should therefore discuss carefully which item they use and how this may limit the results of their study.
Including motivational variables such as interest in the cognitive load framework is an ongoing process. Of particular interest is the question of how motivational variables influence the investment of mental effort. In this study, we investigated how topic interest affects the investment of mental effort in simple tasks. A total of 1543 students’ judgments regarding invested mental effort, perceived task difficulty, and topic interest for 32 tasks of a chemistry test were analyzed at the task level based on item response theory parameters. Additionally, objective task difficulty was calculated. The Rasch parameters were used for correlation and moderated regression analyses. The results indicated that when perceived task difficulty was low, students invested more mental effort in solving tasks of low topic interest compared to tasks of high topic interest. With increasing perceived task difficulty, the amount of invested mental effort rose for tasks of low as well as high topic interest. However, the difference between tasks of low and high topic interest in the amount of invested mental effort decreased as perceived task difficulty increased and even vanished when perceived task difficulty roughly corresponded to students’ performance capability. These results are in line with flow theory and the expectancy-value-cost model of motivation. When solving tasks that match their performance capability, students can experience a flow situation. However, when solving rather easy tasks of low interest, students can experience motivational costs in terms of additional effort, such as an increased need for motivational self-regulation. The results of this study provide a basis for systematically investigating and better understanding the relationship between interest, task difficulty, invested mental effort, flow experience, and emotional costs.
A convincing e-learning system for higher education should offer adequate usability and not add unnecessary (extraneous) cognitive load. It should allow teachers to switch easily from traditional teaching to flipped classrooms to provide students with more opportunities to learn and receive immediate feedback. However, an efficient e-learning and technology-enhanced assessment tool that allows generating digital organic chemistry tasks is yet to be created. The Universities of Bonn and Duisburg-Essen are currently developing and evaluating an e-learning and technology-enhanced assessment tool for organic chemistry. This study compares the effectiveness of traditional paper-pencil-based and digital molecule-drawing tasks in terms of student performance, cognitive load, and usability—factors that all contribute to learning outcomes. Rasch analysis, t-tests, and correlation analyses were used for evaluation, revealing that the developed system can generate digital organic chemistry tasks. Students performed equally well on simple digital and paper-pencil molecule-drawing tasks when they received an appropriate introduction to the digital tool. However, using the digital tool in two of three studies imposes a higher extraneous cognitive load than using paper and pencil. Nevertheless, the students rated the tool as sufficiently usable. A significant negative correlation between extraneous load and tool usability was found, suggesting room for improvement. We are currently concentrating on augmenting the functionality of the new e-learning tool to increase its potential for automatic feedback, even for complex tasks such as reaction mechanisms.
Systematic analyses of repeated measures of cognitive load during realistic, complex learning tasks are still lacking. Previous findings are based on simulations and the use of a set of multiple short problem-solving tasks. For the present study, lower secondary level pupils ( N = 360) worked on three worked examples on the topic of acids in their chemistry lessons. Cognitive load (invested mental effort and perceived task difficulty), interest, and self-assessed understanding were measured at seven points during the completion of each example. The study examines differences between repeated measures of cognitive load and interest and the relationship between the variables. The results show that the values of the repeated measures differ significantly and are poorly represented by the mean value across the measurement points. In addition, the pairwise relationship between the variables (invested effort, perceived task difficulty, interest, and self-assessed understanding) is not constant at different measurement points. Further analyses also show that different intervention conditions during the learning phase and prior knowledge are additional influencing factors.