This study explored the relationships between eye tracking and traditional usability testing data in the context of analyzing the usability of Algebra Nation™, an online system for learning mathematics used by hundreds of thousands of students. Thirty-five undergraduate students (20 females) completed seven usability tasks in the Algebra Nation™ online learning environment. The participants were asked to log in, select an instructor for the instructional video, post a question on the collaborative wall, search for an explanation of a mathematics concept on the wall, find information relating to Karma Points (an incentive for engagement and learning), and watch two instructional videos of varied content difficulty. Participants’ eye movements (fixations and saccades) were simultaneously recorded by an eye tracker. Usability testing software was used to capture all participants’ interactions with the system, task completion time, and task difficulty ratings. Upon finishing the usability tasks, participants completed the System Usability Scale. Important relationships were identified between the eye movement metrics and traditional usability testing metrics such as task difficulty rating and completion time. Eye tracking data were investigated quantitatively using aggregated fixation maps, and qualitative examination was performed on video replay of participants’ fixation behavior. Augmenting the traditional usability testing methods, eye movement analysis provided additional insights regarding revisions to the interface elements associated with these usability tasks.
There has been a lack of research on how people with individual differences learn with multimedia materials, in particular with regard to individuals with dyslexia. Dyslexia is a learning disability characterized by subpar ability in reading, spelling, writing, word recognition, and phonological decoding. This population could potentially benefit from multimedia learning materials according to the cognitive theory of multimedia learning and Orton–Gillingham multisensory instructional approach. This study examined how learning in four multimedia conditions influences dyslexic college students’ ability to recall and recognize information. Seventy-three college students with dyslexia were assigned to one of the four conditions that integrated the modality (spoken text vs. on-screen text) and multimedia (picture present vs. picture absent) principles. They completed a cued-recall and a content recognition test. The results indicated pictures facilitated recognition, which validated the multimedia principle. On-screen text led to a superior performance in recall and recognition compared to spoken text. This finding suggested the modality principle did not hold for participants with dyslexia in this study, which is especially surprising given that dyslexics have difficulty processing written text. Possible explanations of the findings are discussed.