Given that educational technology has increased tremendously, usability testing is a necessity to maximize the efficiency of technological tools in education. The findings of a systematic review including 42 research papers that evaluated the educational technologies’ perceived usability with the Post-Study System Usability Questionnaire (PSSUQ) and the Computer System Usability Questionnaire (CSUQ) are presented in this article. The results were categorized according to the following factors: (a) score derived from evaluating usability with PSSUQ/CSUQ, (b) type of educational technology employed, (c) subject studied, (d) educational stage, (e) participant type, (f) age, and (g) participant count in each survey. The usability levels were found to be satisfactory (M = 72.75, SD = 15.12) from the statistical analysis of all surveys (N = 58). The mobile applications category showed a very good mean PSSUQ/CSUQ score (M = 81.53, SD = 12.61) followed by the multimedia category with 73.89 (SD = 19.69) and internet platforms (M = 73.23, SD = 7.74). The educational stage (p = 0.01) and the participant type (p = 0.005) seem to relate to the obtained PSSUQ/CSUQ scores. However, the participants’ age, the subject being studied, or the participant count in each study did not exhibit any significant correlation with the PSSUQ/CSUQ scores. Over the course of time, a marginal non-statistically significant improvement was noted in terms of perceived usability (p = 0.136).
26 January 2022 in The International Journal of Information and Learning Technology
Purpose: The purpose of this study was to determine the impact of perceived usability and students' personality traits on their learning gain in an e-learning context at the university level.Design/methodology/approach: The factors examined are related to individual characteristics such as students' personality traits, as well as to perceptual characteristics such as the perceived usability of the platform used. A total of 110 undergraduate students participated in the study. A one-group pretest-posttest research design was adopted. Big 5 personality test, System Usability Scale (SUS) and a general knowledge assessment questionnaire were used.Findings: Perceived usability of Zoom platform is statistically significantly correlated with students' learning gain (r = 0.294, p = 0.002, s). Concerning learning effectiveness in the current e-learning scenario, students' final performance was found to be statistically significantly higher than the initial (p = 0.000, s). A hierarchical regression analysis (R2 = 0.146) unveiled that Zoom's perceived usability and personality traits are significant predictors for learning gain (p = 0.011, s).Research limitations/implications: The findings of this research provide important implications regarding the design of lessons in an e-learning context.Social implications: A substantial fraction of the educational process is going online, especially in higher education. Thus, a thorough understanding of the factors which influence learning gain in an e-learning context is of significance.Originality/value: The main contribution of this study is that it quantifies the variance of the learning gain explained by two factors, namely, SUS and personality.