The abundance of courses available in a university often overwhelms students as they must select courses that are relevant to their academic interests and satisfy their requirements. A large number of existing studies in course recommendation systems focus on the accuracy of prediction to show students the most relevant courses with little consideration on interactivity and user perception. However, recent work has highlighted the importance of user-perceived aspects of recommendation systems, such as transparency, controllability, and user satisfaction. This paper introduces CourseQ, an interactive course recommendation system that allows students to explore courses by using a novel visual interface so as to improve transparency and user satisfaction of course recommendations. We describe the design concepts, interactions, and algorithm of the proposed system. A within-subject user study (N=32) was conducted to evaluate our system compared to a baseline interface without the proposed interactive visualization. The evaluation results show that our system improves many user-centric metrics including user acceptance and understanding of the recommendation results. Furthermore, our analysis of user interaction behaviors in the system indicates that CourseQ could help different users with their course-seeking tasks. Our results and discussions highlight the impact of visual and interactive features in course recommendation systems and inform the design of future recommendation systems for higher education.
The COVID-19 pandemic has led to an increase in online classes, and programming classes are no exception. In such a learning environment, understanding every student’s programming process is mostly impractical for teachers, despite its significance in supporting students. Giving teachers feedback on programming processes is a typical approach to the problem. However, few studies have focused on visual representations of the evolution process of source-code contents; it remains unclear what visual representation would be effective to this end and how teachers value such feedback. We propose two feedback tools for teachers. These tools visualize the temporal evolution of source-code contents at different granularities. An experiment was conducted in which several university teachers performed a user evaluation of the tools, particularly with regard to their usefulness for reviewing past programming classes taught by another teacher. Questionnaire results showed that these tools are helpful for understanding programming processes. The tools were also found to be complementary, with different aspects being highly evaluated. We successfully presented concrete visual representations of programming processes as well as their relative strengths and weaknesses for reviewing classes; this contribution may serve as a basis for future real-time use of these tools in class.
While positive effects of imitating other learners have been reported, the recent increases in the number of online classes have seriously limited opportunities to learn how others are learning. Providing information about others’ learning activities through dashboards could be a solution, but few studies have targeted learning activities on e-textbook systems; it remains unclear what information representations would be useful and how they would affect learning. We developed a dashboard system that enables live sharing of students’ learning activities on e-textbooks. An experiment was conducted applying the dashboard in an online class to evaluate its impact. The results of questionnaires and quizzes were analyzed along with learning activities on the e-textbook system. From the questionnaire results, the most useful feedback types were identified. Regarding the impact on learning, the study found that a higher percentage of students who used the dashboard followed the progress of the class than those who did not. The study also found that students who used the dashboard were more likely to achieve higher quiz scores than those who did not. This study is the first to reveal what specific feedback is useful and to successfully investigate the impact of its use on learning.