Boxuan Ma

Prof. Dr. Boxuan Ma

orcid

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications

30 June 2021 in Research and Practice in Technology Enhanced Learning
Verified
Journal Article
Open access
PDF file
BMBoxuan Ma
Boxuan Ma
MLMin Lu
Min Lu
YTYuta Taniguchi
Yuta Taniguchi
SKShinichi Konomi
Shinichi Konomi
The abundance of courses available in a university often overwhelms students as they must select courses that are relevant to their academic interests and satisfy their requirements. A large number of existing studies in course recommendation systems focus on the accuracy of prediction to show students the most relevant courses with little consideration on interactivity and user perception. However, recent work has highlighted the importance of user-perceived aspects of recommendation systems, such as transparency, controllability, and user satisfaction. This paper introduces CourseQ, an interactive course recommendation system that allows students to explore courses by using a novel visual interface so as to improve transparency and user satisfaction of course recommendations. We describe the design concepts, interactions, and algorithm of the proposed system. A within-subject user study (N=32) was conducted to evaluate our system compared to a baseline interface without the proposed interactive visualization. The evaluation results show that our system improves many user-centric metrics including user acceptance and understanding of the recommendation results. Furthermore, our analysis of user interaction behaviors in the system indicates that CourseQ could help different users with their course-seeking tasks. Our results and discussions highlight the impact of visual and interactive features in course recommendation systems and inform the design of future recommendation systems for higher education.

27 November 2021 in Smart Learning Environments
Verified
Journal Article
Open access
PDF file
BMBoxuan Ma
Boxuan Ma
MLMin Lu
Min Lu
YTYuta Taniguchi
Yuta Taniguchi
SKShin’iChi Konomi
Shin’iChi Konomi
Recommendation systems need a deeper understanding of users and their motivations to improve recommendation quality and provide more personalized suggestions. This is especially true in the education domain, the more about the student is known, the more useful recommendations can be made. However, although many studies on the course recommendation exist, studies on the students’ course selection motivations in universities are limited. This study investigates the factors that contribute to students’ choice when selecting courses in universities to better understand student perceptions, attitudes, and needs and leverage data-driven approaches for recommending and explaining the recommendations in university environments. A qualitative interview for university students (N = 10) comprised of open-ended questions as well as a questionnaire for students (N = 81) was conducted, aiming to investigate the main reasons behind their choices. The results of this study show that students highly value the course contents and the benefits of the course towards their future careers. Furthermore, students are influenced by other reasons such as the possibility of obtaining a higher grade, the popularity of professors, and recommendations from peers. Next, we extract the main categories of students’ motivations and analyzed the questionnaire data by employing statistical analysis methods as well as the k-means clustering algorithm to identify different types of students in terms of course selection. Based on our findings, we discuss implications for designing more personalized course recommendation systems.

4 January 2022 in Smart Learning Environments
Verified
Journal Article
Open access
PDF file
BMBoxuan Ma
Boxuan Ma
MLMin Lu
Min Lu
YTYuta Taniguchi
Yuta Taniguchi
SKShinichi Konomi
Shinichi Konomi
With the increasing use of digital learning materials in higher education, the accumulated operational log data provide a unique opportunity to analyzing student learning behaviors and their effects on student learning performance to understand how students learn with e-books. Among the students’ reading behaviors interacting with e-book systems, we find that jump-back is a frequent and informative behavior type. In this paper, we aim to understand the student’s intention for a jump-back using user learning log data on the e-book materials of a course in our university. We at first formally define the “jump-back” behaviors that can be detected from the click event stream of slide reading and then systematically study the behaviors from different perspectives on the e-book event stream data. Finally, by sampling 22 learning materials, we identify six reading activity patterns that can explain jump backs. Our analysis provides an approach to enriching the understanding of e-book learning behaviors and informs design implications for e-book systems.


Verified
Journal Article
Open access
PDF file
TYTianyuan Yang
Tianyuan Yang
BRBaofeng Ren
Baofeng Ren
CGChenghao Gu
Chenghao Gu
THTianjia He
Tianjia He
BMBoxuan Ma
Boxuan Ma
SKShinichi Konomi
Shinichi Konomi
Students must navigate large catalogs of courses and make appropriate enrollment decisions in many online learning environments. In this context, identifying key concepts and their relationships is essential for understanding course content and informing course recommendations. However, identifying and extracting concepts can be an extremely labor-intensive and time-consuming task when it has to be done manually. Traditional NLP-based methods to extract relevant concepts from courses heavily rely on resource-intensive preparation of detailed course materials, thereby failing to minimize labor. As recent advances in large language models (LLMs) offer a promising alternative for automating concept identification and relationship inference, we thoroughly investigate the potential of LLMs in automatically generating course concepts and their relations. Specifically, we systematically evaluate three LLM variants (GPT-3.5, GPT-4o-mini, and GPT-4o) across three distinct educational tasks, which are concept generation, concept extraction, and relation identification, using six systematically designed prompt configurations that range from minimal context (course title only) to rich context (course description, seed concepts, and subtitles). We systematically assess model performance through extensive automated experiments using standard metrics (Precision, Recall, F1, and Accuracy) and human evaluation by four domain experts, providing a comprehensive analysis of how prompt design and model choice influence the quality and reliability of the generated concepts and their interrelations. Our results show that GPT-3.5 achieves the highest scores on quantitative metrics, whereas GPT-4o and GPT-4o-mini often generate concepts that are more educationally meaningful despite lexical divergence from the ground truth. Nevertheless, LLM outputs still require expert revision, and performance is sensitive to prompt complexity. Overall, our experiments demonstrate the viability of LLMs as a tool for supporting educational content selection and delivery.