Jialin Wang

Jialin Wang

Auto-generated profile, based on publicly available information

Jialin Wang

Computational Media and Arts thrust, The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, Guangdong, China

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
17 April 2025 in Journal of Computing in Higher Education
Verified
Journal Article
Open access
PDF file
JKJinhee Kim
Jinhee Kim
SLSang-Soog Lee
Sang-Soog Lee
RDRita Detrick
Rita Detrick
JWJialin Wang
Jialin Wang
Na LiNa Li
Na Li
Considering both the transformative opportunities and challenges presented by generative AI (GenAI) in academic writing, effectively integrating GenAI into the academic setting becomes a significant need requiring prioritization. Yet, there is limited understanding regarding the nature of interactions between different types of students, what behavioral patterns students exhibit during a student-GenAI interaction (SAI) on a given task, and how these different SAI patterns relate to the actual writing task performance. This study, therefore, aimed to identify SAI patterns of academic writing tasks depending on students’ level of AI literacy and examine the differences in academic writing performance between the identified SAI patterns. Drawing from the combination of three data sources, including think-aloud protocols, screen-recordings, and chat histories between 36 Chinese graduate students and a GenAI writing system, epistemic network analysis (ENA) was used to reveal the distinctive SAI patterns of students with different levels of AI literacy. The study found that students with a high level of AI literacy exhibited a collaborative approach to SAI, actively accepting GenAI’s suggestions and engaging GenAI in meta-cognitive-related activities such as planning, whereas students with a low level of AI literacy demonstrated much less interaction with GenAI in completing their writing tasks, instead choosing to ideate and evaluate independently. In addition, the Wilcoxon rank-sum (Mann-Whitney U) test was conducted to assess the writing task performance of the two AI literacy groups. Findings revealed statistical differences in all evaluation rubrics (content, structure/organization, expression). This study offers implications for the design and implementation of GenAI agents in writing tasks and the pedagogy of GenAI-assisted instruction.

27 May 2022 in IEEE Transactions on Games
Verified
Journal Article
Closed access
JWJialin Wang
Jialin Wang
LHLiang Hai-Ning
Liang Hai-Ning
DMDiego VILELA MONTEIRO
Diego VILELA MONTEIRO
WXWenge Xu
Wenge Xu
JXJimin Xiao
Jimin Xiao
Virtual Reality (VR) technology has progressed rapidly and is used in various domains, particularly games. Simulator Sickness (SS) still represents a significant problem for its wider adoption. The most common way to detect SS is using the Simulator Sickness Questionnaire (SSQ). SSQ is a subjective measurement and is inadequate for real-time applications such as VR games. This research aims to develop a model to predict SS in real time using in-game characters’ movement and users’ eye motion data during gameplay in VR games. To achieve this, we designed an experiment to collect such data with three types of games. We trained a Long Short-Term Memory neural network with the eye-tracking and character movement data to predict SS. Our model can predict SS in real time with an accuracy of 83.4% for players who suffer from severe sensitivity to SS. Our results indicate that, in VR games, our model is an accurate and efficient method to predict SS in real time.

11 May 2024
Verified
Conference Paper
Open access
SWShaoyue Wen
Shaoyue Wen
SPSongming Ping
Songming Ping
JWJialin Wang
Jialin Wang
LHLiang Hai-Ning
Liang Hai-Ning
XXXuhai Xu
Xuhai Xu
YYYukang Yan
Yukang Yan
Current voice assistants present messages in a predefined format without considering users’ mental states. This paper presents an optimization-based approach to alleviate this issue which adjusts the level of details and speech speed of the voice messages according to the estimated cognitive load of the user. In the first user study (N = 12), we investigated the impact of cognitive load on user performance. The findings reveal significant differences in preferred message formats across five cognitive load levels, substantiating the need for voice message adaptation. We then implemented AdaptiveVoice, an algorithm based on combinatorial optimization to generate adaptive voice messages in real time. In the second user study (N = 30) conducted in a VR-simulated driving environment, we compare AdaptiveVoice with a fixed format baseline, with and without visual guidance on the Heads-up display (HUD). Results indicate that users benefit from AdaptiveVoice with reduced response time and improved driving performance, particularly when it is augmented with HUD.

4 March 2024 in IEEE Transactions on Visualization and Computer Graphics
Verified
Journal Article
Closed access
JWJialin Wang
Jialin Wang
RSRongkai Shi
Rongkai Shi
XLXiaodong Li
Xiaodong Li
YWYushi Wei
Yushi Wei
LHLiang Hai-Ning
Liang Hai-Ning
Users' perceived image quality of virtual reality head-mounted displays (VR HMDs) is determined by multiple factors, including the HMD's structure, optical system, display and render resolution, and users' visual acuity (VA). Existing metrics such as pixels per degree (PPD) have limitations that prevent accurate comparison of different VR HMDs. One of the main limitations is that not all VR HMD manufacturers released the official PPD or details of their HMDs' optical systems. Without these details, developers and users cannot know the precise PPD or calculate it for a given HMD. The other issue is that the visual clarity varies with the VR environment. Our work has identified a gap in having a feasible metric that can measure the visual clarity of VR HMDs. To address this gap, we present an end-to-end and user-centric visual clarity metric, omnidirectional virtual visual acuity (OVVA), for VR HMDs. OVVA extends the physical visual acuity chart into a virtual format to measure the virtual visual acuity of an HMD's central focal area and its degradation in its noncentral area. OVVA provides a new perspective to measure visual clarity and can serve as an intuitive and accurate reference for VR applications sensitive to visual accuracy. Our results show that OVVA is a simple yet effective metric for comparing VR HMDs and environments.

16 December 2021 in Sensors
Verified
Journal Article
Open access
PDF file
Lei ChenLei Chen
Lei Chen
LHLiang Hai-Ning
Liang Hai-Ning
JWJialin Wang
Jialin Wang
Yuanying QuYuanying Qu
Yuanying Qu
Yong YueYong Yue
Yong Yue
Large interactive displays can provide suitable workspaces for learners to conduct collaborative learning tasks with visual information in co-located settings. In this research, we explored the use of these displays to support collaborative engagement and exploratory tasks with visual representations. Our investigation looked at the effect of four factors (number of virtual workspaces within the display, number of displays, position arrangement of the collaborators, and collaborative modes of interaction) on learners’ knowledge acquisition, engagement level, and task performance. To this end, a user study was conducted with 72 participants divided into 6 groups using an interactive tool developed to support the collaborative exploration of 3D visual structures. The results of this study showed that learners with one shared workspace and one single display can achieve better user performance and engagement levels. In addition, the back-to-back position with learners sharing their view and control of the workspaces was the most favorable. It also led to improved learning outcomes and engagement levels during the collaboration process.

27 December 2022
Verified
Conference Paper
Open access
YLYiming Luo
Yiming Luo
JWJialin Wang
Jialin Wang
YPYushan Pan
Yushan Pan
SLShan Luo
Shan Luo
PIPourang Irani
Pourang Irani
LHLiang Hai-Ning
Liang Hai-Ning
This paper addresses the relations between the artifacts, tools, and technologies that we make to fulfill user-centered teleoperations in the cyber-physical environment. We explored the use of a virtual reality (VR) interface based on customized concepts of Worlds-in-Miniature (WiM) to teleoperate unmanned ground vehicles (UGVs). Our designed system supports teleoperators in their interaction with and control of a miniature UGV directly on the miniature map. Both moving and rotating can be done via body motions. Our results showed that the miniature maps and UGV represent a promising framework for VR interfaces.