Peisen Xu

Peisen Xu

Auto-generated profile, based on publicly available information

Peisen Xu

CNRS@CREATE, Singapore, Singapore and IPAL, Department of Computer Science, National University of Singapore, Singapore, Singapore

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
27 September 2023 in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Verified
Journal Article
Open access
NJNuwan Janaka
Nuwan Janaka
JGJie Gao
Jie Gao
LZLin Zhu
Lin Zhu
SZShengdong Zhao
Shengdong Zhao
LLLan Lyu
Lan Lyu
YOYanch Ong
Yanch Ong
Communicating with others while engaging in simple daily activities is both common and natural for people. However, due to the hands- and eyes-busy nature of existing digital messaging applications, it is challenging to message someone while performing simple daily activities. We present GlassMessaging, a messaging application on Optical See-Through Head-Mounted Displays (OHMDs), to support messaging with voice and manual inputs in hands- and eyes-busy scenarios. GlassMessaging is iteratively developed through a formative study identifying current messaging behaviors and challenges in common multitasking with messaging scenarios. We then evaluated this application against the mobile phone platform on varying texting complexities in eating and walking scenarios. Our results showed that, compared to phone-based messaging, GlassMessaging increased messaging opportunities during multitasking due to its hands-free, wearable nature, and multimodal input capabilities. The affordance of GlassMessaging also allows users easier access to voice input than the phone, which thus reduces the response time by 33.1% and increases the texting speed by 40.3%, with a cost in texting accuracy of 2.5%, particularly when the texting complexity increases. Lastly, we discuss trade-offs and insights to lay a foundation for future OHMD-based messaging applications.

11 May 2024
Verified
Conference Paper
Open access
FTFelicia Fang-Yi Tan
Felicia Fang-Yi Tan
PXPeisen Xu
Peisen Xu
ARAshwin Ram
Ashwin Ram
WSWei Zhen Suen
Wei Zhen Suen
SZShengdong Zhao
Shengdong Zhao
Christophe HurterChristophe Hurter
Christophe Hurter
The rise of multitasking in contemporary lifestyles has positioned audio-first content as an essential medium for information consumption. We present AudioXtend, an approach to augment audiobook experiences during daily tasks by integrating glanceable, AI-generated visuals through optical see-through head-mounted displays (OHMDs). Our initial study showed that these visual augmentations not only preserved users’ primary task efficiency but also dramatically enhanced immediate auditory content recall by 33.3% and 7-day recall by 32.7%, alongside a marked improvement in narrative engagement. Through participatory design workshops involving digital arts designers, we crafted a set of design principles for visual augmentations that are attuned to the requirements of multitaskers. Finally, a 3-day take-home field study further revealed new insights for everyday use, underscoring the potential of assisted reality (aR) to enhance heads-up listening and incidental learning experiences.

11 May 2024
Verified
Conference Paper
Open access
YBYunpeng Bai
Yunpeng Bai
AIAleksi Ikkala
Aleksi Ikkala
AOAntti Oulasvirta
Antti Oulasvirta
SZShengdong Zhao
Shengdong Zhao
LWLucia J Wang
Lucia J Wang
PXPeisen Xu
Peisen Xu
Optical Head-Mounted Displays (OHMDs) allow users to read digital content while walking. A better understanding of how users allocate attention between these two tasks is crucial for improving OHMD interfaces. This paper introduces a computational model for simulating users’ attention switches between reading and walking. We model users’ decision to deploy visual attention as a hierarchical reinforcement learning problem, wherein a supervisory controller optimizes attention allocation while considering both reading activity and walking safety. Our model simulates the control of eye movements and locomotion as an adaptation to the given task priority, design of digital content, and walking speed. The model replicates key multitasking behaviors during OHMD reading while walking, including attention switches, changes in reading and walking speeds, and reading resumptions.

25 April 2025
Verified
Conference Paper
Open access
PXPeisen Xu
Peisen Xu
JGJérémie Garcia
Jérémie Garcia
WOWei Tsang Ooi
Wei Tsang Ooi
CJChristophe Jouffrais
Christophe Jouffrais

13 October 2023
Verified
Conference Paper
Open access
NJNuwan Janaka
Nuwan Janaka
JGJie Gao
Jie Gao
LZLin Zhu
Lin Zhu
SZShengdong Zhao
Shengdong Zhao
LLLan Lyu
Lan Lyu
YOYanch Ong
Yanch Ong
The act of communicating with others during routine daily tasks is both common and intuitive for individuals. However, the hands- and eyes-engaged nature of present digital messaging applications makes it difficult to message someone amidst such activities. We introduce GlassMessaging , a messaging application designed for Optical See-Through Head-Mounted Displays (OST-HMDs). It facilitates messaging through both voice and manual inputs, catering to situations where hands and eyes are preoccupied. GlassMessaging was iteratively developed through a formative study identifying current messaging behaviors and challenges in common multitasking with messaging scenarios.

12 November 2025
Verified
Conference Paper
Open access
MHMelissa Anastasia Harijanto
Melissa Anastasia Harijanto
FYFlorentiana Yuwono
Florentiana Yuwono
YXYi Xu
Yi Xu
XCXiao Xuan Chong
Xiao Xuan Chong
PXPeisen Xu
Peisen Xu
ABAnand Bhojan
Anand Bhojan