Yukang Yan

Yukang Yan

Auto-generated profile, based on publicly available information

Yukang Yan

Department of Computer Science, University of Rochester, Rochester, New York, USA

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
22 February 2023 in IEEE Transactions on Visualization and Computer Graphics
Verified
Journal Article
Closed access
CFCatarina G. Fidalgo
Catarina G. Fidalgo
YYYukang Yan
Yukang Yan
HCHyunsung Cho
Hyunsung Cho
MSMauricio Sousa
Mauricio Sousa
DLDavid Lindlbauer
David Lindlbauer
Joaquim JorgeJoaquim Jorge
Joaquim Jorge
The recent pandemic, war, and oil crises have caused many to reconsider their need to travel for education, training, and meetings. Providing assistance and training remotely has thus gained importance for many applications, from industrial maintenance to surgical telemonitoring. Current solutions such as video conferencing platforms lack essential communication cues such as spatial referencing, which negatively impacts both time completion and task performance. Mixed Reality (MR) offers opportunities to improve remote assistance and training, as it opens the way to increased spatial clarity and large interaction space. We contribute a survey of remote assistance and training in MR environments through a systematic literature review to provide a deeper understanding of current approaches, benefits and challenges. We analyze 62 articles and contextualize our findings along a taxonomy based on degree of collaboration, perspective sharing, MR space symmetry, time, input and output modality, visual display, and application domain. We identify the main gaps and opportunities in this research area, such as exploring collaboration scenarios beyond one-expert-to-one-trainee, enabling users to move across the reality-virtuality spectrum during a task, or exploring advanced interaction techniques that resort to hand or eye tracking. Our survey informs and helps researchers in different domains, including maintenance, medicine, engineering, or education, build and evaluate novel MR approaches to remote training and assistance. All supplemental materials are available at https://augmented-perception.org/publications/2023-training-survey.html.

11 May 2024
Verified
Conference Paper
Open access
AOAdiba Orzikulova
Adiba Orzikulova
HXHan Xiao
Han Xiao
ZLZhipeng Li
Zhipeng Li
YYYukang Yan
Yukang Yan
YWYuntao Wang
Yuntao Wang
XXXuhai Xu
Xuhai Xu

19 April 2023
Verified
Conference Paper
Open access
YJYu Jiang
Yu Jiang
ZLZhipeng Li
Zhipeng Li
MHMufei He
Mufei He
DLDavid Lindlbauer
David Lindlbauer
YYYukang Yan
Yukang Yan
We propose HandAvatar to enable users to embody non-humanoid avatars using their hands. HandAvatar leverages the high dexterity and coordination of users’ hands to control virtual avatars, enabled through our novel approach for automatically-generated joint-to-joint mappings. We contribute an observation study to understand users’ preferences on hand-to-avatar mappings on eight avatars. Leveraging insights from the study, we present an automated approach that generates mappings between users’ hands and arbitrary virtual avatars by jointly optimizing control precision, structural similarity, and comfort. We evaluated HandAvatar on static posing, dynamic animation, and creative exploration tasks. Results indicate that HandAvatar enables more precise control, requires less physical effort, and brings comparable embodiment compared to a state-of-the-art body-to-avatar control method. We demonstrate HandAvatar’s potential with applications including non-humanoid avatar based social interaction in VR, 3D animation composition, and VR scene design with physical proxies. We believe that HandAvatar unlocks new interaction opportunities, especially for usage in Virtual Reality, by letting users become the avatar in applications including virtual social interaction, animation, gaming, or education.

21 December 2022 in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Verified
Journal Article
Open access
CLChen Liang
Chen Liang
CHChi Hsia
Chi Hsia
CYChun Yu
Chun Yu
YYYukang Yan
Yukang Yan
YWYuntao Wang
Yuntao Wang
YSYuanchun Shi
Yuanchun Shi
We present DRG-Keyboard, a gesture keyboard enabled by dual IMU rings, allowing the user to swipe the thumb on the index fingertip to perform word gesture typing as if typing on a miniature QWERTY keyboard. With dual IMUs attached to the user's thumb and index finger, DRG-Keyboard can 1) measure the relative attitude while mapping it to the 2D fingertip coordinates and 2) detect the thumb's touch-down and touch-up events combining the relative attitude data and the synchronous frequency domain data, based on which a fingertip gesture keyboard can be implemented. To understand users typing behavior on the index fingertip with DRG-Keyboard, we collected and analyzed user data in two typing manners. Based on the statistics of the gesture data, we enhanced the elastic matching algorithm with rigid pruning and distance measurement transform. The user study showed DRG-Keyboard achieved an input speed of 12.9 WPM (68.3% of their gesture typing speed on the smartphone) for all participants. The appending study also demonstrated the superiority of DRG-Keyboard for better form factors and wider usage scenarios. To sum up, DRG-Keyboard not only achieves good text entry speed merely on a tiny fingertip input surface, but is also well accepted by the participants for the input subtleness, accuracy, good haptic feedback, and availability.

11 October 2024
Verified
Conference Paper
Open access
SXShuchang Xu
Shuchang Xu
CCChang Chen
Chang Chen
ZLZichen Liu
Zichen Liu
XJXiaofu Jin
Xiaofu Jin
LYLin-Ping Yuan
Lin-Ping Yuan
HQHuamin Qu
Huamin Qu
Reminiscing with photo collections offers significant psychological benefits but poses challenges for people with visual impairment (PVI). Their current reliance on sighted help restricts the flexibility of this activity. In response, we explored using a chatbot in a preliminary study. We identified two primary challenges that hinder effective reminiscence with a chatbot: the scattering of information and a lack of proactive guidance. To address these limitations, we present Memory Reviver, a proactive chatbot that helps PVI reminisce with a photo collection through natural language communication. Memory Reviver incorporates two novel features: (1) a Memory Tree, which uses a hierarchical structure to organize the information in a photo collection; and (2) a Proactive Strategy, which actively delivers information to users at proper conversation rounds. Evaluation with twelve PVI demonstrated that Memory Reviver effectively facilitated engaging reminiscence, enhanced understanding of photo collections, and delivered natural conversational experiences. Based on our findings, we distill implications for supporting photo reminiscence and designing chatbots for PVI.

11 May 2024
Verified
Conference Paper
Open access
HCHyunsung Cho
Hyunsung Cho
YYYukang Yan
Yukang Yan
KTKashyap Todi
Kashyap Todi
MPMark Parent
Mark Parent
MSMissie Smith
Missie Smith
DLDavid Lindlbauer
David Lindlbauer