Hyunsung Cho

Hyunsung Cho

Auto-generated profile, based on publicly available information

Hyunsung Cho

Carnegie Mellon University, Pittsburgh, Pennsylvania, USA

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
22 February 2023 in IEEE Transactions on Visualization and Computer Graphics
Verified
Journal Article
Closed access
CFCatarina G. Fidalgo
Catarina G. Fidalgo
YYYukang Yan
Yukang Yan
HCHyunsung Cho
Hyunsung Cho
MSMauricio Sousa
Mauricio Sousa
DLDavid Lindlbauer
David Lindlbauer
Joaquim JorgeJoaquim Jorge
Joaquim Jorge
The recent pandemic, war, and oil crises have caused many to reconsider their need to travel for education, training, and meetings. Providing assistance and training remotely has thus gained importance for many applications, from industrial maintenance to surgical telemonitoring. Current solutions such as video conferencing platforms lack essential communication cues such as spatial referencing, which negatively impacts both time completion and task performance. Mixed Reality (MR) offers opportunities to improve remote assistance and training, as it opens the way to increased spatial clarity and large interaction space. We contribute a survey of remote assistance and training in MR environments through a systematic literature review to provide a deeper understanding of current approaches, benefits and challenges. We analyze 62 articles and contextualize our findings along a taxonomy based on degree of collaboration, perspective sharing, MR space symmetry, time, input and output modality, visual display, and application domain. We identify the main gaps and opportunities in this research area, such as exploring collaboration scenarios beyond one-expert-to-one-trainee, enabling users to move across the reality-virtuality spectrum during a task, or exploring advanced interaction techniques that resort to hand or eye tracking. Our survey informs and helps researchers in different domains, including maintenance, medicine, engineering, or education, build and evaluate novel MR approaches to remote training and assistance. All supplemental materials are available at https://augmented-perception.org/publications/2023-training-survey.html.

31 October 2023 in Proceedings of the ACM on Human-Computer Interaction
Verified
Journal Article
Open access
VHViolet Yinuo Han
Violet Yinuo Han
HCHyunsung Cho
Hyunsung Cho
KMKiyosu Maeda
Kiyosu Maeda
AIAlexandra Ion
Alexandra Ion
DLDavid Lindlbauer
David Lindlbauer
Mixed Reality (MR) systems display content freely in space, and present nearly arbitrary amounts of information, enabling ubiquitous access to digital information. This approach, however, introduces clutter and distraction if too much virtual content is shown. We present BlendMR, an optimization-based MR system that blends virtual content onto the physical objects in users’ environments to serve as ambient information displays. Our approach takes existing 2D applications and meshes of physical objects as input. It analyses the geometry of the physical objects and identifies regions that are suitable hosts for virtual elements. Using a novel integer programming formulation, our approach then optimally maps selected contents of the 2D applications onto the object, optimizing for factors such as importance and hierarchy of information, viewing angle, and geometric distortion. We evaluate BlendMR by comparing it to a 2D window baseline. Study results show that BlendMR decreases clutter and distraction, and is preferred by users. We demonstrate the applicability of BlendMR in a series of results and usage scenarios.

11 May 2024
Verified
Conference Paper
Open access
HCHyunsung Cho
Hyunsung Cho
YYYukang Yan
Yukang Yan
KTKashyap Todi
Kashyap Todi
MPMark Parent
Mark Parent
MSMissie Smith
Missie Smith
DLDavid Lindlbauer
David Lindlbauer

11 October 2024
Verified
Conference Paper
Open access
HCHyunsung Cho
Hyunsung Cho
AWAlexander Wang
Alexander Wang
DKDivya Kartik
Divya Kartik
EXEmily Liying Xie
Emily Liying Xie
YYYukang Yan
Yukang Yan
DLDavid Lindlbauer
David Lindlbauer
Spatial audio in Extended Reality (XR) provides users with better awareness of where virtual elements are placed, and efficiently guides them to events such as notifications, system alerts from different windows, or approaching avatars. Humans, however, are inaccurate in localizing sound cues, especially with multiple sources due to limitations in human auditory perception such as angular discrimination error and front-back confusion. This decreases the efficiency of XR interfaces because users misidentify from which XR element a sound is coming from. To address this, we propose Auptimize, a novel computational approach for placing XR sound sources, which mitigates such localization errors by utilizing the ventriloquist effect. Auptimize disentangles the sound source locations from the visual elements and relocates the sound sources to optimal positions for unambiguous identification of sound cues, avoiding errors due to inter-source proximity and front-back confusion. Our evaluation shows that Auptimize decreases spatial audio-based source identification errors compared to playing sound cues at the paired visual-sound locations. We demonstrate the applicability of Auptimize for diverse spatial audio-based interactive XR scenarios.

28 September 2023 in Proceedings of the ACM on Human-Computer Interaction
Verified
Journal Article
Open access
AOAdiba Orzikulova
Adiba Orzikulova
HCHyunsung Cho
Hyunsung Cho
HCHye-Young Chung
Hye-Young Chung
HHHwajung Hong
Hwajung Hong
Uichin LeeUichin Lee
Uichin Lee
SLSung-Ju Lee
Sung-Ju Lee
Many digital wellbeing tools help users monitor and control social media use on their smartphones by tracking and setting limits on their usage time. Tracking is typically done at the granularity of phone- or app-level; however, recent social media apps provide various features such as direct messaging, comment reading/posting, and content uploading/viewing. While it is possible to track and analyze within-app feature usage, little is known about the effect of granularity on smartphone interventions. We designed and developed FinerMe to explore how the granularity of interventions (app-level vs. feature-level) affects the usage of popular social media such as Instagram and YouTube on smartphones. We conducted a field study with 56 participants over 16 days that consisted of three phases: baseline collection, self-reflection, and self-reflection with restrictive interventions. The results showed that while both app-level and feature-level interventions similarly reduced social media use, feature-level interventions enabled users to spend less time on passive app features related to content consumption (e.g., following feed on Instagram, and viewing comments on YouTube) than app-level interventions. Moreover, when self-reflection is combined with restrictive interventions at the feature-level, users were more reflective on their usage behavior than when done at the app-level.

27 September 2023 in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Verified
Journal Article
Open access
HCHyunsung Cho
Hyunsung Cho
MKMatthew L. Komar
Matthew L. Komar
DLDavid Lindlbauer
David Lindlbauer
Humans easily miss events in their surroundings due to limited short-term memory and field of view. This happens, for example, while watching an instructor's machine repair demonstration or conversing during a sports game. We present RealityReplay, a novel Mixed Reality (MR) approach that tracks and visualizes these significant events using in-situ MR visualizations without modifying the physical space. It requires only a head-mounted MR display and a 360-degree camera. We contribute a method for egocentric tracking of important motion events in users' surroundings based on a combination of semantic segmentation and saliency prediction, and generating in-situ MR visual summaries of temporal changes. These summary visualizations are overlaid onto the physical world to reveal which objects moved, in what order, and their trajectory, enabling users to observe previously hidden events. The visualizations are informed by a formative study comparing different styles on their effects on users' perception of temporal changes. Our evaluation shows that RealityReplay significantly enhances sensemaking of temporal motion events compared to memory-based recall. We demonstrate application scenarios in guidance, education, and observation, and discuss implications for extending human spatiotemporal capabilities through technological augmentation.