27 June 2022 in Acta Crystallographica Section D Structural Biology
Cryogenic electron microscopy (cryoEM) has emerged as a revolutionary method for solving high-resolution structures and studying the dynamics of macromolecular complexes and viruses in near-native states. However, the availability of the equipment, and the time and cost needed for training, severely limit the opportunities for training. To solve these problems, a virtual reality-based training system, CryoVR, has been developed to prepare trainees before operating real-world cryoEM equipment. This paper describes the design and assessment of CryoVR (available at https://www.purdue.edu/cryoVR), which helps users learn cryoEM experimental procedures in a virtual environment, allowing immersive training with step-by-step tutorials with vivid visual, audio and text guidance. Implemented as a training step before a novice user interacts with the expensive real-world cryoEM equipment, CryoVR can help users to become familiar with hands-on operational procedures through multiple training modules and earning certificates after passing the built-in Exam mode. Qualitative evaluation and feedback of CryoVR from users with various levels of cryoEM experience indicate the substantial value of CryoVR as a tool for a comprehensive cryoEM procedural training.
12 May 2023 in Proceedings of the ACM on Computer Graphics and Interactive Techniques
The use of virtual reality (VR) in laboratory skill training is rapidly increasing. In such applications, users often need to explore a large virtual environment within a limited physical space while completing a series of hand-based tasks (e.g., object manipulation). However, the most widely used controller-based teleport methods may conflict with the users' hand operation and result in a higher cognitive load, negatively affecting their training experiences. To alleviate these limitations, we designed and implemented a locomotion method called ManiLoco to enable hands-free interaction and thus avoid conflicts and interruptions from other tasks. Users can teleport to a remote object's position by taking a step toward the object while looking at it. We evaluated ManiLoco and compared it with state-of-the-art Point & Teleport in a within-subject experiment with 16 participants. The results confirmed the viability of our foot- and head-based approach and better support concurrent object manipulation in VR training tasks. Furthermore, our locomotion method does not require any additional hardware. It solely relies on the VR head-mounted display (HMD) and our implementation of detecting the user's stepping activity, and it can be easily applied to any VR application as a plugin.
1 November 2025 in Computer Animation and Virtual Worlds
Interacting with small objects in virtual reality (VR) can be challenging due to the physical limitations of controllers and headsets, which often lead to unintended collisions and tracking loss when devices come too close, thereby disrupting the user's immersive experience. While researchers have developed techniques like translational gain, hand remapping, and specialized interaction to address these challenges, these approaches are often task‐specific or insufficient for precise, detailed interactions or observations. To address these challenges, in this paper, we introduce a novel interaction technique called dynamic translational gains manipulation (DTGM), which adjusts scaling in real‐time based on the user's proximity to objects. We conducted a user study to evaluate the effectiveness of improving precision during object manipulation and understanding the subjective mental workload of the proposed DTGM technique. Our results revealed that the DTGM technique improved interaction efficiency, making it suitable for various VR applications where precision and space optimization are crucial.