Virtual Reality (VR) is a critical emerging technology in industrial contexts, as it facilitates collaboration and supports the product development lifecycle. However, its broad adoption is constrained by complex and high-cost integration. The use of VR among devices with various immersion and control levels may solve this obstacle, and increase the scalability of VR technologies. This article presents a case study on applying asymmetry between the COVE-VR platform and Microsoft Teams to enable distributed collaboration of multinational departments and enhance the maintenance method and documentation creation processes. Overall, five remote collaborative sessions were held with 20 experts from four countries. Our findings suggest that asymmetry between head-mounted display and Teams users enhances the quality of communication among geographically dispersed teams and their spatial understanding, which positively influences knowledge transfer and efficiency of industrial processes. Based on qualitative evaluation of the asymmetric VR setup, we further suggest a list of guidelines on how to enhance the collaboration efficiency for low-cost distributed asymmetric VR from three perspectives: organization, collaboration and technology.
Developments in sensor technology, artificial intelligence, and network technologies like 5G has made remote operation a valuable method of controlling various types of machinery. The benefits of remote operations come with an opportunity to access hazardous environments. The major limitation of remote operation is the lack of proper sensory feedback from the machine, which in turn negatively affects situational awareness and, consequently, may risk remote operations. This article explores how to improve situational awareness via multimodal feedback (visual, auditory, and haptic) and studies how it can be utilized to communicate warnings to remote operators. To reach our goals, we conducted a controlled, within-subjects experiment in eight conditions with twenty-four participants on a simulated remote driving system. Additionally, we gathered further insights with a UX questionnaire and semi-structured interviews. Gathered data showed that the use of multimodal feedback positively affected situational awareness when driving remotely. Our findings indicate that the combination of added haptic and visual feedback was considered the best feedback combination to communicate the slipperiness of the road. We also found that the feeling of presence is an important aspect of remote driving tasks, and a requested one, especially by those with more experience in operating real heavy machinery.
15 June 2022 in International Journal of Computer Assisted Radiology and Surgery
Purpose: In dental implantology, the optimal placement of dental implants is important to meet functional and aesthetic requirements. Planning dental implants in virtual three-dimensional (3D) environment is possible using virtual reality (VR) technologies. The three-dimensional stereoscopic virtual reality environment offers advantages over three-dimensional projection on a two-dimensional display. The use of voice commands in virtual reality environment to replace button presses and other simple actions frees the user’s hands and eyes for other tasks. Methods: Six dentomaxillofacial radiologists experimented using a prototype version of a three-dimensional virtual reality implant planning tool, and used two different tool selection methods, using either only button presses or also voice commands. We collected objective measurements of the results and subjective data of the participant experience to compare the two conditions. Results: The tool was approved by the experts and they were able to do the multiple-implant planning satisfactorily. The radiologists liked the possibility to use the voice commands. Most of the radiologists were willing to use the tool as part of their daily work routines. Conclusion: The voice commands were useful, natural, and accurate for mode change, and they could be expanded to other tasks. Button presses and the voice commands should be both available and used in parallel. The input methods can be further improved based on the expert comments.
22 June 2022 in International Journal of Computer Assisted Radiology and Surgery
Purpose: Many surgical complications can be prevented by careful operation planning and preoperative evaluation of the anatomical features. Virtual dental implant planning in three-dimensional stereoscopic virtual reality environment has advantages over three-dimensional projections on two-dimensional screens. In the virtual environment, the anatomical areas of the body can be assessed and interacted with in six degrees-of-freedom. Our aim was to make a preliminary evaluation of how professional users perceive the use of the virtual environment on their field. Methods: We prepared a novel implementation of a virtual dental implant planning system and conducted a small-scale user study with four dentomaxillofacial radiologists to evaluate the usability of direct and indirect interaction in a planning task. Results: We found that all four participants ranked direct interaction, planning the implant placement without handles, to be better than the indirect condition where the implant model had handles. Conclusion: The radiologists valued the three-dimensional environment for three-dimensional object manipulation even if usability issues of the handles affected the feel of use and the evaluation results. Direct interaction was seen as easy, accurate, and natural.
Three-dimensional (3D) medical images are used for diagnosis and in surgical operation planning. Computer-assisted surgical simulations (CASS) are essential for complex surgical procedures that are often performed in an interdisciplinary manner. Traditionally, the participants study the designs on the same display. In 3D virtual reality (VR) environments, the planner is wearing a head-mounted display (HMD). The designs can be then examined in VR by other persons wearing HMDs, which is a practical use case for the medical metaverse. A multi-user VR environment was built for the planning of an orthognathic–surgical (correction of facial skeleton) operation. Four domain experts (oral and maxillofacial radiologists) experimented with the pilot system and found it useful. It enabled easier observation of the model and a better understanding of the structures. There was a voice connection and co-operation during the procedure was natural. The planning task is complex, leading to a certain level of complexity in the user interface.
Remote operations have been greatly enhanced by advancements in technology, enabling remote control of machinery in hazardous environments. However, it is still a challenge to design remote control interfaces and provide feedback in a way that would enhance situational awareness without negatively affecting cognitive load. This study investigates how different audio feedback designs can support remote boom operation and, additionally, explores the potential impact of gamification elements on operator performance and motivation. Due to COVID-19 restrictions, this study was conducted remotely with 16 participants using a simulated environment featuring a virtual excavator. Participants performed digging tasks using two audio feedback designs: frequency-modulated beeping and realistic spatialized steam sounds. The findings indicate that both audio designs are beneficial for remote boom operations: the beeping sound was perceived as more comfortable and efficient in determining the proximity of a hidden object and helped in avoiding collisions, whereas spatial sounds enhanced the sense of presence. Therefore, we suggest combining both audio designs for optimal performance and emphasize the importance of customizable feedback in remote operations. This study also revealed that gamification elements could both positively and negatively affect performance and motivation, highlighting the need for careful design tailored to specific task requirements.