Robotic Assisted Surgery (RAS) represents an important step forward in the field of minimally invasive surgery. However, the learning curve of RAS is steep, and a systematic planning of surgical robot setups should be performed to leverage the features of RAS. For this reason, in this paper we show the design and implementation of a mixed-platform collaborative system, creating an interactive virtual shared environment that simulates RAS during the surgery planning phase. The proposed system allows one or more experts to plan together the different phases of an RAS-based surgical procedure, while integrating different levels of immersion to enhance computer-assisted training. We have tested our system with a total of four domain experts. Our results show that experts found the system excellent in terms of usability and useful to prepare and discuss surgical planning with RAS.
This paper presents the development of a virtual walker for wheelchair users designed for use in highly immersive environments, such as Cave Automatic Virtual Environments (CAVEs). The system allows users to navigate virtual environments using their natural wheelchair movements, providing haptic feedback based on the terrain they traverse. Both the control software and hardware have been developed from scratch and integrated into various CAVEs, including one with a six-degree-of-freedom (DOF) motion platform. To test the system, a comparative study was conducted with 21 users, measuring the time taken to complete the same course using different interaction methods and various feedback configurations with the virtual environment. The results show that the shortest times were achieved when users navigated using their natural interaction with their wheelchairs.
The evolution of technology and computer graphics algorithms has had a significant impact on the healthcare sector. It is possible to find proposals using virtual reality or augmented reality devices focused on multiple areas, such as education and skills acquisition, the visualisation of results, and disease detection or surgical planning. The use of these new technologies allows the generation of flexible spaces in which the spatial visualisation of clinical data, such as medical images, is enhanced. This also promotes collaboration between different members of the healthcare community. This study aims to review and synthesise current research and the status of applications using systems within Milgram’s continuum of virtuality as tools to facilitate educational or surgical processes in the healthcare sector. We highlight recent approaches to tackling the various key challenges, as well as the limitations of these approaches, and point toward areas of future development.
Competency in musculoskeletal (MSK) ultrasound requires learners to relate probe manipulation to spatial reasoning, image projection, and the appearance of characteristic artefacts, which remains challenging during early training due to the limited spatial context provided by conventional instructional resources. This study investigates whether reconstructing real MSK ultrasound examinations in an immersive extended reality (XR) environment is perceived as useful for early familiarisation with probe handling and image interpretation. The proposed system reproduces ultrasound acquisitions using synchronised ultrasound video, six-degree-of-freedom probe tracking, and surface scans acquired from cadaveric specimens, enabling the reconstruction of spatially accurate probe trajectories with each ultrasound frame linked to a corresponding position and orientation. Within the XR environment, users can interactively explore these trajectories or observe automated playback in which the recorded probe motion is presented together with the corresponding ultrasound sequence. An exploratory evaluation with healthcare professionals was conducted to assess perceived usefulness and clarity of spatial relationships. The results indicate that participants perceived spatially coherent playback of real ultrasound examinations in XR as a potentially useful aid for understanding probe–image relationships. These findings suggest the feasibility of this approach as a complementary resource for introductory MSK ultrasound training.
About Me
Computer Science PhD Student at University of Valencia
VR, AR & XR Researcher and Developer at IRTIC - UV
Computer Science PhD Student at University of Valencia
VR, AR & XR Researcher and Developer at IRTIC - UV