Background: Approximately 5 billion people worldwide lack adequate access to surgical care, primarily in the Global South. Especially in crisis regions and war zones, telemedical applications may enhance health services. This study explores the feasibility of using artificial intelligence (AI)-enhanced 3D imaging and extended reality (XR) technologies for intercontinental surgical case conferences in a low-resource scenario in Uganda. Our pilot study aims to assess the value of these technologies to address the lack of surgical resources and multilateral knowledge exchange. Objective: This study intends to determine the feasibility of using new AI-enhanced image modeling technology within an immersive spatial XR scenario to collaboratively and remotely assess reconstructive patient cases in the resource-limited country of Uganda. Methods: Within a surgical camp at Lamu Medical Centre, Uganda, 3D models of patients’ conditions were created using a smartphone app. Digital models were generated from photographs taken on-site and processed into 3D formats to be visualized in virtual case conferences. Here, surgeons from Uganda and Germany used virtual reality (VR) headsets to collaboratively discuss case strategies while marking surgical approaches on each digital patient model. Results: The study included 15 patients requiring reconstructive surgery, with a diverse range of conditions. The use of XR technology facilitated detailed visualization and discussion of surgical strategies. The process was time-efficient, with a total of under 8 minutes per case for data acquisition and model creation, and resource-efficient with surgeons reporting sufficient quality of smartphone-derived models. Valuable user experience and precise interaction during the VR case processing were found, underlining its potential to improve surgical planning and patient care in resource-limited settings. Conclusions: The findings indicate that AI-enhanced 3D imaging and immersive virtual communication platforms are valuable tools for integrative surgical case assessments. The cost-effectiveness of the used consumer solutions should be especially beneficial for low-resource environments. While the study demonstrates the feasibility of this approach, further research is needed to explore a broader application and impact of these technologies in global health. The study highlights the potential of XR to enhance training and surgical precision, contributing to better health care outcomes in underserved regions.

Background Mixed Reality (MR) enables intuitive and tangible visualization of patient data in interventional environments without further exposure to radiation, while most state-of-the-art navigation systems lack proper immersive visualization and rely on the use of markers as well as additional intrasurgical imaging for digital-physical registration. Methods We develop and validate a modular and immersive system combining state of the art mixed reality hardware, high-fidelity tracking/scanning technology, and automated surface registration algorithms to generate an accurate MR holographic projection of surgical tools and patient anatomy. Results The system exhibits reliable real-time performance with latencies below 50 ms. The accuracy of the holographic projection was measured for registration and MR precision, revealing a combined average deviation of 1.73 mm on a patient model. Conclusion Overall system accuracy provides a strong foundation for immersive surgical or interventional guidance. Ongoing studies aim to investigate clinical value and usability in real-world scenarios.