This work analyzed the use of Microsoft HoloLens 2 in orthopedic oncological surgeries and compares it to its predecessor (Microsoft HoloLens 1). Specifically, we developed two equivalent applications, one for each device, and evaluated the augmented reality (AR) projection accuracy in an experimental scenario using phantoms based on two patients. We achieved automatic registration between virtual and real worlds using patient-specific surgical guides on each phantom. They contained a small adaptor for a 3D-printed AR marker, the characteristic patterns of which were easily recognized using both Microsoft HoloLens devices. The newest model improved the AR projection accuracy by almost 25%, and both of them yielded an RMSE below 3 mm. After ascertaining the enhancement of the second model in this aspect, we went a step further with Microsoft HoloLens 2 and tested it during the surgical intervention of one of the patients. During this experience, we collected the surgeons’ feedback in terms of comfortability, usability, and ergonomics. Our goal was to estimate whether the improved technical features of the newest model facilitate its implementation in actual surgical scenarios. All of the results point to Microsoft HoloLens 2 being better in all the aspects affecting surgical interventions and support its use in future experiences.

During the last decade, orthopedic oncology has experienced the benefits of computerized medical imaging to reduce human dependency, improving accuracy and clinical outcomes. However, traditional surgical navigation systems do not always adapt properly to this kind of interventions. Augmented reality (AR) and three-dimensional (3D) printing are technologies lately introduced in the surgical environment with promising results. Here we present an innovative solution combining 3D printing and AR in orthopedic oncological surgery. A new surgical workflow is proposed, including 3D printed models and a novel AR-based smartphone application (app). This app can display the patient’s anatomy and the tumor’s location. A 3D-printed reference marker, designed to fit in a unique position of the affected bone tissue, enables automatic registration. The system has been evaluated in terms of visualization accuracy and usability during the whole surgical workflow. Experiments on six realistic phantoms provided a visualization error below 3 mm. The AR system was tested in two clinical cases during surgical planning, patient communication, and surgical intervention. These results and the positive feedback obtained from surgeons and patients suggest that the combination of AR and 3D printing can improve efficacy, accuracy, and patients’ experience.

Objectives Muscle wasting is a recognised extra-pulmonary complication in chronic obstructive pulmonary disease and has been associated with increased risk of death. Acute respiratory exacerbations are associated with reduction of muscle function, but there is a paucity of data on their long-term effect. This study explores the relationship between acute respiratory exacerbations and long-term muscle loss using serial measurements of CT derived pectoralis muscle area (PMA). Design and setting Participants were included from two prospective, longitudinal, observational, multicentre cohorts of ever-smokers with at least 10 pack-year history. Participants The primary analysis included 1332 (of 2501) participants from Evaluation of COPD Longitudinally to Identify Predictive Surrogate Endpoints (ECLIPSE) and 4384 (of 10 198) participants from Genetic Epidemiology of COPD (COPDGene) who had complete data from their baseline and follow-up visits. Interventions PMA was measured on chest CT scans at two timepoints. Self-reported exacerbation data were collected from participants in both studies through the use of periodic longitudinal surveys. Main outcome measures Age-related and excess muscle loss over time. Results Age, sex, race and body mass index were associated with baseline PMA. Participants experienced age-related decline at the upper end of reported normal ranges. In ECLIPSE, the exacerbation rate over time was associated with an excess muscle area loss of 1.3% (95% CI 0.6 to 1.9, p<0.001) over 3 years and in COPDGene with an excess muscle area loss of 2.1% (95% CI 1.2 to 2.8, p<0.001) over 5 years. Excess muscle area decline was absent in 273 individuals who participated in pulmonary rehabilitation. Conclusions Exacerbations are associated with accelerated skeletal muscle loss. Each annual exacerbation was associated with the equivalent of 6 months of age-expected decline in muscle mass. Ameliorating exacerbation-associated muscle loss represents an important therapeutic target.

Augmented reality (AR) can be an interesting technology for clinical scenarios as an alternative to conventional surgical navigation. However, the registration between augmented data and real-world spaces is a limiting factor. In this study, the authors propose a method based on desktop three-dimensional (3D) printing to create patient-specific tools containing a visual pattern that enables automatic registration. This specific tool fits on the patient only in the location it was designed for, avoiding placement errors. This solution has been developed as a software application running on Microsoft HoloLens. The workflow was validated on a 3D printed phantom replicating the anatomy of a patient presenting an extraosseous Ewing's sarcoma, and then tested during the actual surgical intervention. The application allowed physicians to visualise the skin, bone and tumour location overlaid on the phantom and patient. This workflow could be extended to many clinical applications in the surgical field and also for training and simulation, in cases where hard body structures are involved. Although the authors have tested their workflow on AR head mounted display, they believe that a similar approach can be applied to other devices such as tablets or smartphones.

Purpose: Augmented Reality (AR) has the potential to simplify ultrasound (US) examinations which usually require a skilled and experienced sonographer to mentally align narrow 2D cross-sectional US images in the 3D anatomy of the patient. This work describes and evaluates a novel approach to track retroreflective spheres attached to the US probe using an inside-out technique with the AR glasses HoloLens 2. Finally, live US images are displayed in situ on the imaged anatomy. Methods: The Unity application UltrARsound performs spatial tracking of the US probe and attached retroreflective markers using the depth camera integrated into the AR glasses—thus eliminating the need for an external tracking system. Additionally, a Kalman filter is implemented to improve the noisy measurements of the camera. US images are streamed wirelessly via the PLUS toolkit to HoloLens 2. The technical evaluation comprises static and dynamic tracking accuracy, frequency and latency of displayed images. Results: Tracking is performed with a median accuracy of 1.98 mm/1.81 $$^\circ $$∘ for the static setting when using the Kalman filter. In a dynamic scenario, the median error was 2.81 mm/1.70 $$^\circ $$∘ . The tracking frequency is currently limited to 20 Hz. 83% of the displayed US images had a latency lower than 16 ms. Conclusions: In this work, we showed that spatial tracking of retroreflective spheres with the depth camera of HoloLens 2 is feasible, achieving a promising accuracy for in situ visualization of live US images. For tracking, no additional hardware nor modifications to HoloLens 2 are required making it a cheap and easy-to-use approach. Moreover, a minimal latency of displayed images enables a real-time perception for the sonographer.