Image overlay projection is a form of augmented reality that allows surgeons to view underlying anatomical structures directly on the patient surface. It improves intuitiveness of computer-aided surgery by removing the need for sight diversion between the patient and a display screen and has been reported to assist in 3-D understanding of anatomical structures and the identification of target and critical structures. Challenges in the development of image overlay technologies for surgery remain in the projection setup. Calibration, patient registration, view direction, and projection obstruction remain unsolved limitations to image overlay techniques. In this paper, we propose a novel, portable, and handheld-navigated image overlay device based on miniature laser projection technology that allows images of 3-D patient-specific models to be projected directly onto the organ surface intraoperatively without the need for intrusive hardware around the surgical site. The device can be integrated into a navigation system, thereby exploiting existing patient registration and model generation solutions. The position of the device is tracked by the navigation system's position sensor and used to project geometrically correct images from any position within the workspace of the navigation system. The projector was calibrated using modified camera calibration techniques and images for projection are rendered using a virtual camera defined by the projectors extrinsic parameters. Verification of the device's projection accuracy concluded a mean projection error of 1.3 mm. Visibility testing of the projection performed on pig liver tissue found the device suitable for the display of anatomical structures on the organ surface. The feasibility of use within the surgical workflow was assessed during open liver surgery. We show that the device could be quickly and unobtrusively deployed within the sterile environment.

Both Hip Dysplasia(DDH) and Femoro-acetabular-Impingement(FAI) are complex three-dimensional hip pathologies causing hip pain and osteoarthritis in young patients. 3D-MRI-based models were used for radiation-free computer-assisted surgical planning. Automatic segmentation of MRI-based 3D-models are preferred because manual segmentation is time-consuming. To investigate(1) the difference and(2) the correlation for femoral head coverage(FHC) between automatic MR-based and manual CT-based 3D-models and (3) feasibility of preoperative planning in symptomatic patients with hip diseases. We performed an IRB-approved comparative, retrospective study of 31 hips(26 symptomatic patients with hip dysplasia or FAI). 3D MRI sequences and CT scans of the hip were acquired. Preoperative MRI included axial-oblique T1 VIBE sequence(0.8 mm3 isovoxel) of the hip joint. Manual segmentation of MRI and CT scans were performed. Automatic segmentation of MRI-based 3D-models was performed using deep learning. (1)The difference between automatic and manual segmentation of MRI-based 3D hip joint models was below 1 mm(proximal femur 0.2 ± 0.1 mm and acetabulum 0.3 ± 0.5 mm). Dice coefficients of the proximal femur and the acetabulum were 98 % and 97 %, respectively. (2)The correlation for total FHC was excellent and significant(r = 0.975, p < 0.001) between automatic MRI-based and manual CT-based 3D-models. Correlation for total FHC (r = 0.979, p < 0.001) between automatic and manual MR-based 3D models was excellent. (3)Preoperative planning and simulation of periacetabular osteotomy was feasible in all patients(100 %) with hip dysplasia or acetabular retroversion. Automatic segmentation of MRI-based 3D-models using deep learning is as accurate as CT-based 3D-models for patients with hip diseases of childbearing age. This allows radiation-free and patient-specific preoperative simulation and surgical planning of periacetabular osteotomy for patients with DDH.

Three-dimensional (3D)-image-based anatomical analysis of rotator cuff tear patients has been proposed as a way to improve repair prognosis analysis to reduce the incidence of postoperative retear. However, for application in clinics, an efficient and robust method for the segmentation of anatomy from MRI is required. We present the use of a deep learning network for automatic segmentation of the humerus, scapula, and rotator cuff muscles with integrated automatic result verification. Trained on N = 111 and tested on N = 60 diagnostic T1-weighted MRI of 76 rotator cuff tear patients acquired from 19 centers, a nnU-Net segmented the anatomy with an average Dice coefficient of 0.91 ± 0.06. For the automatic identification of inaccurate segmentations during the inference procedure, the nnU-Net framework was adapted to allow for the estimation of label-specific network uncertainty directly from its subnetworks. The average Dice coefficient of segmentation results from the subnetworks identified labels requiring segmentation correction with an average sensitivity of 1.0 and a specificity of 0.94. The presented automatic methods facilitate the use of 3D diagnosis in clinical routine by eliminating the need for time-consuming manual segmentation and slice-by-slice segmentation verification.

Purpose: Preservation surgery can halt the progress of joint degradation, preserving the life of the hip; however, outcome depends on the existing cartilage quality. Biochemical analysis of the hip cartilage utilizing MRI sequences such as delayed gadolinium-enhanced MRI of cartilage (dGEMRIC), in addition to morphological analysis, can be used to detect early signs of cartilage degradation. However, a complete, accurate 3D analysis of the cartilage regions and layers is currently not possible due to a lack of diagnostic tools. Methods: A system for the efficient automatic parametrization of the 3D hip cartilage was developed. 2D U-nets were trained on manually annotated dual-flip angle (DFA) dGEMRIC for femoral head localization and cartilage segmentation. A fully automated cartilage sectioning pipeline for analysis of central and peripheral regions, femoral-acetabular layers, and a variable number of section slices, was developed along with functionality for the automatic calculation of dGEMRIC index, thickness, surface area, and volume. Results: The trained networks locate the femoral head and segment the cartilage with a Dice similarity coefficient of 88 ± 3 and 83 ± 4% on DFA and magnetization-prepared 2 rapid gradient-echo (MP2RAGE) dGEMRIC, respectively. A completely automatic cartilage analysis was performed in 18s, and no significant difference for average dGEMRIC index, volume, surface area, and thickness calculated on manual and automatic segmentation was observed. Conclusion: An application for the 3D analysis of hip cartilage was developed for the automated detection of subtle morphological and biochemical signs of cartilage degradation in prognostic studies and clinical diagnosis. The segmentation network achieved a 4-time increase in processing speed without loss of segmentation accuracy on both normal and deformed anatomy, enabling accurate parametrization. Retraining of the networks with the promising MP2RAGE protocol would enable analysis without the need for B1 inhomogeneity correction in the future.

Background: Rotator cuff disorders, whether symptomatic or asymptomatic, may result in abnormal shoulder kinematics (scapular rotation and glenohumeral translation). This study aimed to investigate the effect of rotator cuff tears on in vivo shoulder kinematics during a 30° loaded abduction test using single-plane fluoroscopy. Materials and methods: In total, 25 younger controls, 25 older controls and 25 patients with unilateral symptomatic rotator cuff tears participated in this study. Both shoulders of each participant were analysed and grouped on the basis of magnetic resonance imaging into healthy, rotator cuff tendinopathy, asymptomatic and symptomatic rotator cuff tears. All participants performed a bilateral 30° arm abduction and adduction movement in the scapular plane with handheld weights (0, 2 and 4 kg) during fluoroscopy acquisition. The range of upward–downward scapular rotation and superior–inferior glenohumeral translation were measured and analysed during abduction and adduction using a linear mixed model (loads, shoulder types) with random effects (shoulder ID). Results: Scapular rotation was greater in shoulders with rotator cuff tendinopathy and asymptomatic rotator cuff tears than in healthy shoulders. Additional load increased upward during abduction and downward during adduction scapular rotation (P < 0.001 in all groups but rotator cuff tendinopathy). In healthy shoulders, upward scapular rotation during 30° abduction increased from 2.3° with 0-kg load to 4.1° with 4-kg load and on shoulders with symptomatic rotator cuff tears from 3.6° with 0-kg load to 6.5° with 4-kg load. Glenohumeral translation was influenced by the handheld weights only in shoulders with rotator cuff tendinopathy (P ≤ 0.020). Overall, superior glenohumeral translation during 30° abduction was approximately 1.0 mm with all loads. Conclusions: The results of glenohumeral translation comparable to control but greater scapular rotations during 30° abduction in the scapular plane in rotator cuff tears indicate that the scapula compensates for rotator cuff deficiency by rotating. Further analysis of load-dependent joint stability is needed to better understand glenohumeral and scapula motion. Level of evidence: Level 2. Trial registration: Ethical approval was obtained from the regional ethics committee (Ethics Committee Northwest Switzerland EKNZ 2021-00182), and the study was registered at clinicaltrials.gov on 29 March 2021 (trial registration number NCT04819724, https://clinicaltrials.gov/ct2/show/NCT04819724).

Scapular morphological attributes show promise as prognostic indicators of retear following rotator cuff repair. Current evaluation techniques using single-slice magnetic-resonance imaging (MRI) are, however, prone to error, while more accurate computed tomography (CT)-based three-dimensional techniques, are limited by cost and radiation exposure. In this study we propose deep learning-based methods that enable automatic scapular morphological analysis from diagnostic MRI despite the anisotropic resolution and reduced field of view, compared to CT. A deep learning-based segmentation network was trained with paired CT derived scapula segmentations. An algorithm to fuse multi-plane segmentations was developed to generated high-resolution 3D models of the scapula on which morphological landmark- and axes were predicted using a second deep learning network for morphological analysis. Using the proposed methods, the critical shoulder angle, glenoid inclination and version were measured from MRI with accuracies of -1.3 ± 1.7 degrees, 1.3 ± 2.1 degree, and − 1.4 ± 3.4 degrees respectively, compared to CT. Inter-class correlation between MRI and CT derived metrics were substantial for the glenoid version and almost perfect for the other metrics. This study demonstrates how deep learning can overcome reduced resolution, bone border contrast and field of view, to enable 3D scapular morphology analysis on MRI.