OBJECTIVE: The authors aimed to evaluate the technical feasibility of a mixed-reality neuronavigation (MRN) system with a wearable head-mounted device (HMD) and to determine its clinical application and accuracy. METHODS: A semiautomatic registration MRN system on HoloLens smart glasses was developed and tested for accuracy and feasibility. Thirty-seven patients with intracranial lesions were prospectively identified. For each patient, multimodal imaging–based holograms of lesions, markers, and surrounding eloquent structures were created and then imported to the MRN HMD. After a point-based registration, the holograms were projected onto the patient's head and observed through the HMD. The contour of the holograms was compared with standard neuronavigation (SN). The projection of the lesion boundaries perceived by the neurosurgeon on the patient's scalp was then marked with MRN and SN. The distance between the two contours generated by MRN and SN was measured so that the accuracy of MRN could be assessed. RESULTS: MRN localization was achieved in all patients. The mean additional time required for MRN was 36.3 ± 6.3 minutes, in which the mean registration time was 2.6 ± 0.9 minutes. A trend toward a shorter time required for preparation was observed with the increase of neurosurgeon experience with the MRN system. The overall median deviation was 4.1 mm (IQR 3.0 mm–4.7 mm), and 81.1% of the lesions localized by MRN were found to be highly consistent with SN (deviation < 5.0 mm). There was a significant difference between the supine position and the prone position (3.7 ± 1.1 mm vs 5.4 ± 0.9 mm, p = 0.001). The magnitudes of deviation vectors did not correlate with lesion volume (p = 0.126) or depth (p = 0.128). There was no significant difference in additional operating time between different operators (37.4 ± 4.8 minutes vs 34.6 ± 4.8 minutes, p = 0.237) or in localization deviation (3.7 ± 1.0 mm vs 4.6 ± 1.5 mm, p = 0.070). CONCLUSIONS: This study provided a complete set of a clinically applicable workflow on an easy-to-use MRN system using a wearable HMD, and has shown its technical feasibility and accuracy. Further development is required to improve the accuracy and clinical efficacy of this system.

OBJECTIVE: To increase access to health interventions and healthcare services for patients in resource-constrained settings, strategies such as telemedicine must be implemented for the allocation of medical resources across geographic boundaries. Telecollaboration is the dominant form of surgical telemedicine. In this study, the authors report and evaluate a novel mobile internet-based mixed-reality interactive telecollaboration (MIMIT) system as a new paradigm for telemedicine and validate its clinical feasibility. METHODS: The application of this system was demonstrated for long-distance, real-time collaboration of neuroendoscopic procedures. The system consists of a local video processing workstation, a head-mounted mixed-reality display device, and a mobile remote device, connected over mobile internet (4G or 5G), allowing global point-to-point communication. Using this system, 20 cases of neuroendoscopic surgery were performed and evaluated. The system setup, composite video latency, technical feasibility, clinical implementation, and future potential business model were analyzed and evaluated. RESULTS: The MIMIT system allows two surgeons to perform complex visual and verbal communication during the operation. The average video delay time is 184.25 msec (range 160–230 msec) with 4G mobile internet, and 23.25 msec (range 20–26 msec) with 5G mobile internet. Excellent image resolution enabled remote neurosurgeons to visualize all critical anatomical structures intraoperatively. Remote instructors could easily make marks on the surgical view; then the composite image, as well as the audio conversation, was transferred to the local surgeon. In this way, a real-time, long-distance collaboration can occur. This system was used for 20 neuroendoscopic surgeries in various cities in China and even across countries (Boston, Massachusetts, to Jingzhou, China). Its simplicity and practicality have been recognized by both parties, and there were no technically related complications recorded. CONCLUSIONS: The MIMIT system allows for real-time, long-distance telecollaborative neuroendoscopic procedures and surgical training through a commercially available and inexpensive system. It enables remote experts to implement real-time, long-distance intraoperative interaction to guide inexperienced local surgeons, thus integrating the best medical resources and possibly promoting both diagnosis and treatment. Moreover, it can popularize and improve neurosurgical endoscopy technology in more hospitals to benefit more patients, as well as more neurosurgeons.

Addressing conventional neurosurgical navigation systems’ high costs and complexity, this study explores the feasibility and accuracy of a simplified, cost-effective mixed reality navigation (MRN) system based on a laser crosshair simulator (LCS). A new automatic registration method was developed, featuring coplanar laser emitters and a recognizable target pattern. The workflow was integrated into Microsoft’s HoloLens-2 for practical application. The study assessed the system’s precision by utilizing life-sized 3D-printed head phantoms based on computed tomography (CT) or magnetic resonance imaging (MRI) data from 19 patients (female/male: 7/12, average age: 54.4 ± 18.5 years) with intracranial lesions. Six to seven CT/MRI-visible scalp markers were used as reference points per case. The LCS-MRN’s accuracy was evaluated through landmark-based and lesion-based analyses, using metrics such as target registration error (TRE) and Dice similarity coefficient (DSC). The system demonstrated immersive capabilities for observing intracranial structures across all cases. Analysis of 124 landmarks showed a TRE of 3.0 ± 0.5 mm, consistent across various surgical positions. The DSC of 0.83 ± 0.12 correlated significantly with lesion volume (Spearman rho = 0.813, p < 0.001). Therefore, the LCS-MRN system is a viable tool for neurosurgical planning, highlighting its low user dependency, cost-efficiency, and accuracy, with prospects for future clinical application enhancements.

Mixed Reality Navigation (MRN) is pivotal in augmented reality-assisted intelligent neurosurgical interventions. However, existing MRN registration methods face challenges in concurrently achieving low user dependency, high accuracy, and clinical applicability. This study proposes and evaluates a novel registration method based on a laser crosshair simulator, evaluating its feasibility and accuracy. A novel registration method employing a laser crosshair simulator was introduced, designed to replicate the scanner frame’s position on the patient. The system autonomously calculates the transformation, mapping coordinates from the tracking space to the reference image space. A mathematical model and workflow for registration were designed, and a Universal Windows Platform (UWP) application was developed on HoloLens-2. Finally, a head phantom was used to measure the system’s target registration error (TRE). The proposed method was successfully implemented, obviating the need for user interactions with virtual objects during the registration process. Regarding accuracy, the average deviation was 3.7 ± 1.7 mm. This method shows encouraging results in efficiency and intuitiveness and marks a valuable advancement in low-cost, easy-to-use MRN systems. The potential for enhancing accuracy and adaptability in intervention procedures positions this approach as promising for improving surgical outcomes.

OBJECTIVE: A clear, stable, suitably located vision field is essential for port surgery. A scope is usually held by hand or a fixing device. The former yields fatigue and requires lengthy training, while the latter increases inconvenience because of needing to adjust the scope. Thus, the authors innovated a novel robotic system that can recognize the port and automatically place the scope in an optimized position. In this study, the authors executed a preliminary experiment to test this system’s technical feasibility and accuracy in vitro. METHODS: A collaborative robotic (CoBot) system consisting of a mechatronic arm and a 3D camera was developed. With the 3D camera and programmed machine vision, CoBot can search a marker attached to the opening of the surgical port, followed by automatic alignment of the scope’s axis with the port’s longitudinal axis so that optimal illumination and visual observation can be achieved. Three tests were conducted. In test 1, the robot positioned a laser range finder attached to the robot’s arm to align the sheath’s center axis. The laser successfully passing through two holes in the port sheath’s central axis defined successful positioning. Researchers recorded the finder’s readings, demonstrating the actual distance between the finder and the sheath. In test 2, the robot held a high-definition exoscope and relocated it to the setting position. Test 3 was similar to test 2, but a metal holder substituted the robot. Trained neurosurgeons manually adjusted the holder. The manipulation time was recorded. Additionally, a grading system was designed to score each image captured by the exoscope at the setting position, and the scores in the two tests were compared using the rank-sum test. RESULTS: The CoBot system positioned the finder successfully in all rounds in test 1; the mean height errors ± SD were 1.14 mm ± 0.38 mm (downward) and 1.60 mm ± 0.89 mm (upward). The grading scores of images in tests 2 and 3 were significantly different. Regarding the total score and four subgroups, test 2 showed a more precise, better-positioned, and more stable vision field. The total manipulation time in test 2 was 20 minutes, and for test 3 it was 52 minutes. CONCLUSIONS: The CoBot system successfully acted as a robust scope holding system to provide a stable and optimized surgical view during simulated port surgery, providing further evidence for the substitution of human hands, and leading to a more efficient, user-friendly, and precise operation.