The technology of augmented and mixed reality (AR/MR) is useful in various areas of modern surgery. We considered the use of augmented and mixed reality technologies as a method of preoperative planning and intraoperative navigation in abdominal cancer patients. Practical use of AM/MR raises a range questions, which demand suitable solutions. The difficulties and obstacles we encountered in the practical use of AR/MR are presented, along with the ways we chose to overcome them. The most demonstrative case is covered in detail. The three-dimensional anatomical model obtained from the CT scan needed to be rigidly attached to the patient’s body, and therefore an invasive approach was developed, using an orthopedic pin fixed to the pelvic bones. The pin is used both similarly to an X-ray contrast marker and as a marker for augmented reality. This solution made it possible, not only to visualize the anatomical structures of the patient and the border zone of the tumor, but also to change the position of the patient during the operation. In addition, a noninvasive (skin-based) marking method was developed that allows the application of mixed and augmented reality during operation. Both techniques were used (8 clinical cases) for preoperative planning and intraoperative navigation, which allowed surgeons to verify the radicality of the operation, to have visual control of all anatomical structures near the zone of interest, and to reduce the time of surgical intervention, thereby reducing the complication rate and improving the rehabilitation period.

The paper considers the possibilities, prospects, and drawbacks of the mixed reality (MR) technology application using mixed reality smartglasses Microsoft HoloLens 2. The main challenge was to find and develop an approach that would allow surgeons to conduct operations using mixed reality on a large scale, reducing the preparation time required for the procedure and without having to create custom solutions for each patient. Research was conducted in three clinical cases: two median neck and one branchial cyst excisions. In each case, we applied a unique approach of hologram positioning in space based on mixed reality markers. As a result, we listed a series of positive and negative aspects related to MR surgery, along with proposed solutions for using MR in surgery on a daily basis.

Lysenko A, et al. Imaging Sci Dent. 2022 Mar;52:e12. https://doi.org/10.5624/isd.20210256

Augmented reality (AR) is a promising area in microsurgical treatment of cerebrovascular pathologies that can significantly facilitate preoperative planning and intraoperative understanding of anatomy. Objective. To describe AR-assisted neuronavigation in microsurgical treatment of intracranial aneurysms, arteriovenous malformations and cavernomas; to evaluate accuracy and applicability of AR-assisted neuronavigation. Material and methods. The study involved 22 patients with cerebral aneurysms, arteriovenous and cavernous malformations. Microsoft Hololens 2 HMD glasses and «Medgital» software for AR navigation were used. Accuracy of registration (TRE and FRE) and time for preoperative preparation were evaluated. Results. Mean TRE when using QR code was 0.6±0.2 cm, when combining through craniometric points — 1.4±0.6 cm. Time for preoperative image processing was 24.7±5.1 minutes, application setup in the operating theatre — 1.6±0.2 minutes. Combination using QR code provided higher accuracy of registration compared to craniometric points. AR-assisted navigation improved visualization and planning of surgeries for aneurysms, arteriovenous malformations, microvascular anastomoses and cavernous angiomas. Conclusion. AR-assisted navigation is an innovative method with specific advantages that can potentially improve microsurgical treatment of cerebrovascular diseases. Further research is needed to confirm these findings and develop AR technology in neurosurgery.

Surgical treatment of locally spread tumors in pelvic organs remains an urgent and complicated oncological problem. The recurrence rate after radical treatment ranges from 15.1% to 45.2%. The key to successful and safe surgical intervention lies in meticulous planning and intraoperative navigation, including the utilization of augmented reality (AR) technology. This paper presents the experience of clinically testing an AR technology application algorithm in the surgical treatment of 11 patients. The main stages of the algorithm are described. Radical operations incorporating intraoperative AR technology with favorable outcomes were performed on eight patients. One patient underwent a palliative intervention, while two patients did not undergo surgery. The testing of the algorithm for the application of AR technology in the surgical treatment of primary and recurrent pelvic tumors demonstrated both a technical possibility and reproducibility of this algorithm and the AR technology itself in clinical practice.