This review aims to examine the existing literature to address currently used virtual, augmented, and mixed reality modalities in the areas of preoperative surgical planning, intraoperative guidance, and postoperative management in the field of cardiothoracic surgery. In addition this innovative technology provides future perspectives and potential benefits for cardiothoracic surgeons, trainees, and patients. A targeted, nonsystematic literature assessment was performed within the Medline and Google Scholar databases to help identify current trends and to provide better understanding of the current state-of-the-art extended reality (XR) modalities in cardiothoracic surgery. Related articles published up to July 2020 were included in the review. XR is a novel technique gaining increasing application in cardiothoracic surgery. It provides a 3-dimensional and realistic view of structures and environments and offers the user the ability to interact with digital projections of surgical targets. Recent studies showed the validity and benefits of XR applications in cardiothoracic surgery. Examples include XR-guided preoperative planning, intraoperative guidance and navigation, postoperative pain and rehabilitation management, surgical simulation, and patient education. XR is gaining interest in the field of cardiothoracic surgery. In particular there are promising roles for XR applications in televirtuality, surgical planning, surgical simulation, and perioperative management. However future refinement and research are needed to further implement XR in the aforementioned settings within cardiothoracic surgery.

There has been an increasing trend toward pulmonary segmentectomies to treat early-stage lung cancer, small intrapulmonary metastases, and localized benign pathology. A complete preoperative understanding of pulmonary anatomy is essential for accurate surgical planning and case selection. Identifying intersegmental divisions is extremely difficult when performed on computed tomography. For the preoperative planning of segmentectomies, virtual reality (VR) and artificial intelligence could allow 3-dimensional visualization of the complex anatomy of pulmonary segmental divisions, vascular arborization, and bronchial anatomy. This technology can be applied by surgeons preoperatively to gain better insight into a patient's anatomy for planning segmentectomy. In this prospective observational pilot study, we aim to assess and demonstrate the technical feasibility and clinical applicability of the first dedicated artificial intelligence-based and immersive 3-dimensional-VR platform (PulmoVR; jointly developed and manufactured by Department of Cardiothoracic Surgery [Erasmus Medical Center, Rotterdam, The Netherlands], MedicalVR [Amsterdam, The Netherlands], EVOCS Medical Image Communication [Fysicon BV, Oss, The Netherlands], and Thirona [Nijmegen, The Netherlands]) for preoperative planning of video-assisted thoracoscopic segmentectomies. A total of 10 eligible patients for segmentectomy were included in this study after referral through the institutional thoracic oncology multidisciplinary team. PulmoVR was successfully applied as a supplementary imaging tool to perform video-assisted thoracoscopic segmentectomies. In 40% of the cases, the surgical strategy was adjusted due to the 3-dimensional-VR–based evaluation of anatomy. This underlines the potential benefit of additional VR-guided planning of segmentectomy for both surgeon and patient. Our study demonstrates the successful development and clinical application of the first dedicated artificial intelligence and VR platform for the planning of pulmonary segmentectomy. This is the first study that shows an immersive virtual reality-based application for preoperative planning of segmentectomy to the best of our knowledge.

Increased complexity in cardiac surgery over the last decades necessitates more precise preoperative planning to minimize operating time, to limit the risk of complications during surgery and to aim for the best possible patient outcome. Novel, more realistic, and more immersive techniques, such as three-dimensional (3D) virtual reality (VR) could potentially contribute to the preoperative planning phase. This study shows our initial experience on the implementation of immersive VR technology as a complementary research-based imaging tool for preoperative planning in cardiothoracic surgery. In addition, essentials to set up and implement a VR platform are described. Six patients who underwent cardiac surgery at the Erasmus Medical Center, Rotterdam, The Netherlands, between March 2020 and August 2020, were included, based on request by the surgeon and availability of computed tomography images. After 3D VR rendering and 3D segmentation of specific structures, the reconstruction was analysed via a head mount display. All participating surgeons (n = 5) filled out a questionnaire to evaluate the use of VR as preoperative planning tool for surgery. Our study demonstrates that immersive 3D VR visualization of anatomy might be beneficial as a supplementary preoperative planning tool for cardiothoracic surgery, and further research on this topic may be considered to implement this innovative tool in daily clinical practice. Over the past decades, surgery on the heart and vessels is becoming more and more complex, necessitating more precise and accurate preoperative planning. Nowadays, operative planning is feasible on flat, two-dimensional computer screens, however, requiring a lot of spatial and three-dimensional (3D) thinking of the surgeon. Since immersive 3D virtual reality (VR) is an upcoming imaging technique with promising results in other fields of surgery, we aimed in this study to explore the additional value of this technique in heart surgery. Our surgeons planned six different heart operations by visualizing computed tomography scans with a dedicated VR headset, enabling them to visualize the patient’s anatomy in an immersive and 3D environment. The outcomes of this preliminary study are positive, with a much more reality-like simulation for the surgeon. In such, VR could potentially be beneficial as a preoperative planning tool for complex heart surgery.

Background: Cardiac arrest after cardiac surgery commonly has a reversible cause, where emergency resternotomy is often required for treatment, as recommended by international guidelines. We have developed a virtual reality (VR) simulation for training of cardiopulmonary resuscitation (CPR) and emergency resternotomy procedures after cardiac surgery, the Cardiopulmonary Resuscitation Virtual Reality Simulator (CPVR-sim). Two fictive clinical scenarios were used: one case of pulseless electrical activity (PEA) and a combined case of PEA and ventricular fibrillation. In this prospective study, we researched the face validity and content validity of the CPVR-sim. Objective: We designed a prospective study to assess the feasibility and to establish the face and content validity of two clinical scenarios (shockable and nonshockable cardiac arrest) of the CPVR-sim partly divided into a group of novices and experts in performing CPR and emergency resternotomies in patients after cardiac surgery. Methods: Clinicians (staff cardiothoracic surgeons, physicians, surgical residents, nurse practitioners, and medical students) participated in this study and performed two different scenarios, either PEA or combined PEA and ventricular fibrillation. All participants (N=41) performed a simulation and completed the questionnaire rating the simulator’s usefulness, satisfaction, ease of use, effectiveness, and immersiveness to assess face validity and content validity. Results: Responses toward face validity and content validity were predominantly positive in both groups. Most participants in the PEA scenario (n=26, 87%) felt actively involved in the simulation, and 23 (77%) participants felt in charge of the situation. The participants thought it was easy to learn how to interact with the software (n=24, 80%) and thought that the software responded adequately (n=21, 70%). All 15 (100%) expert participants preferred VR training as an addition to conventional training. Moreover, 13 (87%) of the expert participants would recommend VR training to other colleagues, and 14 (93%) of the expert participants thought the CPVR-sim was a useful method to train for infrequent post–cardiac surgery emergencies requiring CPR. Additionally, 10 (91%) of the participants thought it was easy to move in the VR environment, and that the CPVR-sim responded adequately in this scenario. Conclusions: We developed a proof-of-concept VR simulation for CPR training with two scenarios of a patient after cardiac surgery, which participants found was immersive and useful. By proving the face validity and content validity of the CPVR-sim, we present the first step toward a cardiothoracic surgery VR training platform.

We present the rendering of a computed tomography (CT) scan in an immersive virtual reality (VR) environment for reviewing anatomy and preoperative planning of minimally invasive direct coronary artery bypass (MIDCAB). An 18-year-old man with a history of Kawasaki disease and associated left anterior descending (LAD) and right coronary artery (RCA) aneurysms, was referred to our multidisciplinary heart meeting to evaluate the necessity of coronary revascularization. The patient had no complaints, the electrocardiogram was normal and echocardiogram showed no resting regional wall motion abnormalities. Stress cardiac magnetic resonance imaging established subendocardial hypoperfusion defects in the LAD region without signs of myocardial fibrosis. A coronary angiography revealed a proximally calcified aneurysm and an occlusion of the LAD with collateral retrograde filling from the RCA and no abnormalities in the left circumflex (Cx) artery (Panels A and B, Supplementary material online, Videos S1 and S2 ). Aneurysm formation of the left internal mammary artery (LIMA) was ruled out with angiography (Panel F). The patient was accepted for MIDCAB, LIMA to LAD coronary revascularization. To prepare for surgery, reconstructions of a CT scan were made by rendering 3D-VR images on our MedicalVR workstation (MedicalVR, Amsterdam, The Netherlands) (Panel C). An interactive reconstruction of the CT scan was made that enabled immersive-360° review of coronary anatomy in a head-mounted VR device (Panels D and E, Supplementary material online, Video S3 ). In addition, immersive VR was used to plan for the insertion location of thoracoscopic ports (for LIMA harvesting) and for determining the ideal location for anterior mini-thoracotomy (Panels G–J, Supplementary material online, Videos S4–S6 ) and direct off-pump MIDCAB using soft-tissue retractor. Cx, left circumflex artery; LAD, left anterior descending; LIMA, left internal mammary artery; RCA, right coronary artery.