17 February 2023 in Physics in Medicine & Biology
Augmented reality (AR) surgical navigation has developed rapidly in recent years. This paper reviews and analyzes the visualization, registration, and tracking techniques used in AR surgical navigation systems, as well as the application of these AR systems in different surgical fields. The types of AR visualization are divided into two categories of in situ visualization and non in situ visualization. The rendering contents of AR visualization are various. The registration methods include manual registration, point-based registration, surface registration, marker-based registration, and calibration-based registration. The tracking methods consist of self-localization, tracking with integrated cameras, external tracking, and hybrid tracking. Moreover, we describe the applications of AR in surgical fields. However, most AR applications were evaluated through model experiments and animal experiments, and there are relatively few clinical experiments, indicating that the current AR navigation methods are still in the early stage of development. Finally, we summarize the contributions and challenges of AR in the surgical fields, as well as the future development trend. Despite the fact that AR-guided surgery has not yet reached clinical maturity, we believe that if the current development trend continues, it will soon reveal its clinical utility.
25 March 2018 in The International Journal of Medical Robotics and Computer Assisted Surgery
23 March 2023 in IEEE/ASME Transactions on Mechatronics
Minimally invasive surgery is gaining wide-spread attention in the laboratory and the clinic due to its advantages of less trauma, less pain, and faster recovery. Miniature continuum instruments with a large central channel are needed for reducing damage to healthy tissue and delivering multiple surgical tools in microsurgery such as fetal surgery and maxillary sinus surgery. In this article, we proposed a novel miniature spring-based cable-driven continuum manipulator characterized by its offset neutral bending plane and its simple and clever structure. These features enable the manipulator to have several advantages such as easy miniaturization, bending stability and uniformity, a large central channel, smaller cable tension required, and low cost. A piecewise constant curvature model, with the offset neutral bending plane taken into account, is presented for the kinematic control of the proposed manipulator. To explore the relationship between the cable tension and manipulator bending angle, the statics model based on the equivalent model principle, is exhaustively discussed. The accuracy of kinematics and statics models, as well as the design superiority, was verified experimentally. Furthermore, teleoperation experiments of peg-transfer tasks and porcine tissue laser ablation are conducted to verify the feasibility and effectiveness of the proposed manipulator in different forms. Final, design variations are showcased to enrich manipulator design and functionality.
26 September 2015 in International Journal of Computer Assisted Radiology and Surgery
17 August 2012 in Archives of orthopaedic and trauma surgery
1 September 2023 in IEEE Journal of Translational Engineering in Health and Medicine
Objective: During minimal invasive surgery (MIS), the laparoscope only provides a single viewpoint to the surgeon, leaving a lack of 3D perception. Many works have been proposed to obtain depth and 3D reconstruction by designing a new optical structure or by depending on the camera pose and image sequences. Most of these works modify the structure of the conventional laparoscopes and cannot provide 3D reconstruction of different magnification views. Methods: In this study, we propose a laparoscopic system based on double liquid lenses, which provide doctors with variable magnification rates, near observation, and real-time monocular 3D reconstruction. Our system composes of an optical structure that can obtain auto magnification change and autofocus without any physically moving element, and a deep learning network based on the Depth from Defocus (DFD) method, trained to suit inconsistent camera intrinsic situations and estimate depth from images of different focal lengths. The optical structure is portable and can be mounted on conventional laparoscopes. The depth estimation network estimates depth in real-time from monocular images of different focal lengths and magnification rates. Results: Experiments show that our system provides a 0.68-1.44x zoom rate and can estimate depth from different magnification rates at 6fps. Monocular 3D reconstruction reaches at least 6mm accuracy. The system also provides a clear view even under 1mm close working distance. Conclusion: Ex-vivo experiments and implementation on clinical images prove that our system provides doctors with a magnified clear view of the lesion, as well as quick monocular depth perception during laparoscopy, which help surgeons get better detection and size diagnosis of the abdomen during laparoscope surgeries.