10 July 2023 in IEEE/ASME Transactions on Mechatronics
Endoscopes provide views inside the patient's body during minimally invasive surgery. Although various robotic endoscopes have been developed to reduce surgeons' workload in manual endoscope operations, autonomous endoscope manipulation remains challenging due to the misorientation effect and different disturbances. In this work, we developed an intelligent endoscope system to steer the surgical view automatically. To keep the target (i.e., the tip of an instrument) at the center of the camera view with a suitable size and orientation, an image moment-based 4-degree-of-freedom (DOF) visual servoing method is implemented. We propose an error learning-based sliding mode controller to realize fast and smooth error convergence. It is specially constructed to improve convergence rate without causing undesirable system chattering. Moreover, the kinematic modeling of the endoscope results in a quadratic programming problem, which is solved by a novel adaptive noise-immune zeroing neural network accelerated to predefined-time convergence by a newly constructed activation function. The experiments show that the proposed control strategy guarantees a superior convergence rate and robustness compared with existing methods. Lab tests show the application potential of the proposed endoscope system in clinical practice.
22 November 2024 in IEEE Transactions on Systems, Man, and Cybernetics: Systems
In minimally invasive surgery (MIS), the field of view (FOV) control is crucial. Autonomous endoscope robots have been developed to facilitate MIS procedures by enabling autonomous surgical target tracking, thus reducing the workload on surgeons. However, existing visual servoing-based target tracking methods for autonomous endoscopes often overlook the insecurity stemming from restricted workspace conditions. Instances, such as collisions between the endoscope robot’s tip and the patient’s chest or abdominal wall pose risks to patient tissue, while extensive motion of the endoscope shaft may damage incision port tissue. Addressing these security concerns, this article proposes a novel approach called virtual fixture-based restricted workspace constraint (RWSC) to reconstruct the endoscope robot’s movement range. A quadratic programming (QP) optimization framework is employed to govern the robot’s motion, ensuring autonomous target tracking while adhering to RWSCs. To solve the QP problem, we propose an adaptive zeroing neural network (ZNN) featuring a newly designed activation function (AF). This AF enhances the ZNN with predefined-time convergence and noise rejection capabilities, making it especially suitable for time-sensitive and noise-prone surgical applications. Theoretical analysis and experimental results demonstrate that our adaptive ZNN achieves shorter convergence times than existing neural dynamic-based QP solvers. Physical validations show the efficacy of the proposed RWSCs in limiting the workspace of the endoscope robot, while the FOV control strategy enables autonomous target tracking of flexible endoscopes under diverse constraints and objectives.
1 December 2018 in Journal of Petroleum Science and Engineering
18 January 2022 in Mechanism and Machine Theory
1 December 2014 in Inverse Problems