7 June 2021 in IEEE Robotics and Automation Letters
Optical coherence tomography (OCT) endoscopic catheters provide efficient solutions for the non-invasive scan of malignant tissues in internal human organs. In this letter, we investigate the image-guided control of a robotic flexible endoscopic system equipped with an OCT probe for autonomous tissue scanning. The visual control strategy is achieved by combining the image feedback from both a monocular endoscopic camera (eye-to-hand) and an OCT probe (eye-in-hand). Our control strategy allows the OCT probe to automatically track a trajectory defined by the user on the 2D endoscopic image and keep contact with the scanned surface. The orientation, depth, and endoscopic 2D image position are controlled by solving an optimization problem, which is converted to a quadratic programming problem. For the implementation of the visual control strategy, we also consider visibility constraints and actuators limitations. In addition, a marker-based method to estimate the 3D pose of the continuum robot using only 2D images is proposed based on a Kalman filter and a registration technique. The proposed control strategy is validated using both simulation and laboratory experiments.
19 June 2020 in IEEE Robotics and Automation Letters
Accurate control of continuum robots requires handling non-linear behaviors between actuators and distal effectors. In this letter, we develop a method for estimating the non-linearities of tendon-driven degrees of freedom of flexible endoscopic systems by using a distal endoscopic camera and encoders at the proximal side. The proposed approach separates the non-linearities in two parts, namely a pure non uniform backlash and a non-linear function. The backlash is estimated without relying on any model, while the non-linear function is obtained by a pose estimation process. Experiments realized on a robotic flexible endoscopy platform (STRAS) show the validity of the approach for estimating in situ the quasi-static behavior of the robot and for compensating the non-linearities of the motion transmission.
22 January 2022 in Medical Image Analysis
Optical Coherence Tomography (OCT) is increasingly used in endoluminal procedures since it provides high-speed and high resolution imaging. Distortion and instability of images obtained with a proximal scanning endoscopic OCT system are significant due to the motor rotation irregularity, the friction between the rotating probe and outer sheath and synchronization issues. On-line compensation of artefacts is essential to ensure image quality suitable for real-time assistance during diagnosis or minimally invasive treatment. In this paper, we propose a new online correction method to tackle both B-scan distortion, video stream shaking and drift problem of endoscopic OCT linked to A-line level image shifting. The proposed computational approach for OCT scanning video correction integrates a Convolutional Neural Network (CNN) to improve the estimation of azimuthal shifting of each A-line. To suppress the accumulative error of integral estimation we also introduce another CNN branch to estimate a dynamic overall orientation angle. We train the network with semi-synthetic OCT videos by intentionally adding rotational distortion into real OCT scanning images. The results show that networks trained on this semi-synthetic data generalize to stabilize real OCT videos, and the algorithm efficacy is demonstrated on both ex vivo and in vivo data, where strong scanning artifacts are successfully corrected.