In this paper, we deal with several aspects related to the control of tendon-based actuation systems for robotic devices. In particular, the problems that are considered in this paper are related to the modeling, identification, and control of tendons sliding on curved pathways, subject to friction and viscoelastic effects. Tendons made in polymeric materials are considered, and therefore, hysteresis in the transmission system characteristic must be taken into account as an additional nonlinear effect because of the plasticity and creep phenomena typical of these materials. With the aim of reproducing these behaviors, a viscoelastic model is used to model the tendon compliance. Particular attention has been given to the friction effects arising from the interaction between the tendon pathway and the tendon itself. This phenomenon has been characterized by means of a LuGre-like dynamic friction model to consider the effects that cannot be reproduced by employing a static friction model. A specific setup able to measure the tendon's tension in different points along its path has been designed in order to verify the tension distribution and identify the proper parameters. Finally, a simple control strategy for the compensation of these nonlinear effects and the control of the force that is applied by the tendon to the load is proposed and experimentally verified.

In this article, a deep learning method for the shape sensing of continuum robots based on multicore fiber bragg grating (FBG) fiber is introduced. The proposed method, based on an artificial neural network (ANN), differs from traditional approaches, where accurate shape reconstruction requires a tedious characterization of many characteristic parameters. A further limitation of traditional approaches is that they require either multiple fibers, whose location relative to the centerline must be precisely known (calibrated), or a single multicore fiber whose position typically coincides with the neutral line. The proposed method addresses this limitation and, thus, allows shape sensing based on a single multicore fiber placed off-center. This helps in miniaturizing and leaves the central channel available for other purposes. The proposed approach was compared to a recent state-of-the-art model-based shape sensing approach. A two-degree-of-freedom benchtop fluidics-driven catheter system was built to validate the proposed ANN. The proposed ANN-based shape sensing approach was evaluated on a 40-mm-long steerable continuum robot in both 3-D free-space and 2-D constrained environments, yielding an average shape sensing error of 0.24 and 0.49 mm, respectively. With these results, the superiority of the proposed approach compared to the recent model-based shape sensing method was demonstrated.

Force sensing is highly desirable in minimally invasive medical applications, since this feature shows great potential for reducing tissue damage and enhancing manipulation safety. However, embedding force sensors in medical devices is challenging and costly. This article explores the possibility to use shape sensing as a measure to extract force information. In this work, a model-based approach that allows simultaneous shape and force sensing is proposed. Shape information is reconstructed employing a multicore fiber with fiber Bragg grating sensors spaced over the fiber length. This fiber is capable of distributed 3D shape sensing. It is shown how by making use of extended Kalman filter and a mechanics model of the flexible instrument, it becomes possible to estimate both the magnitudes and locations of externally applied forces. Experiments were carried out to validate the proposed method for both one and two external forces applied at arbitrary locations in different directions on a flexible instrument. Results show that one-directional force magnitude and location can be estimated with an average error of 23.08 mN (15.39%) and 11.06 mm (6.51%), respectively. For two-directional forces, results of the load near the base show an average error of 52.01 mN (30.59%) for the magnitude and 29.24 mm (17.20%) for the location. For the load applied simultaneously near the tip, the mean magnitude error is 16.79 mN (11.19%) and the average location error is 10.18 mm (5.99%). The force sensing algorithm can run in real time with an approximate frequency of 59 Hz. In these experiments, it can be observed that the force-sensing accuracy, which depends on the sensitivity of the shape of flexible instruments with respect to the external force, can vary drastically in function of the force application point and force direction.

In cardiovascular interventions, when steering catheters and especially robotic catheters, great care should be paid to prevent applying too large forces on the vessel walls as this could dislodge calcifications, induce scars or even cause perforation. To address this challenge, this paper presents a novel compliant motion control algorithm that relies solely on position sensing of the catheter tip and knowledge of the catheter’s behavior. The proposed algorithm features a data-driven tip position controller. The controller is trained based on a so-called control Long Short-Term Memory Network (control-LSTM). Trajectory following experiments are conducted to validate the quality of the proposed control-LSTM. Results demonstrated superior positioning capability with sub-degree precision of the new approach in the presence of severe rate-dependent hysteresis. Experiments both in a simplified setup as well as in an aortic phantom further show that the proposed approach allows reducing the interaction forces with the environment by around 70%. This work shows how deep learning can be exploited advantageously to avoid tedious modeling that would be needed to precisely steer continuum robots in constrained environments such as the patient’s vasculature.

Endovascular catheterization is an intervention which offers a low risk alternative to open surgery in many patients. Today’s interventions rely heavily on fluoroscopic imaging to guide interventionalists. Fluoroscopy only produces 2D visualization of the catheter and also exposes both the patient and interventionalists to harmful radiation. Different approaches have been proposed to overcome the limitations of fluoroscopy. Fiber Bragg Grating (FBG)-based shape sensing is becoming popular to reconstruct the catheter shape. Multi-core fibers with parallel optical cores are interesting as they allow 3D shape reconstruction with a single fiber. A common issue with FBG-based shape sensing is its sensitivity to variations in twist. Even small amounts of twist can significantly impact the overall shape reconstruction accuracy. This work proposes a novel approach which combines electromagnetic tracking (EMT), FBG-based shape sensing, and sparse fluoroscopic images. The method provides real-time 3D visualization of the catheter without the need of continuous fluoroscopy. A unique feature of the proposed method is the selective use of imaging for dynamic twist-compensation of the FBG sensor. The proposed sensor-fusion method improved 3D reconstruction accuracy. Real-world in-vitro experiments promising results. For a catheter with an embedded fiber length of 170 mm, the proposed approach the 3D shape with a median root-mean-square (rms) error of 0.39 mm and an interquartile range of 0.10 mm in the 2D experiment in which the catheter was bent in a plane. A median rms error of 0.54 mm and an interquartile range of 0.07 mm were achieved in the 3D experiments.