Needle insertion is commonly performed in minimally invasive medical procedures such as biopsy and radiation cancer treatment. During such procedures, accurate needle tip placement is critical for correct diagnosis or successful treatment. Accurate placement of the needle tip inside tissue is challenging, especially when the target moves and anatomical obstacles must be avoided. We develop a needle steering system capable of autonomously and accurately guiding a steerable needle using two-dimensional (2D) ultrasound images. The needle is steered to a moving target while avoiding moving obstacles in a three-dimensional (3D) non-static environment. Using a 2D ultrasound imaging device, our system accurately tracks the needle tip motion in 3D space in order to estimate the tip pose. The needle tip pose is used by a rapidly exploring random tree-based motion planner to compute a feasible needle path to the target. The motion planner is sufficiently fast such that replanning can be performed repeatedly in a closed-loop manner. This enables the system to correct for perturbations in needle motion, and movement in obstacle and target locations. Our needle steering experiments in a soft-tissue phantom achieves maximum targeting errors of 0.86 ± 0.35 mm (without obstacles) and 2.16 ± 0.88 mm (with a moving obstacle).

Needle insertion procedures are commonly used for diagnostic and therapeutic purposes. In this paper, an image-guided control system is developed to robotically steer flexible needles with an asymmetric tip. Knowledge about needle deflection is required for accurate steering. Two different models to predict needle deflection are presented. The first is a kinematics-based model, and the second model predicts needle deflection that is based on the mechanics of needle-tissue interaction. Both models predict deflection of needles that undergo multiple bends. The maximum targeting errors of the kinematics-based and the mechanics-based models for 110-mm insertion distance using a φ 0.5-mm needle are 0.8 and 1.7 mm, respectively. The kinematics-based model is used in the proposed image-guided control system. The control system accounts for target motion during the insertion procedure by detecting the target position in each image frame. Five experimental cases are presented to validate the real-time control system using both camera and ultrasound images as feedback. The experimental results show that the targeting errors of camera and ultrasound image-guided steering toward a moving target are 0.35 and 0.42 mm, respectively. The targeting accuracy of the algorithm is sufficient to reach the smallest lesions (φ 2 mm) that can be detected using the state-of-the-art ultrasound imaging systems.

Needle insertion procedures are commonly used for surgical interventions. In this paper, we develop a three-dimensional (3D) closed-loop control algorithm to robotically steer flexible needles with an asymmetric tip towards a target in a soft-tissue phantom. Twelve Fiber Bragg Grating (FBG) sensors are embedded on the needle shaft. FBG sensors measure the strain applied on the needle during insertion. A method is developed to reconstruct the needle shape using the strain data obtained from the FBG sensors. Four experimental cases are conducted to validate the reconstruction method (single-bend, double-bend, 3D double-bend and drilling insertions). In the experiments, the needle is inserted 120 mm into a soft-tissue phantom. Camera images are used as a reference for the reconstruction experiments. The results show that the mean needle tip accuracy of the reconstruction method is 1.8 mm. The reconstructed needle shape is used as feedback for the steering algorithm. The steering algorithm estimates the region that the needle can reach during insertion, and controls the needle to keep the target in this region. Steering experiments are performed for 110 mm insertion, and the mean targeting accuracy is 1.3 mm. The results demonstrate the capability of using FBG sensors to robotically steer needles.

Needle insertion in soft-tissue is a minimally invasive surgical procedure that demands high accuracy. In this respect, robotic systems with autonomous control algorithms have been exploited as the main tool to achieve high accuracy and reliability. However, for reasons of safety and responsibility, autonomous robotic control is often not desirable. Therefore, it is necessary to focus also on techniques enabling clinicians to directly control the motion of the surgical tools. In this work, we address that challenge and present a novel teleoperated robotic system able to steer flexible needles. The proposed system tracks the position of the needle using an ultrasound imaging system and computes needle's ideal position and orientation to reach a given target. The master haptic interface then provides the clinician with mixed kinesthetic-vibratory navigation cues to guide the needle toward the computed ideal position and orientation. Twenty participants carried out an experiment of teleoperated needle insertion into a soft-tissue phantom, considering four different experimental conditions. Participants were provided with either mixed kinesthetic vibratory feedback or mixed kinesthetic-visual feedback. Moreover, we considered two different ways of computing ideal position and orientation of the needle: with or without set-points. Vibratory feedback was found more effective than visual feedback in conveying navigation cues, with a mean targeting error of 0.72 mm when using set-points, and of 1.10 mm without set-points.

In this paper, we present a system capable of automatically steering a bevel-tipped flexible needle under ultrasound guidance toward a physical target while avoiding a physical obstacle embedded in gelatin phantoms and biological tissue with curved surfaces. An ultrasound pre-operative scan is performed for three-dimensional (3D) target localization and shape reconstruction. A controller based on implicit force control is developed to align the transducer with curved surfaces to assure the maximum contact area, and thus obtain an image of sufficient quality. We experimentally investigate the effect of needle insertion system parameters such as insertion speed, needle diameter and bevel angle on target motion to adjust the parameters that minimize the target motion during insertion. A fast sampling-based path planner is used to compute and periodically update a feasible path to the target that avoids obstacles. We present experimental results for target reconstruction and needle insertion procedures in gelatin-based phantoms and biological tissue. Mean targeting errors of 1.46±0.37 mm, 1.29±0.29 mm and 1.82±0.58 mm are obtained for phantoms with inclined, curved and combined (inclined and curved) surfaces, respectively, for insertion distance of 86-103 mm. The achieved targeting errors suggest that our approach is sufficient for targeting lesions of 3mm radius that can be detected using clinical ultrasound imaging systems.