25 February 2022 in IEEE Sensors Journal
In robot-assisted vascular interventional surg- ery (VIS), surgeons often need to operate outside the operating room to avoid exposure to X-ray. However, it greatly changes the operating ways of surgeons, which affects judgment and operation safety. In this paper, a novel VIS robot system was developed to predict guidewire insertion states and operate collaboratively. To assist the surgeons in perceiving the insertion state, an insertion multi-states prediction model based on softmax logistic regression was proposed. Combined with the prediction model, a human-machine collaborative control strategy was designed, which allows surgeons to perceive the insertion states based on not only the force feedback constructed by the master side but also the prediction results from the slave side. Moreover, a human-machine trust evaluation model and a master-slave collaborative mapping model were proposed for improving safety and efficiency of surgery. To verify the effectiveness of these models, the evaluation experiments in the blood vessel model were carried out. It was indicated by the experiment results that the guidewire insertion states can be predicted by the prediction model in different environments, and the overall accuracy is 93%. The master-slave mapping ratio can be adjusted by the collaborative control strategy automatically to adapt to different surgical conditions. The experimental results showed the usability of the robot-assisted VIS system with the novel force-based perception method.
25 March 2024 in IEEE Transactions on Instrumentation and Measurement
Endovascular surgical robots (ESRs) are extensively researched because of their potential to minimize surgeons’ radiation exposure. However, during the surgical operation, it is difficult for ESR to achieve the same flexibility in manipulating the soft catheter and the slender guidewire as human fingers. The flexibility of ESR can be enhanced by incorporating a soft gripper, but the nonlinear deformation of soft material presents challenges in sensing and controlling the force. To address these issues, this study proposes a deep learning-based force sensing method that enables the flexible ESR to measure the surgical force and torque. The proposed deep learning model consists of multiple-layer Long Short-Term Memory (LSTM) modules and is trained using the robot’s motion and soft gripper deformation datasets. The well-trained LSTM model can predict the operationing force and torque in real time. The contrast experiments with other models demonstrate that our robot exhibits higher force measurement accuracy. Furthermore, a force control strategy is proposed for the application of LSTMbased ESR. In the force control strategy, the robot is encouraged to mimic the dexterity of surgeon’s fingers and to maintain the force within a safe range. Finally, the proposed strategy is compared with other strategies in vascular phantom experiments and is proven to effectively enhance the safety and efficiency of surgical operations.
28 August 2023 in IEEE Transactions on Instrumentation and Measurement
Robot-assisted vascular interventional surgery changes the surgeons’ original operation, which affects their judgment and surgical safety. Therefore, the reliable safety method for robot-assisted surgery is practically valuable. However, the existing active safety methods have two challenges: the difficulty in setting inserting force thresholds suitable for the current vascular environment and the response delay caused by program processing. The paper improved a SEA(series elastic actuator)-based guidewire manipulator with an adjustable grasping force function. A multifunctional finger pulp was designed to measure the guidewire inserting force and perceive the manipulating state between fingers simultaneously. Then, an orthogonal force coupling model based on the mechanical-molecular friction theory was established to demonstrate the friction mechanism of cylindrical surgical instruments grasped by elastic grasping surfaces. Based on the model, a passive safety method was proposed to adjust the grasping force autonomously, which can satisfy the inserting force requirements of the phase delivery task and control the safety threshold suitable for the current environment. The evaluation experimental results demonstrated that the designed robot system could manipulate the guidewire accurately. Then the friction experiments verified the designed orthogonal force coupling model. Finally, the in vitro experiments were performed to demonstrated that the designed passive safety method can automatically adjust the grasping force based on the inserting states of the guidewire, reduce the contact force with the vessels, and ensure surgical safety in real-time.
15 December 2022 in IEEE Transactions on Instrumentation and Measurement
The flexible grasping, force sensing, and in-hand manipulating abilities of the gripper are theoretically significant and practically valuable to solve. However, it is still difficult for most existing grippers to realize these three functions simultaneously. This paper proposed a novel humanoid finger-functional parallel gripper with two actuators based on overlapping parallelogram mechanisms and the series elastic actuator (SEA). Based on the in-hand manipulation principle for the ordinary contour object, an in-hand manipulation algorithm for grasping force and position decoupling was designed. Then, to adjust the posture and position of objects within parallel fingers, the rolling and sliding conditions of objects based on the molecular-mechanical friction theory were analyzed. Combined with the proposed in-hand manipulating conditions and algorithm, the PG2 gripper can control the grasping force and manipulate the ordinary contour object in-hand controllably. Evaluation experimental results showed that the force-position control of the PG2 gripper was decoupled stably and the gripper had high accuracy in controlling force and position. Finally, the physical features perception experiments and the in-hand manipulating experiment were carried out to demonstrate the utility of the proposed manipulating methods and algorithm, and in-hand manipulating and grasping force sensing abilities of the gripper. The possible applications of this gripper include tasks that need accurate force-position control or manipulating and sensing in-hand remotely.
11 April 2025 in IEEE/ASME Transactions on Mechatronics
The lack of 3-D localization impedes the advancement of various intracorporeal medical devices. Developing an occlusion-free, small-sized, and high-precision positioning system remains a significant challenge in the practical application of interventional robotics. In this article, a novel 5-degree of freedom (DoF) positioning system utilizing single-axis electromagnetic field excitation coil is designed to locate a microcoil with a size of $\phi$ 1.45 × 5 mm. An XGBoost-based induced electromotive force (EMF) prediction model is proposed to correct the deviation of the magnetic dipole model near the excitation source. Employing the model, a positioning dataset under rotating magnetic field is synthesized. Subsequently, a CNN-LSTM based 5-DoF positioning model is designed and trained, and the transmitting coil speed characteristics of the model were experimentally verified. Evaluation experiments for the two models are performed separately. The results demonstrate the XGBoost-based EMF prediction model improved the prediction accuracy by 34.4% compared to the conventional magnetic dipole model. The static average localization error of the 5-DoF positioning model is 2.53 mm and the orientation error is 2.24$^\circ$ within the $\phi$ 150 × 70 mm volume. The dynamic tracking experimental results indicate that the localization tracking error is 4.25 mm and the orientation error is 3.44$^\circ$, which are 62% and 78% higher than the Levenberg–Marquardt algorithm. The navigation experiment conducted in a coronary artery phantom demonstrated the potential for use in narrow tracts.