In minimally invasive robotic surgery, the surgical instrument is usually inserted inside the patient’s body through a small incision, which acts as a remote center of motion (RCM). Serial-link manipulators can be used as macro robots on which microsurgical robotic instruments are mounted to increase the number of degrees of freedom of the system and ensure safe task and RCM motion execution. However, the surgical instrument needs to be placed in an appropriate configuration when completing the motion tasks. The contribution of this article is to present a novel framework that preoperatively identifies the best base configuration, in terms of Roll, Pitch, and Yaw angles, of the microsurgical instrument with respect to the macro serial-link manipulator’s end effector in order to achieve the maximum accuracy and dexterity in performing specified tasks. The framework relies on hierarchical quadratic programming for the control, genetic algorithm for the optimization, and on a resilience to error strategy to make sure deviations from the optimum do not affect the system’s performance. Simulation results show that the mounting configuration of the surgical instrument significantly impacts the performance of the whole macro–micro manipulator in executing the desired motion tasks, and both the simulation and experimental results demonstrate that the proposed optimization method improves the overall performance.
25 February 2021 in IEEE Robotics and Automation Letters
In order to guarantee precision and safety in robotic surgery, accurate models of the robot and proper control strategies are needed. Bayesian Neural Networks (BNN) are capable of learning complex models and provide information about the uncertainties of the learned system. Model Predictive Control (MPC) is a reliable control strategy to ensure optimality and satisfaction of safety constraints. In this work we propose the use of BNN to build the highly nonlinear kinematic and dynamic models of a tendon-driven surgical robot, and exploit the information about the epistemic uncertainties by means of a Hierarchical MPC (Hi-MPC) control strategy. Simulation and real world experiments show that the method is capable of ensuring accurate tip positioning, while satisfying imposed safety bounds on the kinematics and dynamics of the robot.
22 July 2019 in IEEE Robotics and Automation Letters
Workspace analysis is essential for robotic manipulators, which helps researchers study, evaluate, and optimize their designs based on specific criteria with due consideration of ergonomics and usability. Although workspace analysis is a common research topic, current solutions provide design-specific evaluation, and there is a lack of generic software tools for different hardware configurations. This letter presents WSRender, a versatile research-oriented framework for workspace analysis and visualization. It is based on the Orocos Kinematics and Dynamics Library and the Matlab Robotic Toolbox. The software architecture is presented using four use cases for demonstrating its practical use in single robot, dual-arm manipulator performance evaluation, multi-robot interaction analysis, and master–slave mapping. The source code of WSRender 1 is made publicly available for the benefit of the research community for the design or evaluation of robotic manipulators.
30 June 2022 in IEEE Robotics and Automation Letters
Robots for minimally invasive surgery are becoming more and more complex, due to miniaturization and flexibility requirements. The vast majority of surgical robots are tendon-driven and this, along with the complex design, causes high nonlinearities in the system which are difficult to model analytically. In this work we analyse how incorporating a backlash model and compensation can improve model learning and control. We combine a backlash compensation technique and a Feedforward Artificial Neural Network (ANN) with differential relationships to learn the kinematics at position and velocity level of highly articulated tendon-driven robots. Experimental results show that the proposed backlash compensation is effective in reducing nonlinearities in the system, that compensating for backlash improves model learning and control, and that our proposed ANN outperforms traditional ANN in terms of path tracking accuracy.
10 November 2022 in IEEE Transactions on Automation Science and Engineering
Accurate robot kinematic modelling is a major component for autonomous robot control to guarantee safety and precision during task execution. In surgical robotics complex robotic structures and actuation mechanisms are generally employed, therefore machine learning techniques can be adopted to build the model of the robot. Probabilistic neural networks are a class of learning approaches that provide information about the uncertainty of the learnt models. In this work we compare two different probabilistic neural networks (Bayesian and Evidential Neural Networks) to model the kinematics of a surgical robotic instrument and propose a control strategy based on Hierarchical Quadratic Programming (HQP) capable of exploiting the model uncertainty to improve the accuracy and safety of the controller. Simulation and real world experiments on different autonomous path tracking tasks show that the model uncertainty highly affects the control performances and prove the effectiveness of the proposed controller in improving task execution. Note to Practitioners —The push towards reducing invasiveness and patient’s traumas in surgery has lead to the requirement of miniaturized and highly articulated robots. This however comes at the cost of having systems that are hard to model and control, which is one of the major limitations for autonomy in surgical robotics. Machine learning has become very effective in modelling complex systems and probabilistic approaches additionally allow estimating the confidence of the learnt model. In robotics field where high precision is required to perform an autonomous task, like in minimally invasive surgery, the robot model needs to be very accurate and controllers need to guarantee safety in performing the desired task, while satisfying additional motion constraints imposed by the application scenario. This work proposes the use of probabilistic neural networks to model the complexity of a surgical robotic instrument and a control strategy capable of ensuring safety by maximizing model’s confidence and guaranteeing satisfaction of imposed motion constraints. In this work a macro-micro manipulator setup is employed, consisting of an articulated surgical robotic instrument connected to a serial-link manipulator. The proposed modelling and control approaches can be used in any other field where controllers need to highly rely on the robot model due to limitations in using external sensors and where leveraging information about model’s confidence can be beneficial. Currently, the work focuses only on pure kinematic modelling and control, thus neglecting any possible interaction with the environment. Future work will focus on addressing this limitation in order to ensure proper force control and effective autonomy.
9 June 2022 in IEEE Robotics and Automation Letters
Due to the increasing complexity of robotic structures, modelling robots is becoming more and more challenging, and analytical models are very difficult to build. Machine learning approaches have shown great capabilities in learning complex mapping and have widely been used in robot model learning and control. Generally, the inverse kinematics is directly learned, yet, learning the forward kinematics is simpler and allows computing exploiting the optimality of the controllers. Nevertheless, the learning method has no knowledge about the differential relationship between the position and velocity mappings. Currently, few works have targeted learning full robot poses considering both position and orientation. In this letter, we present a novel feedforward Artificial Neural network (ANN) architecture to learn full robot pose in SE(3) incorporating differential relationships in the learning process. Simulation and real world experiments show the capabilities of the proposed network to properly model the robot pose and its advantages over standard ANN.