Autonomy is the next frontier of research in robotic surgery and its aim is to improve the quality of surgical procedures in the next future. One fundamental requirement for autonomy is advanced perception capability through vision sensors. In this paper, we propose a novel calibration technique for a surgical scenario with a da Vinci Research Kit (dVRK) robot. Camera and robotic arms calibration are necessary to precise position and emulate expert surgeon. The novel calibration technique is tailored for RGB-D cameras. Different tests performed on relevant use cases prove that we significantly improve precision and accuracy with respect to state of the art solutions for similar devices on a surgical-size setups. Moreover, our calibration method can be easily extended to standard surgical endoscope used in real surgical scenario.
6 September 2021 in IEEE Transactions on Medical Robotics and Bionics
In this paper we propose a new methodology to model surgical procedures that is specifically tailored to semi-autonomous robotic surgery. We propose to use a restricted version of statecharts to merge the bottom-up approach, based on data-driven techniques (e.g., machine learning), with the top-down approach based on knowledge representation techniques. We consider medical knowledge about the procedure and sensing of the environment in two concurrent regions of the statecharts to facilitate re-usability and adaptability of the modules. Our approach allows producing a well defined procedural model exploiting the hierarchy capability of the statecharts, while machine learning modules act as soft sensors to trigger state transitions. Integrating data driven and prior knowledge techniques provides a robust, modular, flexible and re-configurable methodology to define a surgical procedure which is comprehensible by both humans and machines. We validate our approach on the three surgical phases of a Robot-Assisted Radical Prostatectomy (RARP) that directly involve the assistant surgeon: bladder mobilization, bladder neck transection, and vesicourethral anastomosis, all performed on synthetic manikins.
Transperineal prostate biopsy is the most reliable technique for detecting prostate cancer, and robot-assisted needle insertion has the potential to improve the accuracy of this procedure. Modeling the interaction between a bevel-tip needle and the tissue, considering tissue heterogeneity, needle bending, and tissue/organ deformation and movement is a required step to enable robotic needle insertion. Even if several models exist, they have never been compared on experimental grounds. Based on this motivation, this paper proposes an experimental comparison for kinematic models of needle insertion, considering different needle insertion speeds and different degrees of tissue stiffness. The experimental comparison considers automated insertions of needles into transparent silicone phantoms under stereo-image guidance. The comparison evaluates the accuracy of existing models in predicting needle deformation.
1 August 2026 in IEEE Transactions on Medical Robotics and Bionics