1 October 2017 in Current Biology
27 March 2019 in IEEE Robotics and Automation Letters
Continuum body structures provide unique opportunities for soft robotics, with the infinite degrees of freedom enabling unconstrained and highly adaptive exploration and manipulation. However, the infinite degrees of freedom of continuum bodies makes sensing (both intrinsically and extrinsically) challenging. To address this, in this paper we propose a model-free method for sensorizing tentacle-like continuum soft-structures using an array of spatially arranged capacitive tactile sensors. By using visual tracking, the relationship between the tactile response and the 3D shape of the continuum soft-structure can be learned. A data set of 15000 random soft-body postures was used, with recorded camera-tracked positions logged synchronously to the tactile sensor responses. This was used to train a neural network which can predict posture. We show it is possible to achieve proprioceptive awareness over all three axis of motion in space, reconstructing the body structure and inferring the soft body head's pose with an average accuracy of $\approx$ 1mm in comparison to the visual tracked counterpart. To demonstrate the capabilities of the system, we perform random exploration of environments limiting the work-space of the sensorized robot. We find the method capable to autonomously reconstruct the reachable morphology of the environment without the need of external sensing units.
29 July 2020 in Autonomous Robots
This paper proposes a framework to investigate the influence of physical interactions to sensory information, during robotic palpation. We embed a capacitive tactile sensor on a robotic arm to probe a soft phantom and detect and classify hard inclusions within it. A combination of PCA and K-Means clustering is used to: first, reduce the dimensionality of the spatiotemporal data obtained through the probing of each area in the phantom; second categorize the re-encoded data into a given number of categories. Results show that appropriate probing interactions can be useful in compensating for the quality of the data, or lack thereof. Finally, we test the proposed framework on a palpation scenario where a Support Vector Machine classifier is trained to discriminate amongst different types of hard inclusions. We show the proposed framework is capable of predicting the best-performing motion strategy, as well as the relative classification performance of the SVM classifier, solely based on unsupervised cluster analysis methods.
29 December 2020 in IEEE Transactions on Robotics
Robotic phantoms enable advanced physical examination training before using human patients. In this article, we present an abdominal phantom for palpation training with controllable stiffness liver nodules that can also sense palpation forces. The coupled sensing and actuation approach is achieved by pneumatic control of positive-granular jammed nodules for tunable stiffness. Soft sensing is done using the variation of internal pressure of the nodules under external forces. This article makes original contributions to extend the linear region of the neo-Hookean characteristic of the mechanical behavior of the nodules by 140% compared to no-jamming conditions and to propose a method using the organ level controllable nodules as sensors to estimate palpation position and force with a root-mean-square error of 4% and 6.5%, respectively. Compared to conventional soft sensors, the method allows the phantom to sense with no interference to the simulated physiological conditions when providing quantified feedback to trainees, and to enable training following current bare-hand examination protocols without the need to wear data gloves to collect data.