Tactile sensing is one important element that can enable robots to interact with an unstructured world. By having tactile perception, a robot can explore its environment by touching objects. Like human skin, a tactile sensor that can provide rich information such as distributed normal and shear forces with high density can help the robot to recognize objects. In previous work we introduced uSkin, a soft skin with distributed 3-axis force sensitive elements, and a center-to-center distance between the 3-axis load cells of 4.7 mm for the flat version. The current paper presents a new structure for the distributed soft force transducer which reduces the crosstalk between the components of the 3-axis force measurements. 3D printing the silicon structure eased the prototype production. However, the 3D printed material has a higher hysteresis than the previously used Ecoflex. Microcontroller boards originally developed for the skin of iCub were implemented for uSkin, increasing the readout frequency and reducing the space requirements and number of wires. The sensor was installed on iCub and successfully used for shape exploration.

This paper presents an easy means to produce a 3-axis Hall effect–based skin sensor for robotic applications. It uses an off-the-shelf chip and is physically small and provides digital output. Furthermore, the sensor has a soft exterior for safe interactions with the environment; in particular it uses soft silicone with about an 8 mm thickness. Tests were performed to evaluate the drift due to temperature changes, and a compensation using the integral temperature sensor was implemented. Furthermore, the hysteresis and the crosstalk between the 3-axis measurements were evaluated. The sensor is able to detect minimal forces of about 1 gf. The sensor was calibrated and results with total forces up to 1450 gf in the normal and tangential directions of the sensor are presented. The test revealed that the sensor is able to measure the different components of the force vector.

Multi-fingered hands could be used to achieve many dexterous manipulation tasks, similarly to humans, and tactile sensing could enhance the manipulation stability for a variety of objects. However, tactile sensors on multi-fingered hands have a variety of sizes and shapes. Convolutional neural networks (CNN) can be useful for processing tactile information, but the information from multi-fingered hands needs an arbitrary pre-processing, as CNNs require a rectangularly shaped input, which may lead to unstable results. Therefore, how to process such complex shaped tactile information and utilize it for achieving manipulation skills is still an open issue. This letter presents a control method based on a graph convolutional network (GCN) which extracts geodesical features from the tactile data with complicated sensor alignments. Moreover, object property labels are provided to the GCN to adjust in-hand manipulation motions. Distributed tri-axial tactile sensors are mounted on the fingertips, finger phalanges and palm of an Allegro hand, resulting in 1152 tactile measurements. Training data is collected with a data-glove to transfer human dexterous manipulation directly to the robot hand. The GCN achieved high success rates for in-hand manipulation. We also confirmed that fragile objects were deformed less when correct object labels were provided to the GCN. When visualizing the activation of the GCN with a PCA, we verified that the network acquired geodesical features. Our method achieved stable manipulation even when an experimenter pulled a grasped object and for untrained objects.

The detection of small forces is of great interest in any robotic application that involves interaction with the environment (e.g., objects manipulation, physical human-robot interaction, minimally invasive surgery), since it allows the robot to detect the contacts early on and to act accordingly. In this letter, we present a sensor design inspired by the ciliary structure frequently found in nature, consisting of an array of permanently magnetized cylinders (cilia) patterned over a giant magnetoresistance sensor (GMR). When these cylinders are deformed in shape due to applied forces, the stray magnetic field variation will change the GMR sensor resistivity, thus enabling the electrical measurement of the applied force. In this letter, we present two 3 mm × 3 mm prototypes composed of an array of five cilia with 1 mm of height and 120 and 200 μm of diameter for each prototype. A minimum force of 333 μN was measured. A simulation model for determining the magnetized cylinders average stray magnetic field is also presented.

A hyperbolic positioning method with antenna arrays consisting of proximately-located antennas and a multi-channel pseudolite is proposed in order to overcome the problems of indoor positioning with conventional pseudolites (ground-based GPS transmitters). A two-dimensional positioning experiment using actual devices is conducted. The experimental result shows that the positioning accuracy varies centimeter- to meter-level according to the geometric relation between the pseudolite antennas and the receiver. It also shows that the bias error of the carrier-phase difference observables is more serious than their random error. Based on the size of the bias error of carrier-phase difference that is inverse-calculated from the experimental result, three-dimensional positioning performance is evaluated by computer simulation. In addition, in the three-dimensional positioning scenario, an initial value convergence analysis of the non-linear least squares is conducted. Its result shows that initial values that can converge to a right position exist at least under the proposed antenna setup. The simulated values and evaluation methods introduced in this work can be applied to various antenna setups; therefore, by using them, positioning performance can be predicted in advance of installing an actual system.

Recently, tactile sensing has attracted increasing attention for robotic manipulation. Predicting the grasping stability before lifting objects and detecting the ongoing/onset of slip after lifting objects are two critical and widely studied tasks in robotic tactile manipulation. Previous methods focus on proposing novel neural networks (NN) architectures towards one of the above two tasks and did not consider that the two tasks are employed in two interconnected action-phases, i.e. grasping and lifting. Therefore, we firstly explore the possibility of constructing a multi-phase, multi-output framework to combine the stability prediction before lifting and the slip detection after lifting. Moreover, to improve the prediction/detection accuracy, we also proposed to explicitly ensemble different NN architectures using various methods, including attention mechanisms. Our experiments are done with 6 state-of-art NN architectures on two datasets including more than 3000 robotic grasps over 80 objects in total. Furthermore our proposals are tested in a real-time robot experiment with unseen objects. Our experimental results show that the proposed multi-phase, multi-output model exhibits more reliable and flexible performance than a single phase model. We also show that using the ensemble of different NN architectures is a viable and practical choice to boost the overall performance.