Modern aircrafts require the assembly of thousands of components with high accuracy and reliability. The normality of drilled holes is a critical geometrical tolerance that is required to be achieved in order to realize an efficient assembly process. Failure to achieve the required tolerance leads to structures prone to fatigue problems and assembly errors. Elastomer-based tactile sensors have been used to support robots in acquiring useful physical interaction information with the environments. However, current tactile sensors have not yet been developed to support robotic machining in achieving the tight tolerances of aerospace structures. In this paper, a novel elastomer-based tactile sensor was developed for cobot machining. Three commercial silicon-based elastomer materials were characterised using mechanical testing in order to select a material with the best deformability. A Finite element model was developed to simulate the deformation of the tactile sensor upon interacting with surfaces with different normalities. Additive manufacturing was employed to fabricate the tactile sensor mould, which was chemically etched to improve the surface quality. The tactile sensor was obtained by directly casting and curing the optimum elastomer material onto the additively manufactured mould. A machine learning approach was used to train the simulated and experimental data obtained from the sensor. The capability of the developed vision tactile sensor was evaluated using real-world experiments with various inclination angles, and achieved a mean perpendicularity tolerance of 0.34°. The developed sensor opens a new perspective on low-cost precision cobot machining.
Neuromorphic vision-based tactile sensors (NVBTSs) have recently attracted significant attention in robotic perception. However, developing neuromorphic vision-based tactile perception algorithms remains challenging due to the unconventional, asynchronous output of the neuromorphic vision sensor (NVS). To address this gap, this paper introduces NeuTac, a novel zero-shot simulation to reality (Sim2Real) transfer method for neuromorphic vision-based tactile sensors. NeuTac proposes a lightweight neural network with a novel loss function to denoise neuromorphic events to robustly extract neuromorphic vision-based measurements (NVBMs) and mitigate measurement uncertainty for tactile perception. During real-time deployment, the extracted NVBMs subsequently resemble the simulated measurements in Finite Element Analysis (FEA), bridging the Sim2Real gap for NVBTSs. We demonstrate NeuTac in a framework for neuromorphic vision-based contact pose measurement and contact force estimation. Various experimental scenarios were conducted to validate the method. The results show that NeuTac facilitates Sim2Real transfer for neuromorphic vision-based tactile perception and its performance is on par with Sim2Real methods for conventional vision-based tactile sensors.
Inspecting large-scale industrial surfaces like aircraft fuselages for quality control requires precise, high-resolution 3D geometry. Vision-based tactile sensors (VBTSs) offer high local resolution but require slow 'press-and-lift' measurements for large areas. Sliding or roller/belt VBTS designs provide continuous measurement but face significant challenges: sliding suffers from friction/wear, while both are speed-limited by camera frame rates and motion blur. Thus, a rapid, continuous, high-resolution method is needed. We introduce a novel neuromorphic tactile roller sensor. It uses a modified event-based multi-view stereo algorithm for 3D reconstruction, leveraging high temporal resolution and motion blur robustness. This reconstruction is most effective for surfaces with distinct edges or sharp features, which are often the most critical for defect detection in industrial inspection tasks. We demonstrate 0.5 m/s scanning speeds with MAE below 100 $\mu$m (11x faster than prior methods). A multi-reference Bayesian fusion strategy reduces MAE by 25.2% (vs. EMVS) and mitigates curvature errors. We also validate high-speed Braille reading 2.6x faster than previous approaches.
This work pioneers the application of direct ink writing (DIW) to fabricate elastomeric additively manufactured vision based tactile sensor (VBTS). DIW cuts down the fabrication time by 76%, allowing design precise control and reducing the complexities of the process compared to the state‐of‐the‐art (SOTA) molding techniques. Successful fabrication of DIW sensor is verified in three stages. Firstly, the mechanical characteristics of the DIW sensor are at par with those of SOTA molded Ecoflex in terms of depth of compression, compression rate, and the number of cycles. Secondly, using robotic pose estimation as a demonstration, the force enables deformation in the DIW sensor shows comparable normality estimation performance to that of the SOTA Ecoflex with a mean absolute error of less than 0.6°. Thirdly, finite element analysis (FEA) of DIW and SOTA Ecoflex sensors using Yeoh model shows similar stress and strain distributions as another evidence of DIW deformability and durability signaling sensor's successful fabrication.