Tactile sensing plays a pivotal role in achieving precise physical manipulation tasks and extracting vital physical features. This comprehensive review paper presents an in-depth overview of the growing research on tactile-sensing technologies, encompassing state-of-the-art techniques, future prospects, and current limitations. The paper focuses on tactile hardware, algorithmic complexities, and the distinct features offered by each sensor. This paper has a special emphasis on agri-food manipulation and relevant tactile-sensing technologies. It highlights key areas in agri-food manipulation, including robotic harvesting, food item manipulation, and feature evaluation, such as fruit ripeness assessment, along with the emerging field of kitchen robotics. Through this interdisciplinary exploration, we aim to inspire researchers, engineers, and practitioners to harness the power of tactile-sensing technology for transformative advancements in agri-food robotics. By providing a comprehensive understanding of the current landscape and future prospects, this review paper serves as a valuable resource for driving progress in the field of tactile sensing and its application in agri-food systems.
Ensuring a stable grasp during robotic manipulation is essential for dexterous and reliable performance. Traditionally, slip control has relied on grip force modulation. Here we show that trajectory modulation provides an effective alternative for slip prevention in certain robotic manipulation tasks. We develop and compare a slip control policy based on trajectory modulation with a conventional grip-force-based approach. Our results demonstrate that trajectory modulation can significantly outperform grip force control in specific scenarios, highlighting its potential as a robust slip control strategy. Furthermore, we show that, similar to humans, incorporating a data-driven action-conditioned forward model within a model predictive control framework is key to optimizing trajectory modulation for slip prevention. These findings introduce a predictive control framework leveraging trajectory adaptation, offering a new perspective on slip mitigation. This approach enhances grasp stability in dynamic and unstructured environments, improving the adaptability of robotic systems across various applications.
The accurate slip detection is essential for achieving reliable robotic manipulation. The representation of tactile data and the architecture of the slip classification model significantly influence detection performance. However, the impact of different data representations and model architectures on slip classification remains underexplored. In this article, we systematically analyze the effect of various tactile data representations and data-driven classification architectures on both slip detection and prediction tasks. Our proposed synthetic minority oversampling technique convolutional neural network (SMOTE-CNN) model demonstrates superior performance, outperforming baseline models in slip detection by improving the ${F}1$ -score by 3% and reducing the false negative rate by over 95%—a critical improvement for preventing undetected slip events. To evaluate the practical applicability, we integrate the slip detection models into a slip avoidance controller, which employs model predictive control (MPC) for real-time trajectory optimization. Furthermore, the dataset of robotic manipulation collected in this study will be publicly available to facilitate future research and benchmarking.