Object recognition is among the basic survival skills of human beings and other animals. To date, artificial intelligence (AI) assisted high-performance object recognition is primarily visual-based, empowered by the rapid development of sensing and computational capabilities. Here, we report a tactile-olfactory sensing array, which was inspired by the natural sense-fusion system of star-nose mole, and can permit real-time acquisition of the local topography, stiffness, and odor of a variety of objects without visual input. The tactile-olfactory information is processed by a bioinspired olfactory-tactile associated machine-learning algorithm, essentially mimicking the biological fusion procedures in the neural system of the star-nose mole. Aiming to achieve human identification during rescue missions in challenging environments such as dark or buried scenarios, our tactile-olfactory intelligent sensing system could classify 11 typical objects with an accuracy of 96.9% in a simulated rescue scenario at a fire department test site. The tactile-olfactory bionic sensing system required no visual input and showed superior tolerance to environmental interference, highlighting its great potential for robust object recognition in difficult environments where other methods fall short.
It is incontrovertible that the bioelectronic enabled bio‐integrated system is one of the most promising technologies in the upcoming decades. Driven by the great versatility of the emerging artificial intelligence, machine‐learning‐supported bio‐integrated intelligent sensing system (BISS) is capable of achieving data processing and intelligent recognition while conducting multimodal human‐centered sensing; such facilitated systems capitalize the benefits of both bioelectronics and supporting algorithm, enabling accurate physiological/somatosensory recognition at the cost of certain computing resources. Herein, an overview of recent progress in BISS is presented, with an emphasis on high‐tech applications enabled by innovations in combining flexible bioelectronic sensors with supporting algorithmic systems. The main applications can be divided into three categories, including implantable, skin‐mounted, and wearable BISS, which have different requirements for materials, fabrication methods, and algorithms, respectively. Advances in these areas open new avenues for employing BISS as future human–machine interfaces for personalized healthcare, human enhancement, as well as other broad applications.
Progress toward intelligent human–robotic interactions requires monitoring sensors that are mechanically flexible, facile to implement, and able to harness recognition capability under harsh environments. Conventional sensing methods have been divided for human‐side collection or robot‐side feedback and are not designed with these criteria in mind. However, the iontronic polymer is an example of a general method that operates properly on both human skin (commonly known as skin electronics or iontronics) and the machine/robotic surface. Here, a unique iontronic composite (silk protein/glycerol/Ca(II) ion) and supportive molecular mechanism are developed to simultaneously achieve high conductivity (around 6 kΩ at 50 kHz), self‐healing (within minutes), strong stretchability (around 1000%), high strain sensitivity and transparency, and universal adhesiveness across a broad working temperature range (−40–120 °C). Those merits facilitate the development of iontronic sensing and the implementation of damage‐resilient robotic manipulation. Combined with a machine learning algorithm and specified data collection methods, the system is able to classify 1024 types of human and robot hand gestures under challenging scenarios and to offer excellent object recognition with an accuracy of 99.7%.
20 March 2021 in Advanced Energy and Sustainability Research
The revolutionary and pioneering advancements of silk materials in recent years have provided numerous opportunities for the great trend of sustainable green energy. Working as an eco‐friendly replacement for conventional energy harvester or storage device, silk‐based energy sources that get intensive attention are regarded as new solutions in flexible human‐integrated applications. Compared with other synthetic polymers, silk materials present outstanding biocompatibility, biodegradability, and many other attractive properties owing to the natural protein composition, various modification methods, large‐scale green production, and superior fabrication techniques. Herein, recent progress and ongoing challenges posed by the utilization and translation of silk materials in green energy application are discussed.
In article number 2004733, Liang Chen, Yinbo Peng, Tiger H. Tao, and co‐workers report a silk‐protein‐based biomimetic sensing suture, which integrates multiple, clinically favorable functions including strain sensing, controlled delivery of medical factor(s) with real‐time monitoring, wound temperature control, and antibacterial activity.