Human affects such as emotions, moods, feelings are increasingly being considered as key parameter to enhance the interaction of human with diverse machines and systems. However, their intrinsically abstract and ambiguous nature make it challenging to accurately extract and exploit the emotional information. Here, we develop a multi-modal human emotion recognition system which can efficiently utilize comprehensive emotional information by combining verbal and non-verbal expression data. This system is composed of personalized skin-integrated facial interface (PSiFI) system that is self-powered, facile, stretchable, transparent, featuring a first bidirectional triboelectric strain and vibration sensor enabling us to sense and combine the verbal and non-verbal expression data for the first time. It is fully integrated with a data processing circuit for wireless data transfer allowing real-time emotion recognition to be performed. With the help of machine learning, various human emotion recognition tasks are done accurately in real time even while wearing mask and demonstrated digital concierge application in VR environment.
Soft inflatable robots are a promising paradigm for applications that benefit from their inherent safety and adaptability. However, for perception, complex connections of rigid electronics both in hardware and software remain the mainstay. Although recent efforts have created soft analogs of individual rigid components, the integration of sensing and control systems is challenging to achieve without compromising the complete softness, form factor, or capabilities. Here, we report a soft self-sensing tensile valve that integrates the functional capabilities of sensors and control valves to directly transform applied tensile strain into distinctive steady-state output pressure states using only a single, constant pressure source. By harnessing a unique mechanism, “helical pinching”, we derive physical sharing of both sensing and control valve structures, achieving all-in-one integration in a compact form factor. We demonstrate programmability and applicability of our platform, illustrating a pathway towards fully soft, electronics-free, untethered, and autonomous robotic systems.
Pen-drawing is an intuitive, convenient, and creative fabrication method for delivering emergent and adaptive design to real devices. To demonstrate the application of pen-drawing to robot construction, we developed pen-drawn Marangoni swimmers that perform complex programmed tasks using a simple and accessible manufacturing process. By simply drawing on substrates using ink-based Marangoni fuel, the swimmers demonstrate advanced robotic motions such as polygon and star-shaped trajectories, and navigate through maze. The versatility of pen-drawing allows the integration of the swimmers with time-varying substrates, enabling multi-step motion tasks such as cargo delivery and return to the original place. We believe that our pen-based approach will significantly expand the potential applications of miniaturized swimming robots and provide new opportunities for simple robotic implementations.
Large‐scale screening of sequential drug combinations, wherein the dynamic rewiring of intracellular pathways leads to promising therapeutic effects and improvements in quality of life, is essential for personalized medicine to ensure realistic cost and time requirements and less sample consumption. However, the large‐scale screening requires expensive and complicated liquid handling systems for automation and therefore lowers the accessibility to clinicians or biologists, limiting the full potential of sequential drug combinations in clinical applications and academic investigations. Here, a miniaturized platform for high‐throughput combinatorial drug screening that is “pipetting‐free” and scalable for the screening of sequential drug combinations is presented. The platform uses parallel and bottom‐up formation of a heterogeneous drug‐releasing hydrogel microarray by self‐assembly of drug‐laden hydrogel microparticles. This approach eliminates the need for liquid handling systems and time‐consuming operation in high‐throughput large‐scale screening. In addition, the serial replacement of the drug‐releasing microarray‐on‐a‐chip facilitates different drug exchange in each and every microwell in a simple and highly parallel manner, supporting scalable implementation of multistep combinatorial screening. The proposed strategy can be applied to various forms of combinatorial drug screening with limited amounts of samples and resources, which will broaden the use of the large‐scale screening for precision medicine.