Human behaviors are extremely sophisticated, relying on the adaptive, plastic and event-driven network of sensory neurons. Such neuronal system analyzes multiple sensory cues efficiently to establish accurate depiction of the environment. Here, we develop a bimodal artificial sensory neuron to implement the sensory fusion processes. Such a bimodal artificial sensory neuron collects optic and pressure information from the photodetector and pressure sensors respectively, transmits the bimodal information through an ionic cable, and integrates them into post-synaptic currents by a synaptic transistor. The sensory neuron can be excited in multiple levels by synchronizing the two sensory cues, which enables the manipulating of skeletal myotubes and a robotic hand. Furthermore, enhanced recognition capability achieved on fused visual/haptic cues is confirmed by simulation of a multi-transparency pattern recognition task. Our biomimetic design has the potential to advance technologies in cyborg and neuromorphic systems by endowing them with supramodal perceptual capabilities.

The cone photoreceptors in our eyes selectively transduce the natural light into spiking representations, which endows the brain with high energy-efficiency color vision. However, the cone-like device with color-selectivity and spike-encoding capability remains challenging. Here, we propose a metal oxide-based vertically integrated spiking cone photoreceptor array, which can directly transduce persistent lights into spike trains at a certain rate according to the input wavelengths. Such spiking cone photoreceptors have an ultralow power consumption of less than 400 picowatts per spike in visible light, which is very close to biological cones. In this work, lights with three wavelengths were exploited as pseudo-three-primary colors to form ‘colorful’ images for recognition tasks, and the device with the ability to discriminate mixed colors shows better accuracy. Our results would enable hardware spiking neural networks with biologically plausible visual perception and provide great potential for the development of dynamic vision sensors.

Coupling myoelectric and mechanical signals during voluntary muscle contraction is paramount in human–machine interactions. Spatiotemporal differences in the two signals intrinsically arise from the muscular excitation–contraction process; however, current methods fail to deliver local electromechanical coupling of the process. Here we present the locally coupled electromechanical interface based on a quadra-layered ionotronic hybrid (named as CoupOn) that mimics the transmembrane cytoadhesion architecture. CoupOn simultaneously monitors mechanical strains with a gauge factor of ~34 and surface electromyogram with a signal-to-noise ratio of 32.2 dB. The resolved excitation–contraction signatures of forearm flexor muscles can recognize flexions of different fingers, hand grips of varying strength, and nervous and metabolic muscle fatigue. The orthogonal correlation of hand grip strength with speed is further exploited to manipulate robotic hands for recapitulating corresponding gesture dynamics. It can be envisioned that such locally coupled electromechanical interfaces would endow cyber–human interactions with unprecedented robustness and dexterity.