29 September 2023 in Science Advances
Parallel perception of visual motion is of crucial significance to the development of an intelligent machine vision system. However, implementing in-sensor parallel visual motion perception using conventional complementary metal-oxide semiconductor technology is challenging, because the temporal and spatial information embedded in motion cannot be simultaneously encoded and perceived at the sensory level. Here, we demonstrate the parallel perception of diverse motion modes at the sensor level by exploiting light-tunable memory matrix in a van der Waals (vdW) heterostructure array. The optoelectronic characteristics of gate-tunable photoconductivity and light-tunable memory matrix enable devices in the array to realize simultaneous encoding and processing of incoming spatiotemporal light pattern. Furthermore, we implement a visual motion perceptron with the array capable of deciphering multiple motion parameters in parallel, including direction, velocity, acceleration, and angular velocity. Our work opens up a promising venue for the realization of an intelligent machine vision system based on in-sensor motion perception.
2 May 2025 in Science Advances
In-memory computing hardware based on memristors has emerged as a promising option for scientific computing due to its large-scale parallel data processing capability. However, the nonuniformity issue of the memristors renders the practical deployment of in-memory computing hardware complex, requiring peripheral circuits to ensure the accuracy of scientific computing, thereby resulting in increased power consumption. Here, we present a mortise-tenon–shaped (MTS) memristor with ultrahigh uniformity by introducing a mortise-shaped h-BN flake on the HfO 2 switching layer. The MTS memristor exhibits ultrasmall cycle-to-cycle (~2.5%) and device-to-device (~6.9%) variations compared to the HfO 2 memristor without the MTS structure. Furthermore, we use the MTS memristors to build a partial differential equation solver and demonstrate a convergence speed of solving the Poisson equation five times faster than the solver based on the traditional HfO 2 memristors. This work provides a promising approach for notably reducing the hardware resources required for fast and high-accuracy scientific computing.
25 January 2000 in International Journal of Modern Physics B
23 September 2024 in Applied Physics Letters
Rotational invariance is fundamental for robust image recognition systems, ensuring accurate analysis irrespective of image orientation. However, existing systems predominantly reliant on software often encounter challenges such as increased computational demands and compromises between processing speed and accuracy. In this study, we propose leveraging the interconnected floating-gate (FG) structure as an effective hardware-level solution to achieve rotational invariance in image recognition. Our design features a reconfigurable two-dimensional material FG phototransistor array, where each processing unit integrates four sensory devices sharing a common FG. This configuration facilitates uniform distribution of stored charges across the interconnected FG layer, which is typically made of metal, enabling consistent application of a single weight matrix to images across varied rotational conditions. The photoactive material, tungsten diselenide (WSe2), possesses a distinctive bipolar property that facilitates both hole and electron tunneling into the FG layer. This property directly contributes to the efficiency of state transition within the setup and improves its overall adaptability. In this manner, our design achieves stable and predictable outputs in recognizing identical digital numbers regardless of their rotation, while also demonstrating variable performance essential for accurately distinguishing between different digital numbers. This dual capability guarantees both the adaptability and precision required for rotation-invariant image recognition, suggesting that our work may open up a promising venue for exploring advanced hardware designs, such as optimized interconnected FG architectures, tailored for enhancing recognition accuracy and efficiency in the field of intelligent visual systems.
19 August 2026 in Nature Sensors