29 September 2023 in Science Advances
Parallel perception of visual motion is of crucial significance to the development of an intelligent machine vision system. However, implementing in-sensor parallel visual motion perception using conventional complementary metal-oxide semiconductor technology is challenging, because the temporal and spatial information embedded in motion cannot be simultaneously encoded and perceived at the sensory level. Here, we demonstrate the parallel perception of diverse motion modes at the sensor level by exploiting light-tunable memory matrix in a van der Waals (vdW) heterostructure array. The optoelectronic characteristics of gate-tunable photoconductivity and light-tunable memory matrix enable devices in the array to realize simultaneous encoding and processing of incoming spatiotemporal light pattern. Furthermore, we implement a visual motion perceptron with the array capable of deciphering multiple motion parameters in parallel, including direction, velocity, acceleration, and angular velocity. Our work opens up a promising venue for the realization of an intelligent machine vision system based on in-sensor motion perception.
12 January 2021 in ACS Materials Letters
23 September 2024 in Applied Physics Letters
Rotational invariance is fundamental for robust image recognition systems, ensuring accurate analysis irrespective of image orientation. However, existing systems predominantly reliant on software often encounter challenges such as increased computational demands and compromises between processing speed and accuracy. In this study, we propose leveraging the interconnected floating-gate (FG) structure as an effective hardware-level solution to achieve rotational invariance in image recognition. Our design features a reconfigurable two-dimensional material FG phototransistor array, where each processing unit integrates four sensory devices sharing a common FG. This configuration facilitates uniform distribution of stored charges across the interconnected FG layer, which is typically made of metal, enabling consistent application of a single weight matrix to images across varied rotational conditions. The photoactive material, tungsten diselenide (WSe2), possesses a distinctive bipolar property that facilitates both hole and electron tunneling into the FG layer. This property directly contributes to the efficiency of state transition within the setup and improves its overall adaptability. In this manner, our design achieves stable and predictable outputs in recognizing identical digital numbers regardless of their rotation, while also demonstrating variable performance essential for accurately distinguishing between different digital numbers. This dual capability guarantees both the adaptability and precision required for rotation-invariant image recognition, suggesting that our work may open up a promising venue for exploring advanced hardware designs, such as optimized interconnected FG architectures, tailored for enhancing recognition accuracy and efficiency in the field of intelligent visual systems.
1 November 2022 in Journal of Physics: Conference Series
The paper focuses on a Bricard Linkage network constructed by Bennett Linkage and discusses the possibility of connecting Bricard linkage using Bennett linkage as the connection. To simplify the problem, accessible geometric parameters are set without much loss of generality. This new design can also evolve into some new mechanisms by connecting the linkages in different ways. Based on the designed connection idea, the corresponding three-dimensional model is created by Onshape. Using Onshape, the movement and deployment of each mechanism could be observed. Then the kinematic analysis is carried out with Adams software, to find out how the kinematic angles vary as time increases. A physical model is made to observe the deployment process more clearly, indicating a potential application of a retractable table. Since the problem has been simplified by setting accessible parameters, the mechanism may show some further performance worthy of being explored if the parameters are more complicated.
10 September 2026 in Cell Reports Physical Science