15 April 2024 in Nature Electronics
14 October 2022 in Science Advances
Synaptic photodetectors exhibit photon-triggered synaptic plasticity, which thus can improve the image recognition rate by enhancing the image contrast. However, still, the visualization and recognition of invisible ultraviolet (UV) patterns are challenging, owing to intense background noise. Here, inspired by all-or-none potentiation of synapse, we develop an integrated device of synaptic phototransistors (SPTrs) and quantum dot light-emitting diodes (QLEDs), facilitating noise reduction and visualization of UV patterns through on-device preprocessing. The SPTrs convert noisy UV inputs into a weighted photocurrent, which is applied to the QLEDs as a voltage input through an external current-voltage–converting circuit. The threshold switching characteristics of the QLEDs result in amplified current and visible illumination by the suprathreshold input voltage or nearly zero current and no visible illumination by the input voltage below the threshold. The preprocessing of image data with the SPTr-QLED can amplify the image contrast, which is helpful for high-accuracy image recognition.
2 May 2025 in Science Advances
Robotic vision has traditionally relied on high-performance yet resource-intensive computing solutions, which necessitate high-throughput data transmission from vision sensors to remote computing servers, sacrificing energy efficiency and processing speed. A promising solution is data compaction through contour extraction, visualizing only the outlines of objects while eliminating superfluous backgrounds. Here, we introduce an in-sensor multilevel image adjustment method using adjustable synaptic phototransistors, enabling the capture of well-defined images with optimal brightness and contrast suitable for achieving high-clarity contour extraction. This is enabled by emulating dopamine-mediated neuronal excitability regulation mechanisms. Electrostatic gating effect either facilitates or inhibits time-dependent photocurrent accumulation, adjusting photo-responses to varying lighting conditions. Through excitatory and inhibitory modes, the adjustable synaptic phototransistor enhances visibility of dim and bright regions, respectively, facilitating distinct contour extraction and high-accuracy semantic segmentation. Evaluations using road images demonstrate improvement of both object detection accuracy and intersection over union, and compression of data volume.
17 July 2024 in Nature Communications
The bioinspired camera, comprising a single lens and a curved image sensor—a photodiode array on a curved surface—, was born of flexible electronics. Its economical build lends itself well to space-constrained machine vision applications. The curved sensor, much akin to the retina, helps image focusing, but the curvature also creates a problem of image distortion, which can undermine machine vision tasks such as object recognition. Here we report an anti-distortion single-lens camera, where 4096 silicon photodiodes arrayed on a curved surface in a nonuniform pattern assimilated to the distorting optics are the key to anti-distortion engineering. That is, the photo-pixel distribution pattern itself is warped in the same manner as images are warped, which correctively reverses distortion. Acquired images feature no appreciable distortion across a 120° horizontal view, as confirmed by their neural-network recognition accuracies. This distortion correction via photo-pixel array reconfiguration is a form of in-sensor computing.
22 January 2025 in Nature Synthesis
8 June 2026 in Nature Materials