An entire solid-state direct time-of-flight (dToF) light detection and ranging (LiDAR) system that incorporates innovations for both the transmitter (TX) and the receiver (RX) is presented in this work. For the illumination TX, we demonstrate solid-state channel addressability, which significantly reduces the transmit power and improves the ranging distance by dividing the field of view (FoV) into separately illuminated sub-regions. In the RX, we introduce single-photon avalanche diodes (SPADs) pixel binning, which enables reconfigurability of the sensor’s spatial resolution. Finally, we introduce a machine learning (ML) technique that enables this pixel-binned depth sensor to upscale its spatial resolution after training/inference fusion with the intensity image. The laser diode driver (LDD) chip is implemented in the 180-nm bipolar-CMOS-DMOS (BCD) process and is capable of pumping more than 8-A peak current into a multi-junction vertical-cavity surface-emitting laser (VCSEL) array, producing up to 20.3-W optical pulses under 12.5-V supply voltage. The sensor chip is also implemented in the 180-nm BCD process with a $128 \times 128$ SPAD array and reconfigurable pixel binning. Hardware and software co-optimization under low signal-to-noise ratio (SNR) conditions with ML-based spatial resolution upscaling is demonstrated.
Direct time-of-flight (dToF) ranging sensors based on single-photon avalanche diodes (SPADs) have been used as a prominent depth-sensing devices. Time-to-digital converters (TDCs) and histogram builders have become the standard for dToF sensors. However, one of the main current issues is the bin width of the histogram, which limits the accuracy of depth without TDC architecture modifications. SPAD-based light detection and ranging (LiDAR) systems require new methods to overcome their inherent drawbacks for accurate 3D ranging. In this work, we report an optimal matched filter to process the raw data of the histogram to obtain high-accuracy depth. This method is performed by feeding the raw data of the histogram into the different matched filters and using the Center-of-Mass (CoM) algorithm for depth extraction. Comparing the measurement results of different matched filters, the filter with the highest depth accuracy can be obtained. Finally, we implemented a dToF system-on-chip (SoC) ranging sensor. The sensor is made of a configurable array of 16 × 16 SPADs, a 940 nm vertical-cavity surface-emitting laser (VCSEL), an integrated VCSEL driver, and an embedded microcontroller unit (MCU) core to implement the best matched filter. To achieve suitably high reliability and low cost, the above-mentioned features are all packaged into one module for ranging. The system resulted in a precision of better than 5 mm within 6 m with 80% reflectance of the target, and had a precision better than 8 mm at a distance within 4 m with 18% reflectance of the target.
Light detection and ranging (LiDAR) technology, a cutting-edge advancement in mobile applications, presents a myriad of compelling use cases, including enhancing low-light photography, capturing and sharing 3D images of fascinating objects, and elevating the overall augmented reality (AR) experience. However, its widespread adoption has been hindered by the prohibitive costs and substantial power consumption associated with its implementation in mobile devices. To surmount these obstacles, this paper proposes a low-power, low-cost, single-photon avalanche detector (SPAD)-based system-on-chip (SoC) which packages the microlens arrays (MLAs) and a lightweight RGB-guided sparse depth imaging completion neural network for 3D LiDAR imaging. The proposed SoC integrates an 8 × 8 SPAD macropixel array with time-to-digital converters (TDCs) and a charge pump, fabricated using a 180 nm bipolar-CMOS-DMOS (BCD) process. Initially, the primary function of this SoC was limited to serving as a ranging sensor. A random MLA-based homogenizing diffuser efficiently transforms Gaussian beams into flat-topped beams with a 45° field of view (FOV), enabling flash projection at the transmitter. To further enhance resolution and broaden application possibilities, a lightweight neural network employing RGB-guided sparse depth complementation is proposed, enabling a substantial expansion of image resolution from 8 × 8 to quarter video graphics array level (QVGA; 256 × 256). Experimental results demonstrate the effectiveness and stability of the hardware encompassing the SoC and optical system, as well as the lightweight features and accuracy of the algorithmic neural network. The state-of-the-art SoC-neural network solution offers a promising and inspiring foundation for developing consumer-level 3D imaging applications on mobile devices.
Light Detection and Ranging (LiDAR) technology, a cutting-edge advancement in mobile applications, presents a myriad of compelling use cases, including enhancing low-light photography, capturing and sharing 3D images of fascinating objects, and elevating the overall augmented reality (AR) experience. However, its widespread adoption has been hindered by the prohibitive costs and substantial power consumption associated with its implementation. To surmount these obstacles, this paper proposes a low-power, low-cost, SPAD-based system-on-chip (SoC) which packages the microlens arrays (MLA) and incorporates with a light-weight RGB-guided sparse depth imaging completion neural network for 3D LiDAR imaging. The proposed SoC integrates an 8x8 Single-Photon Avalanche Detectors (SPADs) macro pixel array with time-to-digital converters (TDC) and charge pump, fabricated using a 180nm bipolar-CMOS-DMOS (BCD) process. A random MLA-based homogenizing diffuser efficiently transforms Gaussian beams into flat-topped beams with a 45° field of view (FOV), enabling flash projection at the transmitter. To further enhance resolution and broaden application possibilities, a lightweight neural network employing RGB-guided sparse depth complementation is proposed, enabling a substantial expansion of image resolution from 8x8 to quarter video graphics array level (QVGA; 256x256). Experimental results demonstrate the effectiveness and stability of the hardware encompassing the SoC and optical system, as well as the lightweight features and accuracy of the algorithmic neural network. This integrated state-of-the-art hardware-software solution offers a promising and inspiring foundation for developing consumer-level 3D imaging applications.
This paper presents an innovative methodology that incorporates direct time-of-flight technology into intelligent sensing for projectors, along with a lightweight, dual-mode optically integrated LiDAR system. The proposed LiDAR system-on-chip, which utilizes a single-photon avalanche diode and time to digital converter with 0.13 µm bipolar CMOS DMOS technology, integrates an on-chip interframe filter, a common optical platform design, and a lightweight keystone correction assist algorithm. This comprehensive integration enables the system to achieve a measurement range of 11 m with 1% relative precision (simulations indicate the potential to achieve 30 m) in auto-focus mode. Additionally, it facilitates high frame-per-second keystone correction within a range of ±30∘ with an error of ±2∘ under illumination conditions of 20 klux.
14 March 2023 in IEEE Photonics Technology Letters
This letter presents a novel fully integrated dToF system-on-chip ranging sensor based on a SPADs array. The sensor is made a configurable array of $16\times16$ SPADs, a 940nm VCSEL, a co-design VCSEL driver and embedded DSP core. To suitable different ranging scenarios with high reliability and low cost, the above mentioned are all packaged into one module for ranging. However, the package of coverglass can cause Xtalk, which have a negative impact on ranging. In order to reduce the influence of Xtalk on ranging. This letter proposes a real-time Xtalk calibration circuit system, which can automatically adjust the laser pulse width, when Xtalk and target bins are mixed together. And also to mitigate the effect of SPAD jitter on the Xtalk bins width, an adjustable bias voltage charge pump circuit is adopted to realize the accurate adjustment of pixel SPAD’s bias voltage. The system has been turned out with precision of better than 5mm within 6m in 80% reflectance of target, still with a precision better than 8mm at a distance within 4m in 18% reflectance of target.