Time of flight is promising technology in machine vision and sensing, with an emerging need for low power consumption, a high image resolution, and reliable operation in high ambient light conditions. Therefore, we propose a novel direct time-of-flight pixel using the single-photon avalanche diode (SPAD) sensor, with an in-pixel averaging method to suppress ambient light and detect the laser pulse arrival time. The system utilizes two orthogonal sinusoidal signals applied to the pixel as inputs, which are synchronized with a pulsed laser source. The detected signal phase indicates the arrival time. To evaluate the proposed system’s potential, we developed analytical and statistical models for assessing the phase error and precision of the arrival time under varying ambient light levels. The pixel simulation showed that the phase precision is less than 1% of the detection range when the ambient-to-signal ratio is 120. A proof-of-concept pixel array prototype was fabricated and characterized to validate the system’s performance. The pixel consumed, on average, 40 W of power in operation with ambient light. The results demonstrate that the system can operate effectively under varying ambient light conditions and its potential for customization based on specific application requirements. This paper concludes by discussing the system’s performance relative to the existing direct time-of-flight technologies, identifying their strengths and limitations.
Correlation-Assisted Direct Time-of-Flight (CA-dToF) is demonstrated for the first time with a 320×240-pixel SPAD array. SPAD triggers are processed in-pixel, avoiding data communication over the array and/or storage bottlenecks. This is accomplished by sampling two orthogonal triangle waves that are synchronized with short light pulses illuminating the scene. Using small switched-capacitor circuits, exponential-moving-averaging (EMA) is applied to the sampled voltages, delivering two analog voltages (VQ2, VI2). These contain the phase delay, or the time of flight between the light pulse and photon’s time of arrival (ToA). Uncorrelated ambient photons and dark counts are averaged out, leaving only their associated shot noise impacting the phase precision. The QVGA camera allows capturing depth-sense images with sub-cm precision over 6-m range of detection, even with a small PDE of 0.7% at 850-nm wavelength.
Correlation-Assisted Direct Time-of-Flight (CA-dToF) is demonstrated for the first time on a large 320 × 240-pixel SPAD array sensor that includes on-chip high-speed timing support circuitry. SPAD events are processed in-pixel, avoiding data communication over the array and/or storage bottlenecks. This is accomplished by sampling two orthogonal triangle waves that are synchronized with short light pulses illuminating the scene. Using small switched-capacitor circuits, exponential moving averaging (EMA) is applied to the sampled voltages, delivering two analog voltages (VQ2, VI2). These contain the phase delay, or the time of flight between the light pulse and photon’s time of arrival (ToA). Uncorrelated ambient photons and dark counts are averaged out, leaving only their associated shot noise impacting the phase precision. The QVGA camera allows for capturing depth-sense images with sub-cm precision over a 6 m range of detection, even with a small PDE of 0.7% at an 850 nm wavelength.
The development of a correlation-assisted direct time-of-flight (CA-dToF) pixel provides a novel solution for time-of-flight applications that combines low power consumption, robust ambient shot noise suppression, and a compact design. However, the pixel’s implementation introduces systematic errors, affecting its performance. We investigate the pixel’s robustness against various noise sources, including timing jitter, kTC noise, switching noise, and photon shot noise. Additionally, we address limitations such as the SPAD deadtime, and source follower gain mismatch and offset, identifying their impact on performance. The paper also proposes solutions to enhance the pixel’s overall reliability and to improve the pixel’s implementation.
This letter proposes a novel SPAD-based pixel, designed for direct time-of-flight (dToF) imaging with in-pixel averaging, which provides a promising advancement in low-power and potentially high image resolution for outdoor applications. By utilizing a laser pulse and two orthogonal sinusoidal signals, the pixel averages out the detected ambient light while accumulating the laser pulse round-trip time. A prototype pixel array was fabricated using a 180 nm CMOS process, featuring a commercial SPAD cell. By characterizing one pixel and employing a 100 klux solar emulator as an ambient light source with a fixed 40 ambient-to-signal ratio (ASR) over a 360 $^{\circ }$ phase shift, equivalent to 6 m detection range, the maximum detected accuracy error was 3.3 %, with a 5 cm precision.
The correlation-assisted direct time-of-flight (CA-dToF) pixel offers a promising approach for low-power consumption, ambient light robustness, and high-resolution depth sensing. However, as with other time-of-flight systems based on global phase estimation, its reliability is compromised by multi-path interference (MPI) of the emitted light, leading to depth estimation errors. In this work, the impact of MPI on CA-dToF pixel performance is systematically analyzed. Furthermore, a multi-frequency modulation algorithm is proposed to mitigate MPI effects. The proposed method improves depth accuracy and enhances the overall reliability of the CA-dToF system.
About Me
Electrical engineer with physics and photonics background. Enjoy innovation, challenges, and experimental work.
Electrical engineer with physics and photonics background. Enjoy innovation, challenges, and experimental work.