The present article introduces VLC for automotive applications using an image sensor. In particular, V2I-VLC and V2V-VLC are presented. While previous studies have documented the effectiveness of V2I and V2V communication using radio technology in terms of improving automotive safety, in the present article, we identify characteristics unique to image-sensor-based VLC as compared to radio wave technology. The two primary advantages of a VLC system are its line-of-sight feature and an image sensor that not only provides VLC functions, but also the potential vehicle safety applications made possible by image and video processing. Herein, we present two ongoing image-sensor-based V2I-VLC and V2VVLC projects. In the first, a transmitter using an LED array (which is assumed to be an LED traffic light) and a receiver using a high-framerate CMOS image sensor camera is introduced as a potential V2I-VLC system. For this system, real-time transmission of the audio signal has been confirmed through a field trial. In the second project, we introduce a newly developed CMOS image sensor capable of receiving highspeed optical signals and demonstrate its effectiveness through a V2V communication field trial. In experiments, due to the high-speed signal reception capability of the camera receiver using the developed image sensor, a data transmission rate of 10 Mb/s has been achieved, and image (320 × 240, color) reception has been confirmed together with simultaneous reception of various internal vehicle data, such as vehicle ID and speed.

This paper introduces an optical vehicle-to-vehicle (V2V) communication system based on an optical wireless communication technology using an LED transmitter and a camera receiver, which employs a special CMOS image sensor, i.e, an optical communication image sensor (OCI). The OCI has a “communication pixel (CPx)” that can promptly respond to light intensity variations and an output circuit of a “flag image” in which only high-intensity light sources, such as LEDs, have emerged. The OCI that employs these two technologies provides capabilities for a 10-Mb/s optical signal reception and real-time LED detection to the camera receiver. The optical V2V communication system consisting of the LED transmitters mounted on a leading vehicle and the camera receiver mounted on a following vehicle is constructed, and various experiments are conducted under real driving and outdoor lighting conditions. Due to the LED detection method using the flag image, the camera receiver correctly detects LEDs, in real time, in challenging outdoor conditions. Furthermore, between two vehicles, various vehicle internal data (such as speed) and image data (320 × 240, color) are transmitted successfully, and the 13.0-fps image data reception is achieved while driving outside.

An optical wireless communication (OWC) system based on a light-emitting-diode (LED) transmitter and a camera receiver has been developed for use in the automotive area. The automotive OWC system will require Mb/s-class data rates and the ability to quickly detect LEDs from an image. The key to achieving this is improvements to the capabilities of the image sensor mounted on the camera receiver. In this paper, we report on a novel OWC system equipped with an optical communication image sensor (OCI), which is newly developed using CMOS technology. To obtain higher transmission rates, the OCI employs a specialized “communication pixel (CPx)” capable of responding promptly to optical intensity variations. Furthermore, a new quick LED detection technique, based on a 1-bit flag image which only reacts to high-intensity objects, is formulated. The communication pixels, ordinary image pixels, and associated circuits (including 1-bit flag image output circuits) are then integrated into the OCI. This paper describes the design, fabrication, and capabilities of the OCI, as well as the development of the LED and image sensor based OWC system, which boasts a 20-Mb/s/pixel data rate without LED detection and a 15-Mb/s/pixel data rate with a 16.6-ms real-time LED detection.

A low temporal read noise and high conversion gain reset-gate-less CMOS image sensor (CIS) has been developed and demonstrated for the first time at photoelectron-counting-level imaging. To achieve a high pixel conversion gain without fine or special processes, the proposed pixel has two unique structures: 1) coupling capacitance between the transfer gate and floating diffusion (FD) and 2) coupling capacitance between the reset gate and FD, for removing parasitic capacitances around the FD node. As a result, a CIS with the proposed pixels is able to achieve a high pixel conversion gain of 220 μV/e ^- and a low read noise of 0.27e _rms ^- using correlated multiple-sampling-based readout circuitry.

This paper presents a CMOS time-of-flight (ToF) range image sensor using high-speed lock-in pixels with background light canceling capability. The proposed lock-in pixel uses MOS gate-induced lateral electric field control of depleted potential of pinned photodiode for implementing a multiple-tap charge modulator while achieving a high-speed charge transfer for high-time resolution. A TOF image sensor with 320 x 240 effective pixels is implemented using a 0.11-μm CMOS image sensor process. The TOF sensor has a range resolution of less than 12 mm without background light and 20 mm under background line for the range from 0.8 to 1.8 m and integration time of 50 ms. The effectiveness of in-pixel background light canceling with a three-tap output pixel is demonstrated.