9 June 2011 in IEEE Transactions on Pattern Analysis and Machine Intelligence
This paper proposes an algorithm for feedforward categorization of objects and, in particular, human postures in real-time video sequences from address-event temporal-difference image sensors. The system employs an innovative combination of event-based hardware and bio-inspired software architecture. An event-based temporal difference image sensor is used to provide input video sequences, while a software module extracts size and position invariant line features inspired by models of the primate visual cortex. The detected line features are organized into vectorial segments. After feature extraction, a modified line segment Hausdorff-distance classifier combined with on-the-fly cluster-based size and position invariant categorization. The system can achieve about 90 percent average success rate in the categorization of human postures, while using only a small number of training samples. Compared to state-of-the-art bio-inspired categorization methods, the proposed algorithm requires less hardware resource, reduces the computation complexity by at least five times, and is an ideal candidate for hardware implementation with event-based circuits.
28 May 2018 in IEEE Transactions on Circuits and Systems for Video Technology
In this paper, we propose an event-guided support vector machine (ESVM) for tracking high-speed moving objects. Tracking fast-moving objects with low frame rate cameras is always difficult due to motion blur and large displacements. The accuracy problem can be solved by using high frame rate cameras at the expense of tremendous computational cost. For this issue, our ESVM incorporates event-based guiding methods into the traditional structured support vector machine to improve the tracking accuracy at a relatively low-complexity level. The event-based guiding methods include two models, event position guided search localization and event intensity guided sample supplement, which are based on the event features of the CeleX motion sensor. The motion sensor continuously responds to intensity change, which is generally related to object motion. Once it has detected intensity change, the motion sensor outputs event packages, and each of them contains the pixel location, time stamp, and pixel illumination. The generated events are continuous in the temporal domain and thus record the motion trajectory of fast-moving objects, which cannot be fully captured by frame-based cameras. In this paper, we convert high-speed test sequences into sequences of spiking events recorded by the CeleX motion sensor. Our approach presents fairly high computational efficiency, and experiments over sequences from multiple tracking benchmarks demonstrate the superior accuracy and real-time performance of our method, compared to the state-of-the-art trackers.
18 November 2011 in IEEE Transactions on Very Large Scale Integration (VLSI) Systems
In this paper we present a low power temporal-difference image sensor with wireless communication capability designed specifically for imaging sensor networks. The event-based image sensor features a 64 × 64 pixel array and can also report standard analog intensity images. An ultra-wide-band radio channel allows to transmit digital temporal difference images wirelessly to a receiver with high rates and reduced power consumption. The sensor can wake up the radio when it detects a specific number of pixels intensity modulation, so that only significant frames are communicated. The prototype chip was implemented using a 2-poly 3-metal AMIS 0.5 μ m CMOS process. Power consumption is 0.9 mW for the sensor and 15 mW for radio transmission to distance of 4 m with rates of 1.3 Mbps and 160 fps.
7 June 2018 in IEEE Transactions on Aerospace and Electronic Systems
This paper presents a novel star identification algorithm for a "Lost-In-Space" mode star tracker. The spearman correlation approach provides reliable recognition even when the captured images are swayed and biased from the onboard star pattern database. The hamming distance approach provides a shortlisted list of star IDs. Thus, the proposed combination of hamming distance and spearman correlation provides a reliable and fast recognition. The achievable performance is evaluated by testing on simulated and real images.
9 August 2018 in IEEE Transactions on Aerospace and Electronic Systems
A novel star pattern recognition technique for a “Lost-in-space” mode star tracker is presented in this paper. Firstly, the two-dimensional (2D) vectors connecting the stars are constructed in a rotation-invariant frame. Later, the additive property of 2D vectors is integrated with the rotation-invariant frame to build a vector sequence for star identification. The proposed technique achieves an identification accuracy of 98.7% and has a run-time of only 12ms for real-time testing on star images.