Bio-inspired neuromorphic cameras asynchronously record visual information of dynamic scenes by discrete events. Due to the high sampling rate, they are capable of fast motion capture without causing image blur, overcoming the drawbacks of frame-based cameras that produce blurry recordings of dynamic objects. However, highly sensitive neuromorphic cameras are also susceptible to interference, and can generate a lot of noise in response. Such noisy event data can dramatically degrade the event-based observations and analysis. Existing methods have insufficient performance on noise suppression, especially for the weak dynamic scenes where noise resembles signals in attributes and distribution, and their results thus have limited improvements on downstream applications. Such demanding cases have not been fully investigated. We aim to seek a solution with more effective and robust discrimination between the two types of events, such that the denoised output can benefit neuromorphic classification tasks. Therefore, we propose a sub-quadratic clustering algorithm tailored for neuromorphic data. It couples event priors with density estimation for noise removal on raw event streams, where strongly correlated signals are taken to be denser in space-time. Experiments on real and synthetic samples illustrate that our simple and interpretable algorithm can suppress noise significantly, and can show greater accuracy and robustness than other techniques in some challenging scenarios.

Neuromorphic imaging reacts to per-pixel brightness changes of a dynamic scene with high temporal precision and responds with asynchronous streaming events as a result. It also often supports a simultaneous output of an intensity image. Nevertheless, the raw events typically involve a large amount of noise due to the high sensitivity of the sensor, while capturing fast-moving objects at low frame rates results in blurry images. These deficiencies significantly degrade human observation and machine processing. Fortunately, the two information sources are inherently complementary — events with microsecond-level temporal resolution, which are triggered by the edges of objects recorded in a latent sharp image, can supply rich motion details missing from the blurry one. In this work, we bring the two types of data together and introduce a simple yet effective unifying algorithm to jointly reconstruct blur-free images and noise-robust events in an iterative coarse-to-fine fashion. Specifically, an event-regularized prior offers precise high-frequency structures and dynamic features for blind deblurring, while image gradients serve as a kind of faithful supervision in regulating neuromorphic noise removal. Comprehensively evaluated on real and synthetic samples, such a synergy delivers superior reconstruction quality for both images with severe motion blur and raw event streams with a storm of noise, and also exhibits greater robustness to challenging realistic scenarios such as varying levels of illumination, contrast and motion magnitude. Meanwhile, it can be driven by much fewer events and holds a competitive edge at computational time overhead, rendering itself preferable as available computing resources are limited. Our solution gives impetus to the improvement of both sensing data and paves the way for highly accurate neuromorphic reasoning and analysis.

Laser speckle imaging (LSI) is a powerful tool for motion analysis owing to the high sensitivity of laser speckles. Traditional LSI techniques rely on identifying changes from the sequential intensity speckle patterns, where each pixel performs synchronous measurements. However, a lot of redundant data of the static speckles without motion information in the scene will also be recorded, resulting in considerable resources consumption for data processing and storage. Moreover, the motion cues are inevitably lost during the “blind” time interval between successive frames. To tackle such challenges, we propose neuromorphic laser speckle imaging (NLSI) as an efficient alternative approach for motion analysis. Our method preserves the motion information while excluding the redundant data by exploring the use of the neuromorphic event sensor, which acquires only the relevant information of the moving parts and responds asynchronously with a much higher sampling rate. This neuromorphic data acquisition mechanism captures fast-moving objects on the order of microseconds. In the proposed NLSI method, the moving object is illuminated using a coherent light source, and the reflected high frequency laser speckle patterns are captured with a bare neuromorphic event sensor. We present the data processing strategy to analyze motion from event-based laser speckles, and the experimental results demonstrate the feasibility of our method at different motion speeds.

Micro motion estimation has important applications in various fields such as microfluidic particle detection and biomedical cell imaging. Conventional methods analyze the motion from intensity images captured using frame-based imaging sensors such as the complementary metal–oxide semiconductor (CMOS) and the charge-coupled device (CCD). Recently, event-based sensors have evolved with the special capability to record asynchronous light changes with high dynamic range, high temporal resolution, low latency, and no motion blur. In this Letter, we explore the potential of using the event sensor to estimate the micro motion based on the laser speckle correlation technique.

Dynamic laser speckle analysis (DLSA) can obtain useful information about the scene dynamics. Traditional implementations use intensity-based imaging sensors such as a complementary metal oxide semiconductor and charge-coupled device to capture time-varying intensity frames. We use an event sensor that measures pixel-wise asynchronous brightness changes to record speckle pattern sequences. Our approach takes advantage of the low latency and high contrast sensitivity of the event sensor to implement DLSA with high temporal resolution. We also propose two evaluation metrics designed especially for event data. Comparison experiments are conducted in identical conditions to demonstrate the feasibility of our proposed approach.