3 January 2024 in IEEE Sensors Journal
Infrared and visible image fusion can effectively integrate the advantages of two source images, preserving significant target information and rich texture details. However, most existing fusion methods are only designed for well-illuminated scenes and tend to lose details when encountering low-light scenes because of the poor brightness of visible images. Some methods incorporate a light adjustment module, but they typically focus only on enhancing intensity information and neglect the enhancement of color feature, resulting in unsatisfactory visual effects in the fused images. To address this issue, this paper proposes a novel method called EV-fusion, which explores the potential color and detail features in visible images and improve the visual perception of fused images. Specifically, an unsupervised image enhancement module is designed that effectively restores texture, structure and color information in visible images by several non-reference loss functions. Then, an intensity image fusion module is devised to integrate the enhanced visible image and the infrared image. Moreover, to improve the infrared salient object feature in the fused images, we propose an infrared bilateral-guided salience map embedding into the fusion loss functions. Extensive experiments demonstrate that our method outperforms state-of-the-art infrared visible image fusion methods.
30 December 2021 in IEEE Sensors Journal
Event cameras provide high temporal resolution and high dynamic range and have application prospects in areas such as visual navigation, robotics, and image reconstruction. Event cameras output an asynchronous stream of address events that can be highly polluted by noise due to lighting and motion conditions. In order to better analyze and process noise with different spatiotemporal correlation, we introduce a method using an event address map (EAM) representation and classify event noise into background noise, near-edge noise, and recessive noise. In addition, since near-edge noise and recessive noise have a closer spatiotemporal correlation with real events, they are difficult to suppress with current denoising methods. Accordingly, we propose an adaptive EAM denoising method by adjusting the time window to form the EAM by measuring the number of events after pre-denoising and performing median filtering and opening. The method can better adapt to scenes of different motions to process near-edge noise, and can generate events to fill recessive noise. The output EAM can be directly used for subsequent process. Alternatively, to provide high temporal resolution, we restore the stream of address events from the output EAM. To suitably evaluate event denoising performance on real-world data, we introduce the average local event variance and amount of recessive noise, and the proposed method achieves improvements of 24.94% and 72.79%, respectively, compared with conventional denoising.
23 January 2023 in IEEE Sensors Journal
Event camera emerges as a new type of neuromorphic sensor, records scenes in an asynchronous paradigm which provides high temporal resolution and high dynamic range. The huge volume of event-based data brings computational burden to data transmission and real-time interaction in intelliSense applications. Compared with general encoding method and current event-based data compression method Spike Coding, we successively propose two event-based data compression methods by analyzing the statistical features of the event characteristic parameters (x, y, t, f). Based on the data features of event parameters, we design the " Characteristic Parameter Jointed Coding (CPJC)" method with the idea of fixed-length coding, which reduces redundancy of delimiters between modules. As for the limitation of CPJC method in pixel scale, we further propose the "ASCII Coding based on Bit Operation (ACBO) " method based on the data storage principle in computer memory, reducing the redundancy caused by data storage. We introduce compression coefficient K as the metrics to evaluate the compression performance on real-world dataset. And the metrics K of the proposed two methods is improved by 17.93% and 14.92%, respectively, compared with the current event-based compression method. The proposed ACBO method also eliminate the limitation in data pixel scale, and have certain adoption for event noise and event dispersion in the scene.
11 January 2024 in IEEE Signal Processing Letters
Haze and fog, as severe weather conditions, have absorbing and scattering effects on the optical images, severely affecting image quality. Polarization-based dehazing algorithms can estimate the original radiance distribution of the scene through the polarization of skylight and transmitted light. However, current traditional methods lack consideration for the polarization of transmitted light, and the datasets required for deep learning-based methods are difficult to obtain. This letter proposes a polarized haze image synthesis method that can generate scene intensity and polarization after passing through different distances and concentrations from existing DoFP images, Specially, we equate the attenuation of the scattering medium to a superposition of a series of Mueller matrices, and in combination with the atmospheric attenuation model, which thoroughly integrates both intensity characteristics and polarization properties. We establish a comprehensive polarization dataset for image dehazing, including 300 sets of simulated data, 40 sets real world data from artificial scenes with haze-free ground truth and 40 sets real world data from urban scenes. The network model trained on our simulated dataset demonstrates the effectiveness of the simulation method in testing experiments.