In this paper, we propose a robust-hash function based on random Gabor filtering and dithered lattice vector quantization (LVQ). In order to enhance the robustness against rotation manipulations, the conventional Gabor filter is adapted to be rotation invariant, and the rotation-invariant filter is randomized to facilitate secure feature extraction. Particularly, a novel dithered-LVQ-based quantization scheme is proposed for robust hashing. The dithered-LVQ-based quantization scheme is well suited for robust hashing with several desirable features, including better tradeoff between robustness and discrimination, higher randomness, and secrecy, which are validated by analytical and experimental results. The performance of the proposed hashing algorithm is evaluated over a test image database under various content-preserving manipulations. The proposed hashing algorithm shows superior robustness and discrimination performance compared with other state-of-the-art algorithms, particularly in the robustness against rotations (of large degrees).
6 January 2019 in IEEE Transactions on Circuits and Systems for Video Technology
Image fingerprinting is a technique that summarizes the perceptual characteristics of a digital image into an invariant digest, and it is one of the most effective solutions for digital rights management. Most conventional fingerprinting algorithms were developed by assembling manually designed feature extractor and quantizer, which requires extensive expert knowledge and may not capture the intrinsic or abstract visual characteristics of the digital image. Focusing on content identification related applications, we propose a data-driven image fingerprinting algorithm in this paper, where neural network is trained to automatically discover the optimal mapping from image to fingerprint. To ameliorate the difficulty of training, we start by training the fingerprint-computation network in a layer-wise manner to progressively improve its robustness against content-preserving distortions. Initialized by the states learned by layer-wise training, the network is then re-trained as a holistic unit, with the objective of maximizing its content identification accuracy. Moreover, we also develop a key-dependent version of the neural network-based fingerprinting algorithm. By quantifying its security using information-theoretic metrics, we have proved that the hierarchical architecture of neural network is beneficial to the security of fingerprinting algorithm. The experimental results on a large testing database show that the proposed work exhibits much higher content identification accuracy than state-of-the-art algorithms, and its execution speed is in the millisecond time scale.
17 December 2020 in IEEE Transactions on Image Processing
Most existing dehazing algorithms recover haze-free image by solving the hazy imaging model using estimated transmission map and global atmospheric light. However, inaccurate estimation of these variables and the strong assumptions of imaging model result in unrealistic dehazing results. In this paper, we use the adversarial game between a pair of neural networks to accomplish end-to-end photo-realistic dehazing. To avoid uniform contrast enhancement, the generator learns to simultaneously restore haze-free image and capture the non-uniformity of haze. The modules for the two tasks are assembled in sequential and parallel manners to enable information sharing at different levels, and the architecture of the generator implicitly forms an ensemble of dehazing models that allows for feature selection. A multi-scale discriminator competes with the generator by learning to detect dehazing artifacts and the inconsistency between dehazed image and the spatial variation of haze. Unlike existing works that penalize dehazing artifacts via hand-crafted loss, the proposed algorithm uses the identity mapping in the space of clear-scene images to regularize data-driven dehazing. The proposed work also addresses the adaptability of data-driven dehazing to high-level computer vision task. We propose a task-driven training strategy that can optimize the object detection performance on dehazed images without updating the parameters of object detector. Performance of the proposed algorithm is assessed on the RESIDE, I-Haze, and O-Haze benchmarks. The comparison with ten state-of-the-art algorithms shows that the proposed work is the best performer in most competitions.
27 November 2017 in IEEE Signal Processing Letters
Content fingerprinting recently emerges as an effective nonintrusive solution for copyright protection. Fingerprinting algorithm maps the perceptual contents of media file to an invariant digest, so that unauthorized copies can be identified via fingerprint comparison. This letter presents a distortion-resistant sparse coding strategy for image fingerprinting that simulates the hierarchical information processing flow of visual system. Sparse coding, which seeks a small set of atoms that can best represent input signal, helps fingerprinting algorithm detect the intrinsic visual features of image. However, the high freedom of atom selection makes sparse coding sensitive to distortion. In this letter, several measures are applied on sparse coding and dictionary learning to jointly ensure the invariance of fingerprint, such as imposing the neighborhood-priority principle on atom selection, regulating the layout of atoms, and forcing sparse codes to preserve the distance in the image space. Content identification performance of the proposed work was tested on a database of 219 000 images. The error rate of the proposed algorithm is at least ten times lower than state-of-the-arts, and satisfactory performance was observed even under extremely low bit budget.
26 December 2022 in IEEE Internet of Things Journal
The inverse problem of inferring clinical gold-standard electrocardiogram (ECG) from photoplethysmogram (PPG) that can be measured by affordable wearable internet-of-healthcare-things (IoHT) devices is a research direction receiving growing attention. It combines the easy measurability of PPG and the rich clinical knowledge of ECG for long-term continuous cardiac monitoring. The prior art for reconstruction using a universal basis, such as discrete cosine transform (DCT), has limited fidelity for uncommon ECG shapes due to the lack of representative power. To better utilize the data and improve data representation, we design two dictionary learning frameworks, the cross-domain joint dictionary learning (XDJDL) and the label-consistent XDJDL (LC-XDJDL), to further improve the ECG inference quality and enrich the PPG-based diagnosis knowledge. Building on the K-SVD technique, our proposed joint dictionary learning frameworks largely extend the expressive power by optimizing simultaneously a pair of signal dictionaries for PPG and ECG with the transforms to relate their sparse codes and disease information. The proposed models are evaluated with a variety of PPG and ECG morphologies from two benchmark datasets that cover various age groups and disease types. The results show the proposed frameworks achieve better inference performance than previous methods with average Pearson coefficients being 0.88 using XDJDL and 0.92 using LC-XDJDL, suggesting an encouraging potential for ECG screening using PPG based on the proactively learned PPG-ECG relationship. By enabling the dynamic monitoring and analysis of the health status of an individual, the proposed frameworks contribute to the emerging digital twins paradigm for personalized healthcare.
Data-driven methods have demonstrated great potential in single image dehazing, most of which are trained using the hazy images synthesized by the atmospheric scattering model. However, the model cannot accurately describe the complicated degradation caused by haze. At the same time, it is impractical to obtain the pixel-to-pixel aligned clear-scene counterparts of real-world hazy images for supervised training. In this letter, we formulate dehazing as a semi-supervised domain translation problem. For better generalization, two auxiliary domain translation tasks are designed to capture the properties of real-world haze and align synthetic hazy images to real-world ones to reduce the domain gap. Dehazing and the auxiliary tasks are conducted in shared latent spaces by a unified framework, and we use differential optimization to search the architectures of the framework. We evaluate the efficacy of the proposed work using one synthetic and three real-world benchmarks that cover the challenging cases in wild scenarios, and it outperforms state-of-the-art algorithms on these benchmarks. The benefits brought by auxiliary domain translation tasks and architecture search are also verified by ablation experiments.