15 March 2024 in Digital Signal Processing
1 January 2024 in Journal of Electronic Imaging
Remote photoplethysmography (rPPG) is an optical technique that measures physiological signals from facial videos by analyzing subtle changes in the skin blood volume. However, rPPG signals generated in practical applications are easily affected by external environmental factors and the state of individuals, leading to irregular waveform variations that increase the difficulty in heart rate estimation. To improve the regularity of generated rPPG signals, we propose a standardized rPPG signal generation method. Specifically, facial videos are fed into the generator of a generative adversarial network (GAN) to predict a rough rPPG signal by supervised learning. In addition, a mathematical signal synthesizer model is used to generate noise-free standardized rPPG signals, which are subsequently fed into a discriminator along with the predicted signal for adversarial learning. This enables the generator to learn more standardized waveforms. As a result, the predicted signal waveform by the generator becomes closer to the waveform distribution of real rPPG signals. The proposed method is validated on the widely used MAHNOB-HCI, UBFC-rPPG, and MMSE-HR databases and shows significant improvements in the prediction accuracy and signal-to-noise ratio.
1 July 2023 in Journal of Electronic Imaging
Images taken under low light conditions tend to suffer from poor visibility, which can decrease image quality and even reduce the performance of downstream tasks. It is hard for a CNN-based method to learn generalized features that can recover normal images from the ones under various unknown low light conditions. We propose to incorporate the contrastive learning into an illumination correction network to learn abstract representations to distinguish various low light conditions in the representation space, with the purpose of enhancing the generalizability of the network. Considering that light conditions can change the frequency components of the images, the representations are learned and compared in both spatial and frequency domains to make full advantage of the contrastive learning. Additionally, a grayscale self-weight perception method is used to preproccess the images to reduce the complexity of the model in coping with the uneven distribution of image illumination. The proposed method is evaluated on LOL and LOL-V2 datasets, and the results show that the proposed method achieves better qualitative and quantitative results compared with other state-of-the-art methods.