Remote photoplethysmography (rPPG) has been in the forefront recently for measuring cardiac pulse rates from live or recorded videos. It finds advantages in scenarios requiring remote monitoring, such as medicine and fitness, where contact based monitoring is limiting and cumbersome. The blood volume pulse, defined as the pulsative flow of arterial blood, gives rise to periodic changes in the skin color which are then quantified to estimate a temporal signal. This temporal signal can be analysed using various methods to extract the representative cardiac signal. We present a novel method for measuring rPPG signals using constrained independent component analysis (cICA). We incorporate a priori information into the cICA algorithm to aid in the extraction of the most prominent rPPG signal. This a priori information is implemented using two constraints: first, based on periodicity using autocorrelation, and second, a chrominance-based constraint exploiting the physical characteristics of the skin. Our method showed improved performances over traditional blind source separation methods like ICA and chrominance based methods with mean absolute errors of 0.62 beats per minute (BPM) and 3.14 BPM for the two datasets in our inhouse video database UBFC-RPPG, and 4.69 BPM for the public MMSE-HR dataset. Its performance was also better in comparison to other state of the art methods in terms of accuracy and robustness. Our UBFC-RPPG database is also made publicly available and is specifically aimed towards testing rPPG measurements.
1 March 2019 in Biomedical Signal Processing and Control
Superpixel algorithms group visually coherent pixels and form an alternative representation of the regular structure of the pixel grid. This fundamental low-level computer vision preprocessing step greatly reduces the complexity of subsequent image processing tasks. However, most of the existing methods suffer from very high calculation costs which makes them quite unsuitable for time-sensitive applications. In this paper, we propose a new superpixel segmentation method, named IBIS for Iterative Boundaries implicit Identification for superpixels segmentation, that implicitly identifies the boundaries between superpixels and performs the segmentation using only a fraction of the pixels of the input image, thereby reducing the complexity and computation time. The results obtained during the experiments show that the segmentation quality of IBIS is comparable to that of state of the art methods with a computation time divided by a factor of 8 without parallelization of the processing for low resolution images (e.g., $320\times 240$ pixels) as usually provided in public data sets. We also present and comprehensively evaluate the GPU variant of IBIS named IBIScuda that allows an optimal exploitation of the available resources considering the limited bandwidth between CPU and GPU memories.
Many previous studies have shown that the remote photoplethysmography (rPPG) can measure the Heart Rate (HR) signal with very high accuracy. The remote measurement of the Pulse Rate Variability (PRV) signal is also possible, but this is much more complicated because it is then necessary to detect the peaks on the temporal rPPG signal, which is usually quite noisy and has a lower temporal resolution than PPG signals obtained by contact equipment. Since the PRV signal is vital for various applications such as remote recognition of stress and emotion, the improvement of PRV measurement by rPPG is a critical task. Contact based PRV measurement has already been investigated, but the research on remotely measured PRV is very limited. In this paper, we propose to use the Periodic Variance Maximization (PVM) method to extract the rPPG signal and event-related Two-Window algorithm to improve the peak detection for PRV measurement. We have made several contributions. Firstly, we show that the newly proposed PVM method and Two-Window algorithm can be used for PRV measurement in the non-contact scenario. Secondly, we propose a method to adaptively determine the parameters of the Two-Window method. Thirdly, we compare the algorithm with other attempts for improving the non-contact PRV measurement such as the Slope Sum Function (SSF) method and the Local Maximum method. We calculated several features and compared the accuracy based on the ground truth provided by contact equipment. Our experiments showed that this algorithm performed the best of all the algorithms.
8 May 2021 in Journal of Mathematical Imaging and Vision