Videoplethysmography is currently recognized as a promising noninvasive heart rate measurement method advantageous for ubiquitous monitoring of humans in natural living conditions. Although the method is considered for application in several areas including telemedicine, sports and assisted living, its dependence on lighting conditions and camera performance is still not investigated enough. In this paper we report on research of various image acquisition aspects including the lighting spectrum, frame rate and compression. In the experimental part, we recorded five video sequences in various lighting conditions (fluorescent artificial light, dim daylight, infrared light, incandescent light bulb) using a programmable frame rate camera and a pulse oximeter as the reference. For a video sequence-based heart rate measurement we implemented a pulse detection algorithm based on the power spectral density, estimated using Welch’s technique. The results showed that lighting conditions and selected video camera settings including compression and the sampling frequency influence the heart rate detection accuracy. The average heart rate error also varies from 0.35 beats per minute (bpm) for fluorescent light to 6.6 bpm for dim daylight.

Over the last few years, a large number of studies have been conducted on the monitoring of human behavior remaining beyond conscious control. One area of application for such monitoring systems is lie detection. The most popular method currently used for this purpose is polygraph examination, which has proven its usefulness in the field and in laboratories, but it is not without its drawbacks. Technological advances in data acquisition and automated analysis have ensured that contactless tools are in high demand in security fields like airport screening or pre-employment procedures. As a result, there has been a shift in interest away from traditional polygraph examinations toward the analysis of facial expressions, voice, and speech patterns, as well as eye-tracking signals to detect deceptive behavior. In this paper, we focus on the last aspect, offer a comprehensive overview of two distinct lie detection methodologies based on eye tracking, and examine the commonly used oculomotor feature analysis. Furthermore, we explore current research directions and their results within the context of their potential applications in the field of forensics. We also highlight future research prospects, suggesting the utilization of eye tracking and scan path interpretation methodologies as a potential fully functional alternative for the conventional polygraph in the future. These considerations refer to legal and ethical issues related to the use of new technology to detect lies.

In real world scenarios, the task of estimating heart rate (HR) using video plethysmography (VPG) methods is difficult because many factors could contaminate the pulse signal (i.e., a subjects’ movement, illumination changes). This article presents the evaluation of a VPG system designed for continuous monitoring of the user’s heart rate during typical human-computer interaction scenarios. The impact of human activities while working at the computer (i.e., reading and writing text, playing a game) on the accuracy of HR VPG measurements was examined. Three commonly used signal extraction methods were evaluated: green (G), green-red difference (GRD), blind source separation (ICA). A new method based on an excess green (ExG) image representation was proposed. Three algorithms for estimating pulse rate were used: power spectral density (PSD), autoregressive modeling (AR) and time domain analysis (TIME). In summary, depending on the scenario being studied, different combinations of signal extraction methods and the pulse estimation algorithm ensure optimal heart rate detection results. The best results were obtained for the ICA method: average RMSE = 6.1 bpm (beats per minute). The proposed ExG signal representation outperforms other methods except ICA (RMSE = 11.2 bpm compared to 14.4 bpm for G and 13.0 bmp for GRD). ExG also is the best method in terms of proposed success rate metric (sRate).

In the present paper the background generation and motion detection algorithms, which are of key importance for the implementation of videodetection, have been presented. A modification of the background generation algorithm, essential for proper algorithm functioning at medium and high road-traffic conditions, has been proposed. Algorithm adaptation for the implementation in reprogrammable device has been also presented. A modification of the SAD algorithm, used in motion detection, has been introduced. The modification allows for regions of interest of irregular shape and structure in the analyzed image. It creates a capability to conduct the calculations in independent and parallel manner for specific, user-defined, active videodetection regions. PixelStream-based implementation has been successfully performed. Real-time verification on reconfigurable platform has been done.

Motivation: The advancement of preventive medicine and, subsequently, telemedicine drives the need for noninvasive and remote measurements in patients’ natural environments. Heart rate (HR) measurements are particularly promising and extensively researched due to their quick assessment and comprehensive representation of patients’ conditions. However, in scenarios such as endurance training or emergencies, where HR measurement was not anticipated and direct access to victims is limited, no method enables obtaining HR results that are suitable even for triage. Methods: This paper presents the possibility of remotely measuring of human HR from a series of in-flight videos using videoplethysmography (VPG) along with skin detection, human pose estimation and image stabilization methods. An unmanned aerial vehicle (UAV) equipped with a camera captured ten segments of video footage featuring volunteers engaged in free walking and running activities in natural sunlight. The human pose was determined using the OpenPose algorithm, and subsequently, skin areas on the face and forearms were identified and tracked in consecutive frames. Ultimately, HR was estimated using several VPG methods: the green channel (G), green-red difference (GR), excess green (ExG), independent component analysis (ICA), and a plane orthogonal to the skin (POS). Results: When compared to simultaneous readings from a reference ECG-based wearable recorder, the root-mean-squared error ranged from 17.7 (G) to 27.7 (POS), with errors of less than 3.5 bpm achieved for the G and GR methods. Conclusions: These results demonstrate the acceptable accuracy of touchless human pulse measurement with the accompanying UAV-mounted camera. The method bridges the gap between HR-transmitting wearables and emergency HR recorders, and it has the potential to be advantageous in training or rescue scenarios in mountain, water, disaster, or battlefield settings.

The importance of developing ambient assisted living technologies (AALT), intended to monitor elderly person activity in their home environment, increases in recent years. Among many approaches, systems based on the optical observation have became popular. Consequently, there is a need of developing robust and fast video analysis platforms and algorithms. In this paper, we propose the use of wearable cameras to monitor the daily activities of the elderly. The novelty of our approach is to analyze gathered data in real-time on wearable platform (without the need of storing video data) and consequently minimize privacy issues. We focus on the person localization in indoor environment, using natural landmark images taken whilst walking inside building during calibration procedure. The hypothesis that wearable video surveillance systems can be used to infer location (and thus detect and monitor the activity of an elderly person) has been confirmed by preliminary tests and results. However, still there are many issues to be solved and therefore further research and development of the proposed solution is planned.