Mental workload (MW) represents the amount of brain resources required to perform concurrent tasks. The evaluation of MW is of paramount importance for Advanced Driver-Assistance Systems, given its correlation with traffic accidents risk. In the present research, two cognitive tests (Digit Span Test—DST and Ray Auditory Verbal Learning Test—RAVLT) were administered to participants while driving in a simulated environment. The tests were chosen to investigate the drivers’ response to predefined levels of cognitive load to categorize the classes of MW. Infrared (IR) thermal imaging concurrently with heart rate variability (HRV) were used to obtain features related to the psychophysiology of the subjects, in order to feed machine learning (ML) classifiers. Six categories of models have been compared basing on unimodal IR/unimodal HRV/multimodal IR + HRV features. The best classifier performances were reached by the multimodal IR + HRV features-based classifiers (DST: accuracy = 73.1%, sensitivity = 0.71, specificity = 0.69; RAVLT: accuracy = 75.0%, average sensitivity = 0.75, average specificity = 0.87). The unimodal IR features based classifiers revealed high performances as well (DST: accuracy = 73.1%, sensitivity = 0.73, specificity = 0.73; RAVLT: accuracy = 71.1%, average sensitivity = 0.71, average specificity = 0.85). These results demonstrated the possibility to assess drivers’ MW levels with high accuracy, also using a completely non-contact and non-invasive technique alone, representing a key advancement with respect to the state of the art in traffic accident prevention.
The development of detection methodologies for reliable drowsiness tracking is a challenging task requiring both appropriate signal inputs and accurate and robust algorithms of analysis. The aim of this research is to develop an advanced method to detect the drowsiness stage in electroencephalogram (EEG), the most reliable physiological measurement, using the promising Machine Learning methodologies. The methods used in this paper are based on Machine Learning methodologies such as stacked autoencoder with softmax layers. Results obtained from 62 volunteers indicate 100% accuracy in drowsy/wakeful discrimination, proving that this approach can be very promising for use in the next generation of medical devices. This methodology can be extended to other uses in everyday life in which the maintaining of the level of vigilance is critical. Future works aim to perform extended validation of the proposed pipeline with a wide-range training set in which we integrate the photoplethysmogram (PPG) signal and visual information with EEG analysis in order to improve the robustness of the overall approach.
Background: As the human behavior is influenced by both cognition and emotion, affective computing plays a central role in human-machine interaction. Algorithms for emotions recognition are usually based on behavioral analysis or on physiological measurements (e.g., heart rate, blood pressure). Among these physiological signals, pulse wave propagation in the circulatory tree can be assessed through photoplethysmography (PPG), a non-invasive optical technique. Since pulse wave characteristics are influenced by the cardiovascular status, which is affected by the autonomic nervous activity and hence by the psychophysiological state, PPG might encode information about emotional conditions. The capability of a multivariate data-driven approach to estimate state anxiety (SA) of healthy participants from PPG features acquired on the brachial and radial artery was investigated. Methods: The machine learning method was based on General Linear Model and supervised learning. PPG was measured employing a custom-made system and SA of the participants was assessed through the State-Trait Anxiety Inventory (STAI-Y) test. Results: A leave-one-out cross-validation framework showed a good correlation between STAI-Y score and the SA predicted by the machine learning algorithm (r = 0.81; p = 1.87∙10−9). The preliminary results suggested that PPG can be a promising tool for emotions recognition, convenient for human-machine interaction applications.
Automatically recognizing negative emotions, such as anger or stress, and also positive ones, such as euphoria, can contribute to improving well-being. In real-life, emotion recognition is a difficult task since many of the technologies used for this purpose in both laboratory and clinic environments, such as electroencephalography (EEG) and electrocardiography (ECG), cannot realistically be used. Photoplethysmography (PPG) is a non-invasive technology that can be easily integrated into wearable sensors. This paper focuses on the comparison between PPG and ECG concerning their efficacy in detecting the psychophysical and affective states of the subjects. It has been confirmed that the levels of accuracy in the recognition of affective variables obtained by PPG technology are comparable to those achievable with the more traditional ECG technology. Moreover, the affective psychological condition of the participants (anxiety and mood levels) may influence the psychophysiological responses recorded during the experimental tests.
Cardiovascular disease is a leading cause of death. Several markers have been proposed to predict cardiovascular morbidity. The ankle-brachial index (ABI) marker is defined as the ratio between the ankle and the arm systolic blood pressures, and it is generally assessed through sphygmomanometers. An alternative tool for cardiovascular status assessment is Photoplethysmography (PPG). PPG is a non-invasive optical technique that measures volumetric blood changes induced by pulse pressure propagation within arteries. However, PPG does not provide absolute pressure estimation, making assessment of cardiovascular status less direct. The capability of a multivariate data-driven approach to predict ABI from peculiar PPG features was investigated here. ABI was measured using a commercial instrument (Enverdis Vascular Explorer, VE-ABI), and it was then used for a General Linear Model estimation of ABI from multi-site PPG in a supervised learning framework (PPG-ABI). A Receiver Operating Characteristic (ROC) analysis allowed to investigate the capability of PPG-ABI to discriminate cardiovascular impairment as defined by VE-ABI. Findings suggested that ABI can be estimated form PPG (r = 0.79) and can identify pathological cardiovascular status (AUC = 0.85). The advantages of PPG are simplicity, speed and operator-independency, allowing extensive screening of cardiovascular status and associated cardiovascular risks.
The development and validation of a system for multi-site photoplethysmography (PPG) and electrocardiography (ECG) is presented. The system could acquire signals from 8 PPG probes and 10 ECG leads. Each PPG probe was constituted of a light-emitting diode (LED) source at a wavelength of 940 nm and a silicon photomultiplier (SiPM) detector, located in a back-reflection recording configuration. In order to ensure proper optode-to-skin coupling, the probe was equipped with insufflating cuffs. The high number of PPG probes allowed us to simultaneously acquire signals from multiple body locations. The ECG provided a reference for single-pulse PPG evaluation and averaging, allowing the extraction of indices of cardiovascular status with a high signal-to-noise ratio. Firstly, the system was characterized on optical phantoms. Furthermore, in vivo validation was performed by estimating the brachial-ankle pulse wave velocity (baPWV), a metric associated with cardiovascular status. The validation was performed on healthy volunteers to assess the baPWV intra- and extra-operator repeatability and its association with age. Finally, the baPWV, evaluated via the developed instrumentation, was compared to that estimated with a commercial system used in clinical practice (Enverdis Vascular Explorer). The validation demonstrated the system’s reliability and its effectiveness in assessing the cardiovascular status in arterial ageing.