Smart wearables, equipped with sensors monitoring physiological parameters, are becoming an integral part of our life. In this work, we investigate the possibility of utilizing such wearables to recognize emotions in the wild. In most reviewed papers, the authors apply a similar procedure consisting of participant recruitment, stimuli preparation and annotation, signal collection and processing, self-assessment, and machine learning model learning and validation. Besides, we identified seven emotion recognition scenarios and analyzed the transition from psychological models to machine learning tasks.
1 September 2003 in Annals of Biomedical Engineering
Wearables equipped with pervasive sensors enable us to monitor physiological and behavioral signals in our everyday life. We propose the WellAff system able to recognize affective states for wellbeing support. It also includes health care scenarios, in particular patients with chronic kidney disease suffering from bipolar disorders. For the need of a large-scale field study, we revised over 50 off-the-shelf devices in terms of usefulness for emotion, stress, meditation, sleep, and physical activity recognition and analysis. Their usability directly comes from the types of sensors they possess as well as the quality and availability of raw signals. We found there is no versatile device suitable for all purposes. Using Empatica E4 and Samsung Galaxy Watch, we have recorded physiological signals from 11 participants over many weeks. The gathered data enabled us to train a classifier that accurately recognizes strong affective states.
Cardiac monitoring based on wearable photoplethysmography (PPG) is widespread because of its usability and low cost. Unfortunately, PPG is negatively affected by various types of disruptions, which could introduce errors to the algorithm that extracts pulse rate variability (PRV). This study aims to identify the nature of such artifacts caused by various types of factors under the conditions of precisely planned experiments. We also propose methods for their reduction based solely on the PPG signal while preserving the frequency content of PRV. The accuracy of PRV derived from PPG was compared to heart rate variability (HRV) derived from the accompanying ECG. The results indicate that filtering PPG signals using the discrete wavelet transform and its inverse (DWT/IDWT) is suitable for removing slow components and high-frequency noise. Moreover, the main benefit of amplitude demodulation is better preparation of the PPG to determine the duration of pulse cycles and reduce the impact of some other artifacts. Post-processing applied to HRV and PRV indicates that the correction of outliers based on local statistical measures of signals and the autoregressive (AR) model is only important when the PPG is of low quality and has no effect under good signal quality. The main conclusion is that the DWT/IDWT, followed by amplitude demodulation, enables the proper preparation of the PPG signal for the subsequent use of PRV extraction algorithms, particularly at rest. However, post-processing in the proposed form should be applied more in the situations of observed strong artifacts than in motionless laboratory experiments.
1 November 1998 in Computers in Biology and Medicine