The electrodermal activity (EDA) signal is an electrical manifestation of the sympathetic innervation of the sweat glands. EDA has a history in psychophysiological (including emotional or cognitive stress) research since 1879, but it was not until recent years that researchers began using EDA for pathophysiological applications like the assessment of fatigue, pain, sleepiness, exercise recovery, diagnosis of epilepsy, neuropathies, depression, and so forth. The advent of new devices and applications for EDA has increased the development of novel signal processing techniques, creating a growing pool of measures derived mathematically from the EDA. For many years, simply computing the mean of EDA values over a period was used to assess arousal. Much later, researchers found that EDA contains information not only in the slow changes (tonic component) that the mean value represents, but also in the rapid or phasic changes of the signal. The techniques that have ensued have intended to provide a more sophisticated analysis of EDA, beyond the traditional tonic/phasic decomposition of the signal. With many researchers from the social sciences, engineering, medicine, and other areas recently working with EDA, it is timely to summarize and review the recent developments and provide an updated and synthesized framework for all researchers interested in incorporating EDA into their research.

Accurate estimation of heart rates from photoplethysmogram (PPG) signals during intense physical activity is a very challenging problem. This is because strenuous and high intensity exercise can result in severe motion artifacts in PPG signals, making accurate heart rate (HR) estimation difficult. In this study we investigated a novel technique to accurately reconstruct motion-corrupted PPG signals and HR based on time-varying spectral analysis. The algorithm is called Spectral filter algorithm for Motion Artifacts and heart rate reconstruction (SpaMA). The idea is to calculate the power spectral density of both PPG and accelerometer signals for each time shift of a windowed data segment. By comparing time-varying spectra of PPG and accelerometer data, those frequency peaks resulting from motion artifacts can be distinguished from the PPG spectrum. The SpaMA approach was applied to three different datasets and four types of activities: (1) training datasets from the 2015 IEEE Signal Process. Cup Database recorded from 12 subjects while performing treadmill exercise from 1 km/h to 15 km/h; (2) test datasets from the 2015 IEEE Signal Process. Cup Database recorded from 11 subjects while performing forearm and upper arm exercise. (3) Chon Lab dataset including 10 min recordings from 10 subjects during treadmill exercise. The ECG signals from all three datasets provided the reference HRs which were used to determine the accuracy of our SpaMA algorithm. The performance of the SpaMA approach was calculated by computing the mean absolute error between the estimated HR from the PPG and the reference HR from the ECG. The average estimation errors using our method on the first, second and third datasets are 0.89, 1.93 and 1.38 beats/min respectively, while the overall error on all 33 subjects is 1.86 beats/min and the performance on only treadmill experiment datasets (22 subjects) is 1.11 beats/min. Moreover, it was found that dynamics of heart rate variability can be accurately captured using the algorithm where the mean Pearson’s correlation coefficient between the power spectral densities of the reference and the reconstructed heart rate time series was found to be 0.98. These results show that the SpaMA method has a potential for PPG-based HR monitoring in wearable devices for fitness tracking and health monitoring during intense physical activities.

Detection of atrial fibrillation (AF) from a wrist watch photoplethysmogram (PPG) signal is important because the wrist watch form factor enables long term continuous monitoring of arrhythmia in an easy and non-invasive manner. We have developed a novel method not only to detect AF from a smart wrist watch PPG signal, but also to determine whether the recorded PPG signal is corrupted by motion artifacts or not. We detect motion and noise artifacts based on the accelerometer signal and variable frequency complex demodulation based time-frequency analysis of the PPG signal. After that, we use the root mean square of successive differences and sample entropy, calculated from the beat-to-beat intervals of the PPG signal, to distinguish AF from normal rhythm. We then use a premature atrial contraction detection algorithm to have more accurate AF identification and to reduce false alarms. Two separate datasets have been used in this study to test the efficacy of the proposed method, which shows a combined sensitivity, specificity and accuracy of 98.18%, 97.43% and 97.54% across the datasets.

Time-domain indices of electrodermal activity (EDA) have been used as a marker of sympathetic tone. However, they often show high variation between subjects and low consistency, which has precluded their general use as a marker of sympathetic tone. To examine whether power spectral density analysis of EDA can provide more consistent results, we recently performed a variety of sympathetic tone-evoking experiments (43). We found significant increase in the spectral power in the frequency range of 0.045 to 0.25 Hz when sympathetic tone-evoking stimuli were induced. The sympathetic tone assessed by the power spectral density of EDA was found to have lower variation and more sensitivity for certain, but not all, stimuli compared with the time-domain analysis of EDA. We surmise that this lack of sensitivity in certain sympathetic tone-inducing conditions with time-invariant spectral analysis of EDA may lie in its inability to characterize time-varying dynamics of the sympathetic tone. To overcome the disadvantages of time-domain and time-invariant power spectral indices of EDA, we developed a highly sensitive index of sympathetic tone, based on time-frequency analysis of EDA signals. Its efficacy was tested using experiments designed to elicit sympathetic dynamics. Twelve subjects underwent four tests known to elicit sympathetic tone arousal: cold pressor, tilt table, stand test, and the Stroop task. We hypothesize that a more sensitive measure of sympathetic control can be developed using time-varying spectral analysis. Variable frequency complex demodulation, a recently developed technique for time-frequency analysis, was used to obtain spectral amplitudes associated with EDA. We found that the time-varying spectral frequency band 0.08–0.24 Hz was most responsive to stimulation. Spectral power for frequencies higher than 0.24 Hz were determined to be not related to the sympathetic dynamics because they comprised less than 5% of the total power. The mean value of time-varying spectral amplitudes in the frequency band 0.08–0.24 Hz were used as the index of sympathetic tone, termed TVSymp. TVSymp was found to be overall the most sensitive to the stimuli, as evidenced by a low coefficient of variation (0.54), and higher consistency (intra-class correlation, 0.96) and sensitivity (Youden's index > 0.75), area under the receiver operating characteristic (ROC) curve (>0.8, accuracy > 0.88) compared with time-domain and time-invariant spectral indices, including heart rate variability.

Some smartphones have the capability to process video streams from both the front- and rear-facing cameras simultaneously. This paper proposes a new monitoring method for simultaneous estimation of heart and breathing rates using dual cameras of a smartphone. The proposed approach estimates heart rates using a rear-facing camera, while at the same time breathing rates are estimated using a non-contact front-facing camera. For heart rate estimation, a simple application protocol is used to analyze the varying color signals of a fingertip placed in contact with the rear camera. The breathing rate is estimated from non-contact video recordings from both chest and abdominal motions. Reference breathing rates were measured by a respiration belt placed around the chest and abdomen of a subject; reference heart rates (HR) were determined using the standard electrocardiogram. An automated selection of either the chest or abdominal video signal was determined by choosing the signal with a greater autocorrelation value. The breathing rate was then determined by selecting the dominant peak in the power spectrum. To evaluate the performance of the proposed methods, data were collected from 11 healthy subjects. The breathing ranges spanned both low and high frequencies (6–60 breaths/min), and the results show that the average median errors from the reflectance imaging on the chest and the abdominal walls based on choosing the maximum spectral peak were 1.43% and 1.62%, respectively. Similarly, HR estimates were also found to be accurate.