Thermal cameras capture the infrared radiation emitted from a body in a contactless manner and can provide an indirect estimation of the autonomic nervous system (ANS) dynamics through the regulation of the skin temperature. This study investigates the contribution given by thermal imaging for an effective automatic stress detection with the perspective of a contactless stress recognition system. To this aim, we recorded both ANS correlates (cardiac, electrodermal, and respiratory activity) and thermal images from 25 volunteers under acute stress induced by the Stroop test. We conducted a statistical analysis on the features extracted from each signal, and we implemented subject-independent classifications based on the support vector machine model with an embedded recursive feature elimination algorithm. Particularly, we trained three classifiers using different feature sets: the full set of features, only those derived from the peripheral autonomic correlates, and only those derived from the thermal images. Classification accuracy and feature selection results confirmed the relevant contribution provided by the thermal features in the acute stress detection task. Indeed, a combination of ANS correlates and thermal features achieved 97.37% of accuracy. Moreover, using only thermal features we could still successfully detect stress with an accuracy of 86.84% in a contact-free manner.

Skin temperature reflects the Autonomic Nervous System (ANS)’s response to emotions and mental states and can be remotely measured using InfraRed Thermography. Understanding the physiological mechanisms that affect facial temperature is essential to improve the precision of emotional inference from thermal imaging. To achieve this aim, we recorded thermal images from 30 volunteers, at rest and under acute stress induced by the Stroop test, together with two autonomic correlates, i.e., heart rate variability and electrodermal activity, the former serving as a measure of cardiovascular dynamics, and the latter of the activity of the sweat glands. We used a Cross Mapping (CM) approach to quantify the nonlinear coupling of the temperature from four facial regions with the ANS correlates. CM reveals that facial temperature has a statistically significant correlation with the two autonomic time series, under both conditions, which was not evident in the linear domain. In particular, compared to the other regions, the nose shows a significantly higher link to the electrodermal activity in both conditions, and to the heart rate variability under stress. Moreover, the cardiovascular activity seems to be primarily responsible for the well-known decrease in nose temperature, and its coupling with the thermal signals significantly varies with gender.

Monitoring physiological parameters such as respiratory rate (f$_{R}$) is essential for diagnosing and managing various pathological conditions. Thermal imaging offers a promising contactless alternative to traditional methods, which often rely on partially invasive sensors or obtrusive wearable systems. However, existing approaches for f$_{R}$ estimation from thermal signals typically require extensive pre-processing and manual or semi-automatic region-of-interest (ROI) tracking, limiting their practical applicability. This study proposes a deep learning-based method for estimating f$_{R}$ directly from thermal videos, eliminating the need for complex pre-processing and ROI tracking. A 3D Convolutional Neural Network (3D-CNN) is developed to operate on raw thermal video data. To address challenges related to small datasets, the model is trained using data augmentation and transfer learning from synthetic datasets. Experimental results demonstrate that the proposed approach achieves a validation $R^{2}$ score of approximately 0.61 on both pre-processed and raw thermal videos. By simplifying the workflow, this method holds promise for enhancing the feasibility of thermal imaging in real-world applications, such as remote healthcare and driver monitoring in automotive applications.

Objective: Infrared Thermography (IRT) has been used to monitor skin temperature variation in a contactless manner, in both clinical medicine and psychophysiology. Here, we introduce a new methodology to obtain information about autonomic correlates related to perspiration, peripheral vasomotility, and respiration from infrared recordings. Methods: Our approach involves a model-based decomposition of facial thermograms using Independent Component Analysis (ICA) and an ad-hoc preprocessing procedure. We tested our approach on 30 healthy volunteers whose psychophysiological state was stimulated as part of an experimental protocol. Results: Within-subject ICA analysis identified three independent components demonstrating correlations with the reference physiological signals. Moreover, a linear combination of independent components effectively predicted each physiological signal, achieving median correlations of 0.9 for electrodermal activity, 0.8 for respiration, and 0.73 for photoplethysmography peaks envelope. In addition, we performed a cross-validated inter-subject analysis, which allows to predict physiological signals from facial thermograms of unseen subjects. Conclusions/Significance: Our findings validate the efficacy of features extracted from both original and thermal-derived signals for differentiating experimental conditions. This outcome emphasizes the sensitivity and promise of our approach, advocating for expanded investigations into thermal imaging within biomedical signal analysis. It underscores its potential for enhancing objective assessments of emotional states.