This paper reports on how emotional states elicited by affective sounds can be effectively recognized by means of estimates of Autonomic Nervous System (ANS) dynamics. Specifically, emotional states are modeled as a combination of arousal and valence dimensions according to the well-known circumplex model of affect, whereas the ANS dynamics is estimated through standard and nonlinear analysis of Heart rate variability (HRV) exclusively, which is derived from the electrocardiogram (ECG). In addition, Lagged Poincaré Plots of the HRV series were also taken into account. The affective sounds were gathered from the International Affective Digitized Sound System and grouped into four different levels of arousal (intensity) and two levels of valence (unpleasant and pleasant). A group of 27 healthy volunteers were administered with these standardized stimuli while ECG signals were continuously recorded. Then, those HRV features showing significant changes (p $<;$ 0.05 from statistical tests) between the arousal and valence dimensions were used as input of an automatic classification system for the recognition of the four classes of arousal and two classes of valence. Experimental results demonstrated that a quadratic discriminant classifier, tested through Leave-One-Subject-Out procedure, was able to achieve a recognition accuracy of 84.72 percent on the valence dimension, and 84.26 percent on the arousal dimension.

This study discusses a personalized wearable monitoring system, which provides information and communication technologies to patients with mental disorders and physicians managing such diseases. The system, hereinafter called the PSYCHE system, is mainly comprised of a comfortable t-shirt with embedded sensors, such as textile electrodes, to monitor electrocardiogram-heart rate variability (HRV) series, piezoresistive sensors for respiration activity, and triaxial accelerometers for activity recognition. Moreover, on the patient-side, the PSYCHE system uses a smartphone-based interactive platform for electronic mood agenda and clinical scale administration, whereas on the physician-side provides data visualization and support to clinical decision. The smartphone collects the physiological and behavioral data and sends the information out to a centralized server for further processing. In this study, we present experimental results gathered from ten bipolar patients, wearing the PSYCHE system, with severe symptoms who exhibited mood states among depression (DP), hypomania(HM), mixed state (MX), and euthymia (EU), i.e., the good affective balance. In analyzing more than 400 h of cardiovascular dynamics, we found that patients experiencing mood transitions from a pathological mood state (HM, DP, or MX - where depressive and hypomanic symptoms are simultaneously present) to EU can be characterized through a commonly used measure of entropy. In particular, the SampEn estimated on long-term HRV series increases according to the patients' clinical improvement. These results are in agreement with the current literature reporting on the complexity dynamics of physiological systems and provides a promising and viable support to clinical decision in order to improve the diagnosis and management of psychiatric disorders.

Current clinical practice in diagnosing patients affected by psychiatric disorders such as bipolar disorder is based only on verbal interviews and scores from specific questionnaires, and no reliable and objective psycho-physiological markers are taken into account. In this paper, we propose to use a wearable system based on a comfortable t-shirt with integrated fabric electrodes and sensors able to acquire electrocardiogram, respirogram, and body posture information in order to detect a pattern of objective physiological parameters to support diagnosis. Moreover, we implemented a novel ad hoc methodology of advanced biosignal processing able to effectively recognize four possible clinical mood states in bipolar patients (i.e., depression, mixed state, hypomania, and euthymia) continuously monitored up to 18 h, using heart rate variability information exclusively. Mood assessment is intended as an intrasubject evaluation in which the patient's states are modeled as a Markov chain, i.e., in the time domain, each mood state refers to the previous one. As validation, eight bipolar patients were monitored collecting and analyzing more than 400 h of autonomic and cardiovascular activity. Experimental results demonstrate that our novel concept of personalized and pervasive monitoring constitutes a viable and robust clinical decision support system for bipolar disorders recognizing mood states with a total classification accuracy up to 95.81%.

Understanding human trust in machine partners has become imperative due to the widespread use of intelligent machines in a variety of applications and contexts. The aim of this paper is to investigate whether human-beings trust a social robot—i.e. a human-like robot that embodies emotional states, empathy, and non-verbal communication—differently than other types of agents. To do so, we adapt the well-known economic trust-game proposed by Charness and Dufwenberg (2006) to assess whether receiving a promise from a robot increases human-trust in it. We find that receiving a promise from the robot increases the trust of the human in it, but only for individuals who perceive the robot very similar to a human-being. Importantly, we observe a similar pattern in choices when we replace the humanoid counterpart with a real human but not when it is replaced by a computer-box. Additionally, we investigate participants’ psychophysiological reaction in terms of cardiovascular and electrodermal activity. Our results highlight an increased psychophysiological arousal when the game is played with the social robot compared to the computer-box. Taken all together, these results strongly support the development of technologies enhancing the humanity of robots.

Bipolar disorder (BD) is characterized by an alternation of mood states from depression to (hypo)mania. Mixed states, i.e., a combination of depression and mania symptoms at the same time, can also be present. The diagnosis of this disorder in the current clinical practice is based only on subjective interviews and questionnaires, while no reliable objective psycho-physiological markers are available. Furthermore, there are no biological markers predicting BD outcomes, or providing information about the future clinical course of the phenomenon. To overcome this limitation, here we propose a methodology predicting mood changes in BD using heartbeat nonlinear dynamics exclusively, derived from the ECG. Mood changes are here intended as transitioning between two mental states: euthymic state (EUT), i.e., the good affective balance, and non-euthymic (non-EUT) states. Heart rate variability (HRV) series from 14 bipolar spectrum patients (age: 33.43 ± 9.76, age range: 23-54; six females) involved in the European project PSYCHE, undergoing whole night electrocardiogram (ECG) monitoring were analyzed. Data were gathered from a wearable system comprised of a comfortable t-shirt with integrated fabric electrodes and sensors able to acquire ECGs. Each patient was monitored twice a week, for 14 weeks, being able to perform normal (unstructured) activities. From each acquisition, the longest artifact-free segment of heartbeat dynamics was selected for further analyses. Sub-segments of 5 min of this segment were used to estimate trends of HRV linear and nonlinear dynamics. Considering data from a current observation at day t ₀ , and past observations at days (t _-1 , t _-2 ,...,), personalized prediction accuracies in forecasting a mood state (EUT/non-EUT) at day t ₊₁ were 69% on average, reaching values as high as 83.3%. This approach opens to the possibility of predicting mood states in bipolar patients through heartbeat nonlinear dynamics exclusively.

The non-invasiveness of photoplethysmographic (PPG) acquisition systems, together with their cost-effectiveness and easiness of connection with IoT technologies, is opening up to the possibility of their widespread use. For this reason, the study of the reliability of PPG and pulse rate variability (PRV) signal quality has become of great scientific, technological, and commercial interest. In this field, sensor location has been demonstrated to play a crucial role. The goal of this study was to investigate PPG and PRV signal quality acquired from two body locations: finger and wrist. We simultaneously acquired the PPG and electrocardiographic (ECG) signals from sixteen healthy subjects (aged 28.5 ± 3.5, seven females) who followed an experimental protocol of affective stimulation through visual stimuli. Statistical tests demonstrated that PPG signals acquired from the wrist and the finger presented different signal quality indexes (kurtosis and Shannon entropy), with higher values for the wrist-PPG. Then we propose to apply the cross-mapping (CM) approach as a new method to quantify the PRV signal quality. We found that the performance achieved using the two sites was significantly different in all the experimental sessions (p < 0.01), and the PRV dynamics acquired from the finger were the most similar to heart rate variability (HRV) dynamics.