The study of emotions through the analysis of the induced physiological responses gained increasing interest in the past decades. Emotion-related studies usually employ films or video clips, but these stimuli do not give the possibility to properly separate and assess the emotional content provided by sight or hearing in terms of physiological responses. In this study we have devised an experimental protocol to elicit emotions by using, separately and jointly, pictures and sounds from the widely used International Affective Pictures System and International Affective Digital Sounds databases. We processed galvanic skin response, electrocardiogram, blood volume pulse, pupillary signal and electroencephalogram from 21 subjects to extract both autonomic and central nervous system indices to assess physiological responses in relation to three types of stimulation: auditory, visual, and auditory/visual. Results show a higher galvanic skin response to sounds compared to images. Electrocardiogram and blood volume pulse show different trends between auditory and visual stimuli. The electroencephalographic signal reveals a greater attention paid by the subjects when listening to sounds compared to watching images. In conclusion, these results suggest that emotional responses increase during auditory stimulation at both central and peripheral levels, demonstrating the importance of sounds for emotion recognition experiments and also opening the possibility toward the extension of auditory stimuli in other fields of psychophysiology. Clinical and Translational Impact Statement- These findings corroborate auditory stimuli’s importance in eliciting emotions, supporting their use in studying affective responses, e.g., mood disorder diagnosis, human-machine interaction, and emotional perception in pathology.
Objective. Deep learning algorithms employed in brain computer interfaces (BCIs) need large electroencephalographic (EEG) datasets to be trained. These datasets are usually unbalanced, particularly when error potential (ErrP) experiment are considered, being ErrP’s epochs much rarer than non-ErrP ones. To face the issue of unbalance of rare epochs, this paper presents a novel, data balancing methods based on ARX–modelling. Approach. AutoRegressive with eXogenous input (ARX)-models are identified on the EEG data of the ‘Monitoring error-related potentials’ dataset of the BNCI Horizon 2020 and then employed to generate new synthetic data of the minority class of ErrP epochs. The balanced dataset is used to train a classifier of non-ErrP vs. ErrP epochs based on EEGNet. Main results. Compared to classical techniques (e.g. class weights, CW) for data balancing, the new method outperforms the others in terms of resulting accuracy (i.e. ARX vs CW ), F1-score (i.e. ARX vs CW ) and balanced accuracy (i.e. ARX vs CW ) and also reduces the number of false positive detection (i.e. ARX 51 vs CW 104). Moreover, the ARX-based method shows a better generalization capability of the whole model to classify and predict new data. Significance. The results obtained suggest that the proposed method can be used in BCI application for tackling the issue of data unbalance and obtain more reliable and robust performances.
3 November 2025 in Sensors and Actuators A: Physical
Introduction: Motor Imagery (MI)-based Brain Computer Interfaces (BCI) have raised gained attention for their use in rehabilitation therapies since they allow controlling an external device by using brain activity, in this way promoting brain plasticity mechanisms that could lead to motor recovery. Specifically, rehabilitation robotics can provide precision and consistency for movement exercises, while embodied robotics could provide sensory feedback that can help patients improve their motor skills and coordination. However, it is still not clear whether different types of visual feedback may affect the elicited brain response and hence the effectiveness of MI-BCI for rehabilitation.Methods: In this paper, we compare two visual feedback strategies based on controlling the movement of robotic arms through a MI-BCI system: 1) first-person perspective, with visual information that the user receives when they view the robot arms from their own perspective; and 2) third-person perspective, whereby the subjects observe the robot from an external perspective. We studied 10 healthy subjects over three consecutive sessions. The electroencephalographic (EEG) signals were recorded and evaluated in terms of the power of the sensorimotor rhythms, as well as their lateralization, and spatial distribution.Results: Our results show that both feedback perspectives can elicit motor-related brain responses, but without any significant differences between them. Moreover, the evoked responses remained consistent across all sessions, showing no significant differences between the first and the last session.Discussion: Overall, these results suggest that the type of perspective may not influence the brain responses during a MI- BCI task based on a robotic feedback, although, due to the limited sample size, more evidence is required. Finally, this study resulted into the production of 180 labeled MI EEG datasets, publicly available for research purposes.
Recent advances in wearable technology have enabled the recording of electrocardiogram (ECG) signals from unconventional body locations, including the head. Particularly on this last location, ECG recording is challenging due to the low signal-to-noise ratio (SNR), making fundamental the selection of relevant positions on the head to gather high-quality signals. In addition, traditional wet electrodes are unsuitable, necessitating the use of dry electrodes. In this work, we investigated the feasibility of recording the ECG using a novel eyewear-based setup, enabling a single-lead high-quality ECG acquisition. The prototype featured three dry electrodes, strategically placed on an eyewear prototype, one in the nose pad (reference electrode), the second electrode (-) in contact with the ear pad skin and the third electrode (+) exposed on the external surface of the frame to be touched by the fingertip. Among various materials, we identified conductive elastomers featuring the most favorable impedance characteristics through measurements performed on gelatin compounds and human skin. The prototype was systematically tested against standard chest ECG in 25 participants to verify the quality of the ECG signal and the derived heart-rate variability (HRV) indexes. The recorded ECG signals were classified as Excellent, Barely Acceptable, and Unacceptable in 72, 28 and 0% of the overall cases. HRV indices obtained from both the prototype and standard ECG showcased a strong correlation (R >0.9). This study highlighted the feasibility of high-quality ECG recording based on eyewear setups.
We present a novel architecture designed to enhance the detection of Error Potential (ErrP) signals during ErrP stimulation tasks. In the context of predicting ErrP presence, conventional Convolutional Neural Networks (CNNs) typically accept a raw EEG signal as input, encompassing both the information associated with the evoked potential and the background activity, which can potentially diminish predictive accuracy. Our approach involves advanced Single-Trial (ST) ErrP enhancement techniques for processing raw EEG signals in the initial stage, followed by CNNs for discerning between ErrP and NonErrP segments in the second stage. We tested different combinations of methods and CNNs. As far as ST ErrP estimation is concerned, we examined various methods encompassing subspace regularization techniques, Continuous Wavelet Transform, and ARX models. For the classification stage, we evaluated the performance of EEGNet, CNN, and a Siamese Neural Network. A comparative analysis against the method of directly applying CNNs to raw EEG signals revealed the advantages of our architecture. Leveraging subspace regularization yielded the best improvement in classification metrics, at up to 14% in balanced accuracy and 13.4% in F1-score.