Emotion recognition based on physiological signals has been a hot topic and applied in many areas such as safe driving, health care and social security. In this paper, we present a comprehensive review on physiological signal-based emotion recognition, including emotion models, emotion elicitation methods, the published emotional physiological datasets, features, classifiers, and the whole framework for emotion recognition based on the physiological signals. A summary and comparation among the recent studies has been conducted, which reveals the current existing problems and the future work has been discussed.

EEG-based automatic emotion recognition can help brain-inspired robots in improving their interactions with humans. This paper presents a novel framework for emotion recognition using multi-channel electroencephalogram (EEG). The framework consists of a linear EEG mixing model and an emotion timing model. Our proposed framework considerably decomposes the EEG source signals from the collected EEG signals and improves classification accuracy by using the context correlations of the EEG feature sequences. Specially, Stack AutoEncoder (SAE) is used to build and solve the linear EEG mixing model and the emotion timing model is based on the Long Short-Term Memory Recurrent Neural Network (LSTM-RNN). The framework was implemented on the DEAP dataset for an emotion recognition experiment, where the mean accuracy of emotion recognition achieved 81.10% in valence and 74.38% in arousal, and the effectiveness of our framework was verified. Our framework exhibited a better performance in emotion recognition using multi-channel EEG than the compared conventional approaches in the experiments.

Emotion recognition and monitoring based on commonly used wearable devices can play an important role in psychological health monitoring and human-computer interaction. However, the existing methods cannot rely on the common smart bracelets or watches for emotion monitoring in daily life. To address this issue, our study proposes a method for emotional recognition using heart rate data from a wearable smart bracelet. A ‘neutral + target’ pair emotion stimulation experimental paradigm was presented, and a dataset of heart rate from 25 subjects was established, where neutral plus target emotion (neutral, happy, and sad) stimulation video pairs from China’s standard Emotional Video Stimuli materials (CEVS) were applied to the recruited subjects. Normalized features from the data of target emotions normalized by the baseline data of neutral mood were adopted. Emotion recognition experiment results approved the effectiveness of ‘neutral + target’ video pair simulation experimental paradigm, the baseline setting using neutral mood data, and the normalized features, as well as the classifiers of Adaboost and GBDT on this dataset. This method will promote the development of wearable consumer electronic devices for monitoring human emotional moods.

One of the major challenges of daily wearable electroencephalogram (EEG) monitoring is that there are rarely suitable EEG electrodes for hairy sites. Wet electrodes require conductive gels, which will dry over the acquisition time, making them unstable for long-term EEG monitoring. Additionally, the electrode–scalp impedances of most dry electrodes are not adequate for high quality EEG collection at hairy sites. In view of the above problems, a flexible multi-layer semi-dry electrode was proposed for EEG monitoring in this study. The semi-dry electrode contains a flexible electrode body layer, foam layer and reservoir layer. The probe structure of the electrode body layer enables the electrode to work effectively at hairy sites. During long-term EEG monitoring, electrolytes stored in the reservoir layer are continuously released through the foam layer to the electrode–scalp interface, ensuring a lower electrode–scalp contact impedance. The experimental results showed that the average electrode–scalp impedance of the semi-dry electrode at a hairy site was only 23.89 ± 7.44 KΩ at 10 Hz, and it was lower than 40 KΩ over a long-term use of 5 h. The electrode performed well in both static and dynamic EEG monitoring, where the temporal correlation with wet electrode signals at the hairy site could reach 94.25% and 90.65%, respectively, and specific evoked EEG signals could be collected. The flexible multi-layer semi-dry electrode can be well applied to scalp EEG monitoring at hairy sites, providing a promising solution for daily long-term monitoring of wearable EEGs.

Diabetic foot is one of the main complications of diabetes with the characteristics of high incidence and difficulty in treatment. Diabetic patients with peripheral neuropathy may develop foot ulcers, and in severe cases amputations are required and some may even die. Plantar pressure can be used to assess the risk of developing diabetic foot, but the existing plantar pressure monitoring methods are not suitable for long-term monitoring in daily life. This study presents a novel low-cost shoe system for daily monitoring of plantar pressure in diabetics. It includes an insole with pressure sensor array, which can dynamically monitor the plantar pressure and display the changes of plantar pressure in real time in the mobile phone to provide early warning for patients with high risk of diabetic foot. As for the sensor, copper and carbon black were adopted as the electrode and conductive filler respectively, enabling a mass production with low price. It was soft and bendable, meeting the performance needs of daily plantar pressure monitoring. All devices were encapsulated in shoes, and the data was transmitted wirelessly through Bluetooth, which did not affect the user's walking. After using random forest for feature selection, five classifiers were used to classify the plantar pressure of healthy people, diabetic patients without peripheral neuropathy, and diabetic patients with peripheral neuropathy collected by this system. The results showed the accuracy of the random forest classifier was the highest, reaching 94.7%, which indicated the system could be useful for daily plantar pressure monitoring of diabetic patients.