Unmanaged long-term mental stress in the workplace can lead to serious health problems and reduced productivity. To prevent this, it is important to recognize and relieve mental stress in a timely manner. Here, we propose a novel stress detection algorithm based on end-to-end deep learning using multiple physiological signals, such as electrocardiogram (ECG) and respiration (RESP) signal. To mimic workplace stress in our experiments, we used Stroop and math tasks as stressors, with each stressor being followed by a relaxation task. Herein, we recruited 18 subjects and measured both ECG and RESP signals using Zephyr BioHarness 3.0. After five-fold cross validation, the proposed network performed well, with an average accuracy of 83.9%, an average F1 score of 0.81, and an average area under the receiver operating characteristic (ROC) curve (AUC) of 0.92, demonstrating its superiority over conventional machine learning models. Furthermore, by visualizing the activation of the trained network’s neurons, we found that they were activated by specific ECG and RESP patterns. In conclusion, we successfully validated the feasibility of end-to-end deep learning using multiple physiological signals for recognition of mental stress in the workplace. We believe that this is a promising approach that will help to improve the quality of life of people suffering from long-term work-related mental stress.
Motion classification can be performed using biometric signals recorded by electroencephalography (EEG) or electromyography (EMG) with noninvasive surface electrodes for the control of prosthetic arms. However, current single-modal EEG and EMG based motion classification techniques are limited owing to the complexity and noise of EEG signals, and the electrode placement bias, and low-resolution of EMG signals. We herein propose a novel system of two-dimensional (2D) input image feature multimodal fusion based on an EEG/EMG-signal transfer learning (TL) paradigm for detection of hand movements in transforearm amputees. A feature extraction method in the frequency domain of the EEG and EMG signals was adopted to establish a 2D image. The input images were used for training on a model based on the convolutional neural network algorithm and TL, which requires 2D images as input data. For the purpose of data acquisition, five transforearm amputees and nine healthy controls were recruited. Compared with the conventional single-modal EEG signal trained models, the proposed multimodal fusion method significantly improved classification accuracy in both the control and patient groups. When the two signals were combined and used in the pretrained model for EEG TL, the classification accuracy increased by 4.18–4.35% in the control group, and by 2.51–3.00% in the patient group.
This paper covers the feasibility of electrogastrogram (EGG) in multi-modal mental stress assessment in conjunction with electrocardiogram (ECG) and respiratory signal (RESP). In this study, twenty-one healthy participants were repeatedly relaxed, stressed, and highly stressed according to our experimental protocol, which was based on combined arithmetic and Stroop tasks, and their EGG, ECG, and RESP were simultaneously captured. Subsequently, various features were extracted from the signals, and correlation analysis was performed between mental stress levels and the features, especially the EGG features. Furthermore, conventional machine learning models were optimized and validated to verify the feasibility of EGG in mental stress detection. Some EGG features exhibited significant correlation to mental stress levels (ρbi,menaDP = -0.187 and ρmulti,meanDP = -0.177, p < 0.001). The correlation degree was comparable to that of the RESP features. The EGG features largely reflected individual differences regarding mental stress response compared to the ECG and RESP features. Most importantly, the utilization of the EGG features along with the ECG and RESP features significantly improved the accuracy of several models by up to 8% regarding mental stress detection. Especially, logistic regression exhibited moderate accuracy in detecting mental stress (70.15% accuracy and 0.741 area under the receiver operating characteristic curve). We believe that EGG monitoring could significantly contribute to in-depth mental stress evaluation, and potentially be used for the development of real-time mental stress monitoring system and personalized mental stress assessment modality.
28 October 2020 in IEEE Transactions on Biomedical Circuits and Systems
Recently, electroceutical has been spotlighted as an emerging treatment for various severe chronic brain diseases due to its intrinsic advantage of electrical interaction with brain, the most electrically active organ. However, most attempts have verified only short-term efficacy through acute studies in lab test due to the lack of reliable miniaturized platform for long-term animal studies. Building a sufficient level of integrated system for such platform is extremely difficult since it requires a multi-disciplinary work of state-of-the-art technologies in a wide range of fields. Here, we propose a complete system of implantable platform for the long term preclinical brain study. Our proposed system, the Extra Cranial Brain Activator (ECBA), consists of a titanium-packaged implantable module and a helmet type base station which powers the module wirelessly. ECBA can be also controlled by a remote handheld device. Using ECBA, we have performed a long term study with multiple number of non-anesthetic canine subjects, and the resulting PET-CT scans showed remarkable enhancement of brain activity related to memory and sensory skills. Furthermore, histologic analysis and high temperature aging test have confirmed the system‘s reliability for up to 31 months. Hence, the proposed ECBA system is highly expected to lead a new paradigm of the human neuro-modulation study in the near future.