3 March 2022 in IEEE Transactions on Neural Systems and Rehabilitation Engineering
The accurate evaluation of operators’ mental workload in human-machine systems plays an important role in ensuring the correct execution of tasks and the safety of operators. However, the performance of cross-task mental workload evaluation based on physiological metrics remains unsatisfactory. To explore the changes in dynamic functional connectivity properties with varying mental workload in different tasks, four mental workload tasks with different types of information were designed and a newly proposed dynamic brain network analysis method based on EEG microstate was applied in this paper. Six microstate topographies labeled as Microstate A-F were obtained to describe the task-state EEG dynamics, which was highly consistent with previous studies. Dynamic brain network analysis revealed that 15 nodes and 68 pairs of connectivity from the Frontal-Parietal region were sensitive to mental workload in all four tasks, indicating that these nodal metrics had potential to effectively evaluate mental workload in the cross-task scenario. The characteristic path length of Microstate D brain network in both Theta and Alpha bands decreased whereas the global efficiency increased significantly when the mental workload became higher, suggesting that the cognitive control network of brain tended to have higher function integration property under high mental workload state. Furthermore, by using a SVM classifier, an averaged classification accuracy of 95.8% for within-task and 80.3% for cross-task mental workload discrimination were achieved. Results implies that it is feasible to evaluate the cross-task mental workload using the dynamic functional connectivity metrics under specific microstate, which provided a new insight for understanding the neural mechanism of mental workload with different types of information.
24 October 2017 in Journal of Healthcare Engineering
This paper proposed a remote health monitoring system for the elderly based on smart home gateway. The proposed system consists of three parts: the smart clothing, the smart home gateway, and the health care server. The smart clothing collects the elderly’s electrocardiogram (ECG) and motion signals. The home gateway is used for data transmission. The health care server provides services of data storage and user information management; it is constructed on the Windows-Apache-MySQL-PHP (WAMP) platform and is tested on the Ali Cloud platform. To resolve the issues of data overload and network congestion of the home gateway, an ECG compression algorithm is applied. System demonstration shows that the ECG signals and motion signals of the elderly can be monitored. Evaluation of the compression algorithm shows that it has a high compression ratio and low distortion and consumes little time, which is suitable for home gateways. The proposed system has good scalability, and it is simple to operate. It has the potential to provide long-term and continuous home health monitoring services for the elderly.
19 May 2023 in IEEE Transactions on Neural Systems and Rehabilitation Engineering
The accurate evaluation of mental workload of operators in human machine systems is of great significance in ensuring the safety of operators and the correct execution of tasks. However, the effectiveness of EEG based cross-task mental workload evaluation are still unsatisfactory because of the different EEG response patterns in different tasks, which hindered its generalization in real scenario severely. To solve this problem, this paper proposed a feature construction method based on EEG tensor representation and transfer learning, which was verified in various task conditions. Specifically, four working memory load tasks with different types of information were designed firstly. The EEG signals of participants were collected synchronously during task execution. Then, the wavelet transform method was used to perform time-frequency analysis of multi-channel EEG signals, and three-way EEG tensor (time-frequency-channel) features were constructed. EEG tensor features from different tasks were transferred based on the criteria of feature distribution alignment and class-wise discrimination criteria. Finally, the support vector machine was used to construct a 3-class mental workload recognition model. Results showed that compared with the classical feature extraction methods, the proposed method can achieve higher accuracy in both within-task and cross-task mental workload evaluation (91.1% for within-task and 81.3% for cross-task). These results demonstrated that the EEG tensor representation and transfer learning method is feasible and effective for cross-task mental workload evaluation, which can provide theoretical basis and application reference for future researches.
7 November 2024 in IEEE Transactions on Aerospace and Electronic Systems
Given the challenges of direction of arrival (DOA) estimation methods under low signal-to-noise ratios (SNRs), we propose a one-shot architecture search and transformation DOA estimation (OAST-DOA) framework for robust DOA estimation. First, by formulating the DOA estimation problem as a multi-label classification task, the multi-channel training data is constructed from the real covariance matrix under low SNRs. A long short-term memory (LSTM) network is introduced as a controller to guide the process of architecture search and optimal cell selection. In addition, to reduce the computational complexity without compromising performance, the computationally intensive operations are transformed into more efficient alternatives within the optimal cell via architecture transformation. Simulation results show that the proposed OAST-DOA method has significant advantages for scenarios with low SNRs and a relatively small number of snapshots, and exhibits robustness against array model errors.
1 November 2021 in Annual International Conference of the IEEE Engineering in Medicine and Biology Society
More and more hybrid brain-computer interfaces (BCI) supplement traditional single-modality BCI in practical applications. Combinations based on steady-state visual evoked potential (SSVEP) and electromyography (EMG) are the widely used hybrid BCIs. The EMG of jaw clench is commonly used together with SSVEP. This article explored the interference with SSVEP from occipital electrodes by the jaw clench-related EMG so that SSVEP with specific frequency can be identified even during occlusal movements. The experiment was divided into three sets base on the jaw clench patterns (no clenches, chew, and long clench). In each set, the subjects used the same visual stimuli, which were realized by the three flashing targets at different frequencies (6.2Hz, 9.8Hz, and 14.6Hz). After collecting the SSVEP at 4 sites in the occipital region, the SSVEP response spectrum of each stimulus was observed under the three jaw clench patterns. Then, the SSVEP signal was identified by the canonical correlation analysis method for accuracy statistics. Spectrum responses showed that the interference of the jaw clench EMG on SSVEP could be avoided when the stimulation frequency is lower than 20Hz. SSVEP could be identified based on the frequency domain characteristics of these signals. During steady-state visual stimulation with jaw clenches, the recognition rate of SSVEP was still high (no clenches: 100.0%, chew: 94.7%, and long clench: 100.0%). Through reasonable frequency selecting and signal processing, the influence of the jaw clench movement on the SSVEP could be reduced and a high recognition accuracy could be achieved, even the jaw clench actions and the SSVEP stimulation occur simultaneously.
1 January 2026 in IEEE Transactions on Cognitive Communications and Networking