Brain-computer interface (BCI) technologies have been widely used in many areas. In particular, non-invasive technologies such as electroencephalography (EEG) or near-infrared spectroscopy (NIRS) have been used to detect motor imagery, disease, or mental state. It has been already shown in literature that the hybrid of EEG and NIRS has better results than their respective individual signals. The fusion algorithm for EEG and NIRS sources is the key to implement them in real-life applications. In this research, we propose three fusion methods for the hybrid of the EEG and NIRS-based brain-computer interface system: linear fusion, tensor fusion, and p th-order polynomial fusion. Firstly, our results prove that the hybrid BCI system is more accurate, as expected. Secondly, the p th-order polynomial fusion has the best classification results out of the three methods, and also shows improvements compared with previous studies. For a motion imagery task and a mental arithmetic task, the best detection accuracy in previous papers were 74.20% and 88.1%, whereas our accuracy achieved was 77.53% and 90.19%. Furthermore, unlike complex artificial neural network methods, our proposed methods are not as computationally demanding.
4 November 2020 in IEEE Transactions on Automation Science and Engineering
Planes and edges are attractive features for simultaneous localization and mapping (SLAM) in indoor environments because they can be reliably extracted and are robust to illumination changes. However, it remains a challenging problem to seamlessly fuse two different kinds of features to avoid degeneracy and accurately estimate the camera motion. In this article, a plane-edge-SLAM system using an RGB-D sensor is developed to address the seamless fusion of planes and edges. Constraint analysis is first performed to obtain a quantitative measure of how the planes constrain the camera motion estimation. Then, using the results of the constraint analysis, an adaptive weighting algorithm is elaborately designed to achieve seamless fusion. Through the fusion of planes and edges, the solution to motion estimation is fully constrained, and the problem remains well-posed in all circumstances. In addition, a probabilistic plane fitting algorithm is proposed to fit a plane model to the noisy 3-D points. By exploiting the error model of the depth sensor, the proposed plane fitting is adaptive to various measurement noises corresponding to different depth measurements. As a result, the estimated plane parameters are more accurate and robust to the points with large uncertainties. Compared with the existing plane fitting methods, the proposed method definitely benefits the performance of motion estimation. The results of extensive experiments on public data sets and in real-world indoor scenes demonstrate that the plane-edge-SLAM system can achieve high accuracy and robustness.
7 August 2020 in IEEE Transactions on Neural Systems and Rehabilitation Engineering
Previous studies made progress in the early diagnosis of Alzheimer’s disease (AD) using electroencephalography (EEG) without considering EEG connectivity. To fill this gap, we explored significant differences between early AD patients and controls based on frequency domain and spatial properties using functional connectivity in mild cognitive impairment (MCI) and mild AD datasets. Four global metrics, network resilience, connection-level metrics and node versatility were used to distinguish between controls and patients. The results show that the main frequency bands that are different between MCI patients and controls are the $\theta $ and low $\alpha $ bands, and the differently affected brain areas are the frontal, left temporal and parietal areas. Compared to MCI patients, in patients with mild AD, the main frequency bands that are different are the low and high $\alpha $ bands, and the main differently affected brain region is a larger right temporal area. Four LOFC bands were used as input to train the ResNet-18 model. For the MCI dataset, the average accuracy of 20 runs was 93.42% and the best accuracy was 98.33%, while for the mild AD dataset, the average accuracy was 98.54% and the best accuracy was 100%. To determine the timing of early treatment and discovering the susceptible patients, and to slow the progression of the disease, we assume that the occurrence of MCI and mild AD and their progression to more serious AD and dementia could be inferred by analyzing the topological structure of the brain network generated by EEG. Our findings provide a novel solution for connectome-based biomarker analysis to improve personalized medicine.
4 December 2018 in IEEE Transactions on Cognitive and Developmental Systems
Surface electromyogram (sEMG) signals have been used to control multifunctional prosthetic hands. Researchers usually focused on the use of several channels with sEMG signals to identify more gestures without limiting the number of sEMG sensors. However, the residual muscles of an amputee are limited. Therefore, the point of a successful recognition system is to decrease the channels of sEMG signals to classify more gestures. To achieve this goal, we proposed a novel gesture recognition system, in which three channels of sEMG signals can classify nine gestures. In this recognition system, the time domain features, root mean square ratio (RMSR) and autoregressive (AR) model, were selected to extract the features of the sEMG signals as compared with the time-frequency domain features. Furthermore, the linear discriminant analysis (LDA) was adopted as the classifier. Consequently, the average accuracy rate of the presented system was 91.7%. Therefore, the proposed gesture recognition system is feasible to identify more gestures with less sensors.
Treadmills are widely used to recover walking function in the rehabilitation field for those patients with gait disorders. Nevertheless, the ultimate goal of walking function recovery is to walk on the ground rather than on the treadmill. This study aims to determine the effect of treadmill walking on gait and upper trunk movement characteristics using wearable sensors. Eight healthy male subjects are recruited to perform 420-m straight overground walking (OW) and 5 min treadmill walking (TW), wearing 3 inertial measurement units and a pair of insole sensors. In addition to common linear features, nonlinear features, which contains sample entropy, maximal Lyapunov exponent and fractal dynamic of stride intervals (detrended fluctuation analysis), are used to compare the difference between TW and OW condition. Canonical correlation analysis is also used to indicate the correlation between upper trunk movement characteristics and gait features in the aspects of spatiotemporal parameters and gait dynamic features. The experimental results show that the treadmill can cause a shorter stride length, less stride time and worsen long-range correlation of stride intervals. And the treadmill can significantly increase the stability for both gait and upper trunk, while it can significantly reduce gait regularity during swing phase. Canonical correlation analysis results show that treadmill can reduce the correlation between gait and upper trunk features. One possible interpretation of these results is that people tend to walk more cautiously to prevent the risk of falling and neglect the coordination between gait and upper trunk when walking on the treadmill. This study can provide fundamental insightful information about the effect of treadmill walking on gait and upper trunk to support future similar studies.