In this study, we determine the optimal feature-combination for classification of functional near-infrared spectroscopy (fNIRS) signals with the best accuracies for development of a two-class brain-computer interface (BCI). Using a multi-channel continuous-wave imaging system, mental arithmetic signals are acquired from the prefrontal cortex of seven healthy subjects. After removing physiological noises, six oxygenated and deoxygenated hemoglobin (HbO and HbR) features — mean, slope, variance, peak, skewness and kurtosis — are calculated. All possible 2- and 3-feature combinations of the calculated features are then used to classify mental arithmetic versus rest using linear discriminant analysis (LDA). It is found that the combinations containing mean and peak values yielded significantly higher (p < 0.05) classification accuracies for both HbO and HbR than did all of the other combinations, across all of the subjects. These results demonstrate the feasibility of achieving high classification accuracies using mean and peak values of HbO and HbR as features for classification of mental arithmetic versus rest for a two-class BCI.

We analyse and compare the classification accuracies of six different classifiers for a two-class mental task (mental arithmetic and rest) using functional near-infrared spectroscopy (fNIRS) signals. The signals of the mental arithmetic and rest tasks from the prefrontal cortex region of the brain for seven healthy subjects were acquired using a multichannel continuous-wave imaging system. After removal of the physiological noises, six features were extracted from the oxygenated hemoglobin (HbO) signals. Two- and three-dimensional combinations of those features were used for classification of mental tasks. In the classification, six different modalities, linear discriminant analysis (LDA), quadratic discriminant analysis (QDA),k-nearest neighbour (kNN), the Naïve Bayes approach, support vector machine (SVM), and artificial neural networks (ANN), were utilized. With these classifiers, the average classification accuracies among the seven subjects for the 2- and 3-dimensional combinations of features were 71.6, 90.0, 69.7, 89.8, 89.5, and 91.4% and 79.6, 95.2, 64.5, 94.8, 95.2, and 96.3%, respectively. ANN showed the maximum classification accuracies: 91.4 and 96.3%. In order to validate the results, a statistical significance test was performed, which confirmed that thepvalues were statistically significant relative to all of the other classifiers (p< 0.005) using HbO signals.

Objective. In this paper, a novel methodology for feature extraction to enhance classification accuracy of functional near-infrared spectroscopy (fNIRS)-based two-class and three-class brain–computer interface (BCI) is presented. Approach. Novel features are extracted using vector-based phase analysis method. Changes in oxygenated Δ H b O and de-oxygenated ( Δ H b R ) haemoglobin are used to calculate four novel features: change in cerebral blood volume ( Δ C B V ), change in cerebral oxygen exchange ( Δ C O E ), vector magnitude ( |L| ) and angle (k ). Δ C B V is the sum and Δ C O E is difference of Δ H b O and Δ H b R , whereas |L| is magnitude and k is angle of vector. fNIRS signals of seven healthy subjects, corresponding to left-hand index finger tapping (LFT), right-hand index finger tapping (RFT) and rest are acquired from motor cortex using multi-channel continuous-wave imaging system. After removing physiological and instrumental noises from the acquired signals, the four novel features are calculated. For validation, conventional temporal, spatial and spatiotemporal features; mean, peak, slope, variance, kurtosis and skewness are also calculated using Δ H b O and Δ H b R . All possible two-feature and three-feature combinations of the novel and conventional features are then used to classify two-class (LFT vs RFT) and three-class (LFT vs RFT vs rest) fNIRS-BCI using linear discriminant analysis. Main results. Results demonstrate that combination of four novel features yields significantly higher average classification accuracies of 98.7 ± 1.0% and 85.4 ± 1.4% as compared to 68.7 ± 6.9% and 53.6 ± 10.6% using conventional features for two-class and three-class problem, respectively. Validation of proposed method on an open access database containing RFT, LFT and dominant side foot tapping tasks for 30 subjects also shows improvement in average classification accuracies for two-class and three-class fNIRS-BCIs. Significance. This study provides a step forward in improving the classification accuracies of state-of-the-art fNIRS-BCIs by showing significant improvement in classification accuracies of two-class and three-class fNIRS-BCIs using novel features extracted by vector-based phase analysis.

With the emerging interest in the ubiquitous sensing field, it has become possible to build assistive technologies for persons during their daily life activities to provide personalized feedback and services. For instance, it is possible to detect an individual’s behavioral pattern (e.g., physical activity, location, and mood) by using sensors embedded in smart-watches and smartphones. The multi-sensor environments also come with some challenges, such as how to fuse and combine different sources of data. In this article, we explore several methods of fusion for multi-representations of data from sensors. Furthermore, multiple representations of sensor data were generated and then fused using data-level, feature-level , and decision-level fusions . The presented methods were evaluated using three publicly available human activity recognition (HAR) datasets. The presented approaches utilize Deep Convolutional Neural Networks (CNNs). A generic architecture for fusion of different sensors is proposed. The proposed method shows promising performance, with the best results reaching an overall accuracy of 98.4% for the Context-Awareness via Wrist-Worn Motion Sensors (HANDY) dataset and 98.7% for the Wireless Sensor Data Mining (WISDM version 1.1) dataset. Both results outperform previous approaches.

With recent advances in the field of sensing, it has become possible to build better assistive technologies. This enables the strengthening of eldercare with regard to daily routines and the provision of personalised care to users. For instance, it is possible to detect a person’s behaviour based on wearable or ambient sensors; however, it is difficult for users to wear devices 24/7, as they would have to be recharged regularly because of their energy consumption. Similarly, although cameras have been widely used as ambient sensors, they carry the risk of breaching users’ privacy. This paper presents a novel sensing approach based on deep learning for human activity recognition using a non-wearable ultra-wideband (UWB) radar sensor. UWB sensors protect privacy better than RGB cameras because they do not collect visual data. In this study, UWB sensors were mounted on a mobile robot to monitor and observe subjects from a specific distance (namely, 1.5–2.0 m). Initially, data were collected in a lab environment for five different human activities. Subsequently, the data were used to train a model using the state-of-the-art deep learning approach, namely long short-term memory (LSTM). Conventional training approaches were also tested to validate the superiority of LSTM. As a UWB sensor collects many data points in a single frame, enhanced discriminant analysis was used to reduce the dimensions of the features through application of principal component analysis to the raw dataset, followed by linear discriminant analysis. The enhanced discriminant features were fed into the LSTMs. Finally, the trained model was tested using new inputs. The proposed LSTM-based activity recognition approach performed better than conventional approaches, with an accuracy of 99.6%. We applied 5-fold cross-validation to test our approach. We also validated our approach on publically available dataset. The proposed method can be applied in many prominent fields, including human–robot interaction for various practical applications, such as mobile robots for eldercare.