Conventional methods of motor imagery brain computer interfaces (MI-BCIs) suffer from the limited number of samples and simplified features, so as to produce poor performances with spatial-frequency features and shallow classifiers. Alternatively, this paper applies a deep recurrent neural network (RNN) with a sliding window cropping strategy (SWCS) to signal classification of MI-BCIs. The spatial-frequency features are first extracted by the filter bank common spatial pattern (FB-CSP) algorithm, and such features are cropped by the SWCS into time slices. By extracting spatial-frequency-sequential relationships, the cropped time slices are then fed into RNN for classification. In order to overcome the memory distractions, the commonly used gated recurrent unit (GRU) and long-short term memory (LSTM) unit are applied to the RNN architecture, and experimental results are used to determine which unit is more suitable for processing EEG signals. Experimental results on common BCI benchmark datasets show that the spatial-frequency-sequential relationships outperform all other competing spatial-frequency methods. In particular, the proposed GRU-RNN architecture achieves the lowest misclassification rates on all BCI benchmark datasets. By introducing spatial-frequency-sequential relationships with cropping time slice samples, the proposed method gives a novel way to construct and model high accuracy and robustness MI-BCIs based on limited trials of EEG signals.

Conventional Chinese calligraphy robots often suffer from the limited sizes of predefined font databases, which prevent the robots from writing new characters. This paper presents a robotic handwriting system to address such limitations, which extracts Chinese characters from textbooks and uses a robot’s manipulator to write the characters in a different style. The key technologies of the proposed approach include the following: 1) automatically decomposing Chinese characters into strokes using Harris corner detection technology and 2) matching the decomposed strokes to robotic writing trajectories learned from human gestures. Briefly, the system first decomposes a given Chinese character into a set of strokes and obtains the stroke trajectory writing ability by following the gestures performed by a human demonstrator. Then, it applies a stroke classification method that recognizes the decomposed strokes as robotic writing trajectories. Finally, the robot arm is driven to follow the trajectories and thus write the Chinese character. Seven common Chinese characters have been used in an experiment for system validation and evaluation. The experimental results demonstrate the power of the proposed system, given that the robot successfully wrote all the testing characters in the given Chinese calligraphic style.

Action observation (AO) generates event-related desynchronization (ERD) suppressions in the human brain by activating partial regions of the human mirror neuron system (hMNS). The activation of the hMNS response to AO remains controversial for several reasons. Therefore, this study investigated the activation of the hMNS response to a speed factor of AO by controlling the movement speed modes of a humanoid robot's arm movements. Since hMNS activation is reflected by ERD suppressions, electroencephalography (EEG) with BCI analysis methods for ERD suppressions were used as the recording and analysis modalities. Six healthy individuals were asked to participate in experiments comprising five different conditions. Four incremental-speed AO tasks and a motor imagery (MI) task involving imaging of the same movement were presented to the individuals. Occipital and sensorimotor regions were selected for BCI analyses. The experimental results showed that hMNS activation was higher in the occipital region but more robust in the sensorimotor region. Since the attended information impacts the activations of the hMNS during AO, the pattern of hMNS activations first rises and subsequently falls to a stable level during incremental-speed modes of AO. The discipline curves suggested that a moderate speed within a decent inter-stimulus interval (ISI) range produced the highest hMNS activations. Since a brain computer/machine interface (BCI) builds a path-way between human and computer/mahcine, the discipline curves will help to construct BCIs made by patterns of action observation (AO-BCI). Furthermore, a new method for constructing non-invasive brain machine brain interfaces (BMBIs) with moderate AO-BCI and motor imagery BCI (MI-BCI) was inspired by this paper.

To compare the cognitive effects of guqin (the oldest Chinese instrument) music and piano music. Behavioral and event-related potential (ERP) data in a standard two-stimulus auditory oddball task were recorded and analyzed. This study replicated the previous results of culture-familiar music effect on Chinese subjects: the greater P300 amplitude in frontal areas in a culture-familiar music environment. At the same time, the difference between guqin music and piano music was observed in N1 and later positive complex (LPC: including P300 and P500): a relatively higher participation of right anterior-temporal areas in Chinese subjects. The results suggest that the special features of ERP responses to guqin music are the outcome of Chinese tonal language environments given the similarity between Guqin’s tones and Mandarin lexical tones.

Electroencephalography (EEG) signals may provide abundant information reflecting the developmental changes in brain status. It usually takes a long time to finally judge whether a brain is dead, so an effective pre-test of brain states method is needed. In this paper, we present a hybrid processing pipeline to differentiate brain death and coma patients based on canonical correlation analysis (CCA) of power spectral density, complexity features, and feature fusion for group analysis. In addition, time-varying power spectrum and complexity were observed based on the analysis of individual patients, which can be used to monitor the change of brain status over time. Results showed three major differences between brain death and coma groups of EEG signal: slowing, increased complexity, and the improvement on classification accuracy with feature fusion. To the best of our knowledge, this is the first scheme for joint general analysis and time-varying state monitoring. Delta-band relative power spectrum density and permutation entropy could effectively be regarded as potential features of discrimination analysis on brain death and coma patients.