Brain-Computer Interfaces (BCIs) translate neuronal information into commands to control external software or hardware, which can improve the quality of life for both healthy and disabled individuals. Here, a multi-modal BCI which combines motor imagery (MI) and steady-state visual evoked potential (SSVEP) is proposed to achieve stable control of a quadcopter in three-dimensional physical space. The complete information common spatial pattern (CICSP) method is used to extract two MI features to control the quadcopter to fly left-forward and right-forward, and canonical correlation analysis (CCA) is employed to perform the SSVEP classification for rise and fall. Eye blinking is designed to switch these two modes while hovering. Real-time feedback is provided to subjects by a global camera. Two flight tasks were conducted in physical space in order to certify the reliability of the BCI system. Subjects were asked to control the quadcopter to fly forward along the zig-zag pattern to pass through a gate in the relatively simple task. For the other complex task, the quadcopter was controlled to pass through two gates successively according to an S-shaped route. The performance of the BCI system is quantified using suitable metrics and subjects are able to acquire 86.5% accuracy for the complicated flight task. It is demonstrated that the multi-modal BCI has the ability to increase the accuracy rate, reduce the task burden, and improve the performance of the BCI system in the real world.

Accurate functional diagnosis of coronary stenosis is vital for decision making in coronary revascularization. With recent advances in computational fluid dynamics (CFD), fractional flow reserve (FFR) can be derived non-invasively from coronary computed tomography angiography images (FFRCT) for functional measurement of stenosis. However, the accuracy of FFRCT is limited due to the approximate modeling approach of maximal hyperemia conditions. To overcome this problem, a new CFD based non-invasive method is proposed. Instead of modeling maximal hyperemia condition, a series of boundary conditions are specified and those simulated results are combined to provide a pressure-flow curve for a stenosis. Then, functional diagnosis of stenosis is assessed based on parameters derived from the obtained pressure-flow curve. The proposed method is applied to both idealized and patient-specific models, and validated with invasive FFR in six patients. Results show that additional hemodynamic information about the flow resistances of a stenosis is provided, which cannot be directly obtained from anatomy information. Parameters derived from the simulated pressure-flow curve show a linear and significant correlations with invasive FFR (r > 0.95, P < 0.05). The proposed method can assess flow resistances by the pressure-flow curve derived parameters without modeling of maximal hyperemia condition, which is a new promising approach for non-invasive functional assessment of coronary stenosis.

Graph neural networks (GNNs) have demonstrated efficient processing of graph-structured data, making them a promising method for electroencephalogram (EEG) emotion recognition. However, due to dynamic functional connectivity and nonlinear relationships between brain regions, representing EEG as graph data remains a great challenge. To solve this problem, we proposed a multi-domain based graph representation learning (MD $^{2}$ GRL) framework to model EEG signals as graph data. Specifically, MD $^{2}$ GRL leverages gated recurrent units (GRU) and power spectral density (PSD) to construct node features of two subgraphs. Subsequently, the self-attention mechanism is adopted to learn the similarity matrix between nodes and fuse it with the intrinsic spatial matrix of EEG to compute the corresponding adjacency matrix. In addition, we introduced a learnable soft thresholding operator to sparsify the adjacency matrix to reduce noise in the graph structure. In the downstream task, we designed a dual-branch GNN and incorporated spatial asymmetry for graph coarsening. We conducted experiments using the publicly available datasets SEED and DEAP, separately for subject-dependent and subject-independent, to evaluate the performance of our model in emotion classification. Experimental results demonstrated that our method achieved state-of-the-art (SOTA) classification performance in both subject-dependent and subject-independent experiments. Furthermore, the visualization analysis of the learned graph structure reveals EEG channel connections that are significantly related to emotion and suppress irrelevant noise. These findings are consistent with established neuroscience research and demonstrate the potential of our approach in comprehending the neural underpinnings of emotion.

Brain–computer interface (BCI) has developed rapidly over the past two decades, mainly due to advancements in machine learning. Subjects must learn to modulate their brain activities to ensure a successful BCI. Feedback training is a practical approach to this learning process; however, the commonly used classifier-dependent approaches have inherent limitations such as the need for calibration and a lack of continuous feedback over long periods of time. This paper proposes an online data visualization feedback protocol that intuitively reflects the EEG distribution in Riemannian geometry in real time. Rather than learning a hyperplane, the Riemannian geometry formulation allows iterative learning of prototypical covariance matrices that are translated into visualized feedback through diffusion map process. Ten subjects were recruited for MI-BCI (motor imagery-BCI) training experiments. The subjects learned to modulate their sensorimotor rhythm to centralize the points within one category and to separate points belonging to different categories. The results show favorable overall training effects in terms of the class distinctiveness and EEG feature discriminancy over a 3-day training with 30% learners. A steadily increased class distinctiveness in the last three sessions suggests that the advanced training protocol is effective. The optimal frequency band was consistent during the 3-day training, and the difference between subjects with good or low MI-BCI performance could be clearly observed. We believe that the proposed feedback protocol has promising application prospect.

Motor imagery (MI) electroencephalography (EEG) is natural and comfortable for controllers, and has become a research hotspot in the field of the brain–computer interface (BCI). Exploring the inter-subject MI-BCI performance variation is one of the fundamental problems in MI-BCI application. EEG microstates with high spatiotemporal resolution and multichannel information can represent brain cognitive function. In this paper, four EEG microstates (MS1, MS2, MS3, MS4) were used in the analysis of the differences in the subjects’ MI-BCI performance, and the four microstate feature parameters (the mean duration, the occurrences per second, the time coverage ratio, and the transition probability) were calculated. The correlation between the resting-state EEG microstate feature parameters and the subjects’ MI-BCI performance was measured. Based on the negative correlation of the occurrence of MS1 and the positive correlation of the mean duration of MS3, a resting-state microstate predictor was proposed. Twenty-eight subjects were recruited to participate in our MI experiments to assess the performance of our resting-state microstate predictor. The experimental results show that the average area under curve (AUC) value of our resting-state microstate predictor was 0.83, and increased by 17.9% compared with the spectral entropy predictor, representing that the microstate feature parameters can better fit the subjects’ MI-BCI performance than spectral entropy predictor. Moreover, the AUC of microstate predictor is higher than that of spectral entropy predictor at both the single-session level and average level. Overall, our resting-state microstate predictor can help MI-BCI researchers better select subjects, save time, and promote MI-BCI development.

Steady-State Visual Evoked Potentials (SSVEPs) are widely used in spatial selective attention. In this process the two kinds of visual simulators, Light Emitting Diode (LED) and Liquid Crystal Display (LCD), are commonly used to evoke SSVEP. In this paper, the differences of SSVEP caused by these two stimulators in the study of spatial selective attention were investigated. Results indicated that LED could stimulate strong SSVEP component on occipital lobe, and the frequency of evoked SSVEP had high precision and wide range as compared to LCD. Moreover a significant difference between noticed and unnoticed frequencies in spectrum was observed whereas in LCD mode this difference was limited and selectable frequencies were also limited. Our experimental finding suggested that average classification accuracies among all the test subjects in our experiments were 0.938 and 0.853 in LED and LCD mode, respectively. These results indicate that LED simulator is appropriate for evoking the SSVEP for the study of spatial selective attention.