In this study, we implemented a new home appliance control system by combining electroencephalography (EEG)-based brain-computer interface (BCI), augmented reality (AR), and internet of things (IoT) technologies. We adopted a steady-state visual evoked potential (SSVEP)-based BCI paradigm for the implementation of a fast and robust BCI system. In the offline experiment, we compared the performances of three BCIs adopting different types of visual stimuli in an AR environment to determine the optimal visual stimulus. In the online experiment, we evaluated the feasibility of the proposed smart home system using the optimal stimulus by controlling three home appliances in real time. The visual stimuli were presented on a see-through head-mounted display (HMD), while the recorded brain activity was analyzed to classify the control command, and the home appliances were controlled through IoT. In the offline experiment, a grow/shrink stimulus (GSS) consisting of a star-shaped flickering object of varying size was selected as the optimal stimulus, eliciting SSVEP responses more effectively than the other options. In the online experiment, all users could turn the BCI-based control system on/off whenever they wanted using the eye-blinking-based electrooculogram (EOG) switch, and could successfully perform all the designated control tasks without difficulty. The average classification accuracy of the SSVEP-BCI-based control system was 92.8%, with an information transfer rate (ITR) of 37.4 bits/min. The proposed system exhibited an excellent performance, surpassing the best results reported in previous studies regarding external device control based on BCI using an HMD as rendering device.
Owing to the increased public interest in passive brain–computer interface (pBCI) applications, many wearable devices for capturing electroencephalogram (EEG) signals in daily life have recently been released on the market. However, there exists no well-established criterion to determine the electrode configuration for such devices. Herein, an overall procedure is proposed to determine the optimal electrode configurations of wearable EEG devices that yield the optimal performance for intended pBCI applications. We utilized two EEG datasets recorded in different experiments designed to modulate emotional or attentional states. Emotion-specialized EEG headsets were designed to maximize the accuracy of classification of different emotional states using the emotion-associated EEG dataset, and attention-specialized EEG headsets were designed to maximize the temporal correlation between the EEG index and the behavioral attention index. General purpose electrode configurations were designed to maximize the overall performance in both applications for different numbers of electrodes (2, 4, 6, and 8). The performance was then compared with that of existing wearable EEG devices. Simulations indicated that the proposed electrode configurations allowed for more accurate estimation of the users’ emotional and attentional states than the conventional electrode configurations, suggesting that wearable EEG devices should be designed according to the well-established EEG datasets associated with the target pBCI applications.
9 December 2022 in IEEE Transactions on Neural Systems and Rehabilitation Engineering
Over the past decades, brain-computer interfaces (BCIs) have been developed to provide individuals with an alternative communication channel toward external environment. Although the primary target users of BCI technologies include the disabled or the elderly, most newly developed BCI applications have been tested with young, healthy people. In the present study, we developed an online home appliance control system using a steady-state visual evoked potential (SSVEP)-based BCI with visual stimulation presented in an augmented reality (AR) environment and electrooculogram (EOG)-based eye tracker. The performance and usability of the system were evaluated for individuals aged over 65. The participants turned on the AR-based home automation system using an eye-blink-based switch, and selected devices to control with three different methods depending on the user’s preference. In the online experiment, all 13 participants successfully completed the designated tasks to control five home appliances using the proposed system, and the system usability scale exceeded 70. Furthermore, the BCI performance of the proposed online home appliance control system surpassed the best results of previously reported BCI systems for the elderly.
1 July 2019 in Computational Intelligence and Neuroscience
Recent studies on brain-computer interfaces (BCIs) based on the steady-state visual evoked potential (SSVEP) have demonstrated their use to control objects or generate commands in virtual reality (VR) environments. However, most SSVEP-based BCI studies performed in VR environments have adopted visual stimuli that are typically used in conventional LCD environments without considering the differences in the rendering devices (head-mounted displays (HMDs) used in the VR environments). The proximity between the visual stimuli and the eyes in HMDs can readily cause eyestrain, degrading the overall performance of SSVEP-based BCIs. Therefore, in the present study, we have tested two different types of visual stimuli—pattern-reversal checkerboard stimulus (PRCS) and grow/shrink stimulus (GSS)—on young healthy participants wearing HMDs. Preliminary experiments were conducted to investigate the visual comfort of each participant during the presentation of the visual stimuli. In subsequent online avatar control experiments, we observed considerable differences in the classification accuracy of individual participants based on the type of visual stimuli used to elicit SSVEP. Interestingly, there was a close relationship between the subjective visual comfort score and the online performance of the SSVEP-based BCI: most participants showed better classification accuracy under visual stimulus they were more comfortable with. Our experimental results suggest the importance of an appropriate visual stimulus to enhance the overall performance of the SSVEP-based BCIs in VR environments. In addition, it is expected that the appropriate visual stimulus for a certain user might be readily selected by surveying the user’s visual comfort for different visual stimuli, without the need for the actual BCI experiments.
Neurocinematics is an emerging discipline in neuroscience, which aims to provide new filmmaking techniques by analyzing the brain activities of a group of audiences. Several neurocinematics studies attempted to track temporal changes in mental states during movie screening; however, it is still needed to develop efficient and robust electroencephalography (EEG) features for tracking brain states precisely over a long period. This study proposes a novel method for estimating emotional arousal changes in a group of individuals during movie screening by employing steady-state visual evoked potential (SSVEP), which is a widely used EEG response elicited by the presentation of periodic visual stimuli. Previous studies have reported that the emotional arousal of each individual modulates the strength of SSVEP responses. Based on this phenomenon, movie clips were superimposed on a background, eliciting an SSVEP response with a specific frequency. Two emotionally arousing movie clips were presented to six healthy male participants, while EEG signals were recorded from the occipital channels. We then investigated whether the movie scenes that elicited higher SSVEP responses coincided well with those rated as the most impressive scenes by 37 viewers in a separate experimental session. Our results showed that the SSVEP response averaged across six participants could accurately predict the overall impressiveness of each movie, evaluated with a much larger group of individuals.
Controlling the in-car environment, including temperature and ventilation, is necessary for a comfortable driving experience. However, it often distracts the driver’s attention, potentially causing critical car accidents. In the present study, we implemented an in-car environment control system utilizing a brain-computer interface (BCI) based on steady-state visual evoked potential (SSVEP). In the experiment, four visual stimuli were displayed on a laboratory-made head-up display (HUD). This allowed the participants to control the in-car environment by simply staring at a target visual stimulus, i.e., without pressing a button or averting their eyes from the front. The driving performances in two realistic driving tests—obstacle avoidance and car-following tests—were then compared between the manual control condition and SSVEP-BCI control condition using a driving simulator. In the obstacle avoidance driving test, where participants needed to stop the car when obstacles suddenly appeared, the participants showed significantly shorter response time (1.42 ± 0.26 s) in the SSVEP-BCI control condition than in the manual control condition (1.79 ± 0.27 s). No-response rate, defined as the ratio of obstacles that the participants did not react to, was also significantly lower in the SSVEP-BCI control condition (4.6 ± 14.7%) than in the manual control condition (20.5 ± 25.2%). In the car-following driving test, where the participants were instructed to follow a preceding car that runs at a sinusoidally changing speed, the participants showed significantly lower speed difference with the preceding car in the SSVEP-BCI control condition (15.65 ± 7.04 km/h) than in the manual control condition (19.54 ± 11.51 km/h). The in-car environment control system using SSVEP-based BCI showed a possibility that might contribute to safer driving by keeping the driver’s focus on the front and thereby enhancing the overall driving performance.