This work considers the problem of utilizing electroencephalographic signals for use in systems designed for monitoring and enhancing the performance of aircraft pilots. Systems with such capabilities are generally referred to as cognitive cockpits. This article provides a description of the potential that is carried by such systems, especially in terms of increasing flight safety. Additionally, a neuropsychological background of the problem is presented. Conducted research was focused mainly on the problem of discrimination between states of brain activity related to idle but focused anticipation of visual cue and reaction to it. Especially, a problem of selecting a proper classification algorithm for such problems is being examined. For that purpose an experiment involving subjects was planned and conducted. Experimental electroencephalographic data was acquired using an Emotiv EPOC+ headset. Proposed methodology involved use of a popular method in biomedical signal processing, the Common Spatial Pattern, extraction of bandpower features, and an extensive test of different classification algorithms, such as Linear Discriminant Analysis, -nearest neighbors, and Support Vector Machines with linear and radial basis function kernels, Random Forests, and Artificial Neural Networks.
The main hypothesis of this work is that the time of delay in reaction to an unexpected event can be predicted on the basis of the brain activity recorded prior to that event. Such mental activity can be represented by electroencephalographic data. To test this hypothesis, we conducted a novel experiment involving 19 participants that took part in a 2-h long session of simulated aircraft flights. An EEG signal processing pipeline is proposed that consists of signal preprocessing, extracting bandpass features, and using regression to predict the reaction times. The prediction algorithms that are used in this study are the Least Absolute Shrinkage Operator and its Least Angle Regression modification, as well as Kernel Ridge and Radial Basis Support Vector Machine regression. The average Mean Absolute Error obtained across the 19 subjects was 114 ms. The present study demonstrates, for the first time, that it is possible to predict reaction times on the basis of EEG data. The presented solution can serve as a foundation for a system that can, in the future, increase the safety of air traffic.
The purpose of this research is to examine and assess the relation between a pilot’s concentration and reaction time with specific brain activity during short-haul flights. Participants took part in one-hour long flight sessions performed on the FNPT II class flight simulator. Subjects were instructed to respond to unexpected events that occurred during the flight. The brainwaves of each participant were recorded with the Emotiv EPOC+ Scientific Contextual EEG device. The majority of participants showed a statistically significant, positive correlation between Theta Power in the frontal lobe and response time. Additionally, most subjects exhibited statistically significant, positive correlations between band-power and reaction times in the Theta range for the temporal and parietal lobes. Statistically significant event-related changes (ERC) were observed for the majority of subjects in the frontal lobe for Theta frequencies, Beta waves in the frontal lobe and in all lobes for the Gamma band. Notably, significant ERC was also observed for Theta and Beta frequencies in the temporal and occipital Lobes, Alpha waves in the frontal, parietal and occipital lobes for most participants. A difference in brain activity patterns was observed, depending on the performance in time-restricted tasks.
The purpose of the research was to examine and assess the relation between the pilot’s concentration and reaction time with specific brain activity during short-haul flights. In order to obtain this task, participants took part in 1-hour long flight sessions performed on FNPT II class flight simulator. During the flight auto–pilot was activated and subjects were instructed to give response to unexpected events that were occurring during the flight. Brainwaves of each participant were recorded with Emotiv EPOC+ Scientific Contextual EEG device. Statistical analyses of the results were presented in the article.