Adaptive Automation (AA) is a promising approach to keep the task workload demand within appropriate levels in order to avoid both the under- and overload conditions, hence enhancing the overall performance and safety of the human-machine system. The main issue on the use of AA is how to trigger the AA solutions without affecting the operative task. In this regard, passive Brain-Computer Interface (pBCI) systems are a good candidate to activate automation, since they are able to gather information about the covert behaviour (e.g. mental workload) of a subject by analysing its neurophysiological signals (i.e. brain activity), and without interfering with the ongoing operational activity. We proposed a pBCI system able to trigger AA solutions integrated in a realistic Air Traffic Management (ATM) research simulator developed and hosted at ENAC (École Nationale de l’Aviation Civile of Toulouse, France). Twelve Air Traffic Controller (ATCO) students have been involved in the experiment and they have been asked to perform ATM scenarios with and without the support of the AA solutions. Results demonstrated the effectiveness of the proposed pBCI system, since it enabled the AA mostly during the high-demanding conditions (i.e. overload situations) inducing a reduction of the mental workload under which the ATCOs were operating. On the contrary, as desired, the AA was not activated when workload level was under the threshold, to prevent too low demanding conditions that could bring the operator’s workload level towards potentially dangerous conditions of underload.

Goal: This minireview aims to highlight recent important aspects to consider and evaluate when passive brain-computer interface (pBCI) systems would be developed and used in operational environments, and remarks future directions of their applications. Methods: Electroencephalography (EEG) based pBCI has become an important tool for real-time analysis of brain activity since it could potentially provide covertly-without distracting the user from the main task-and objectively-not affected by the subjective judgment of an observer or the user itself-information about the operator cognitive state. Results: Different examples of pBCI applications in operational environments and new adaptive interface solutions have been presented and described. In addition, a general overview regarding the correct use of machine learning techniques (e.g., which algorithm to use, common pitfalls to avoid, etc.) in the pBCI field has been provided. Conclusion: Despite recent innovations on algorithms and neurotechnology, pBCI systems are not completely ready to enter the market yet, mainly due to limitations of the EEG electrodes technology, and algorithms reliability and capability in real settings. Significance: High complexity and safety critical systems (e.g., airplanes, ATM interfaces) should adapt their behaviors and functionality accordingly to the user' actual mental state. Thus, technologies (i.e., pBCIs) able to measure in real time the user's mental states would result very useful in such “high risk” environments to enhance human machine interaction, and so increase the overall safety.

The directed transfer function (DTF) and the partial directed coherence (PDC) are frequency-domain estimators that are able to describe interactions between cortical areas in terms of the concept of Granger causality. However, the classical estimation of these methods is based on the multivariate autoregressive modelling (MVAR) of time series, which requires the stationarity of the signals. In this way, transient pathways of information transfer remains hidden. The objective of this study is to test a time-varying multivariate method for the estimation of rapidly changing connectivity relationships between cortical areas of the human brain, based on DTF/PDC and on the use of adaptive MVAR modelling (AMVAR) and to apply it to a set of real high resolution EEG data. This approach will allow the observation of rapidly changing influences between the cortical areas during the execution of a task. The simulation results indicated that time-varying DTF and PDC are able to estimate correctly the imposed connectivity patterns under reasonable operative conditions of signal-to-noise ratio (SNR) ad number of trials. An SNR of Ave and a number of trials of at least 20 provide a good accuracy in the estimation. After testing the method by the simulation study, we provide an application to the cortical estimations obtained from high resolution EEG data recorded from a group of healthy subject during a combined foot-lips movement and present the time-varying connectivity patterns resulting from the application of both DTF and PDC. Two different cortical networks were detected with the proposed methods, one constant across the task and the other evolving during the preparation of the joint movement.

Several models defining different types of cognitive human behaviour are available. For this work, we have selected the Skill, Rule and Knowledge (SRK) model proposed by Rasmussen in 1983. This model is currently broadly used in safety critical domains, such as the aviation. Nowadays, there are no tools able to assess at which level of cognitive control the operator is dealing with the considered task, that is if he/she is performing the task as an automated routine (skill level), as procedures-based activity (rule level), or as a problem-solving process (knowledge level). Several studies tried to model the SRK behaviours from a Human Factor perspective. Despite such studies, there are no evidences in which such behaviours have been evaluated from a neurophysiological point of view, for example, by considering brain activity variations across the different SRK levels. Therefore, the proposed study aimed to investigate the use of neurophysiological signals to assess the cognitive control behaviours accordingly to the SRK taxonomy. The results of the study, performed on 37 professional Air Traffic Controllers, demonstrated that specific brain features could characterize and discriminate the different SRK levels, therefore enabling an objective assessment of the degree of cognitive control behaviours in realistic settings.

We investigated brain activity during the observation of TV commercials by tracking the cortical activity and the functional connectivity changes in normal subjects. The aim was to elucidate if the TV commercials that were remembered by the subjects several days after their first observation elicited particular brain activity and connectivity compared with those generated during the observation of TV commercials that were quickly forgotten. High-resolution electroencephalogram (EEG) recordings were performed in a group of healthy subjects and the cortical activity during the observation of TV commercials was evaluated in several regions of interest coincident with the Brodmann areas (BAs). The patterns of cortical connectivity were obtained in the four principal frequency bands, Theta (3-7 Hz), Alpha (8-12 Hz), Beta (13-30 Hz), Gamma (30-40 Hz) and the directed influences between any given pair of the estimated cortical signals were evaluated by use of a multivariate spectral technique known as partial directed coherence. The topology of the cortical networks has been identified with tools derived from graph theory. Results suggest that the cortical activity and connectivity elicited by the viewing of the TV commercials that were remembered by the experimental subjects are markedly different from the brain activity elicited during the observation of the TV commercials that were forgotten. In particular, during the observation of the TV commercials that were remembered, the amount of cortical spectral activity from the frontal areas (BA 8 and 9) and from the parietal areas (BA 5, 7, and 40) is higher compared with the activity elicited by the observation of TV commercials that were forgotten. In addition, network analysis suggests a clear role of the parietal areas as a target of the incoming flow of information from all the other parts of the cortex during the observation of TV commercials that have been remembered. The techniques presented here shed new light on all the cortical networks and their behavior during the memorization of TV commercials. Such techniques could also be relevant in neuroeconomics and neuromarketing for the investigation of the neural substrates subserving other decision-making and recognition tasks.