This paper provides a brief survey of recent developments on the use of electroencephalogram (EEG) sensors for detecting mental fatigue (MF) in human operators during tasks involving human–machine interaction. This research topic has received much attention since there is a consensus among experts on the increasing relation between human failure and accidents in safety-critical tasks. MF is one of the most influential aspects leading to human failure and the most reliable way to assess it is using operator’s physiological data, especially EEG. In the past few decades, hundreds of publications have explored the use of EEG alone or together with other objective and subjective measures for assessing MF, drowsiness, and tiredness in human operators. With recent improvements in data preprocessing, feature extraction, and classification algorithms, the monitoring and mitigation of MF in real time has become a reality. This trend is mainly due to the increasing use of machine learning techniques. This paper provides a comprehensive look at the current state of the art in the field of MF detection using EEG, identifying the currently used technique, algorithms, and methods and possible trends and promising areas for further research. The paper is concluded by suggesting a kernel partial least squares discrete-output linear regression based model as an all-around good option for an MF assessment system.
Human-related issues are currently the most significant factor in maritime causalities, especially in demanding operations that require coordination between two or more vessels and/or other maritime structures. Some of these human-related issues include incorrect, incomplete, or nonexistent following of procedures; lack of situational awareness; and physical or mental fatigue. Among these, mental fatigue is especially dangerous, due to its capacity to reduce reaction time, interfere in the decision-making process, and affect situational awareness. Mental fatigue is also especially hard to identify and quantify. Self-assessment of mental fatigue may not be reliable and few studies have assessed mental fatigue in maritime operations, especially in real time. In this work we propose an integrated sensor fusion system for mental fatigue assessment using physiological sensors and convolutional neural networks. We show, by using a simulated navigation experiment, how data from different sensors can be fused into a robust mental fatigue assessment tool, capable of achieving up to detection accuracy for single-subject classification. Additionally, the use of different sensors seems to favor the representation of the transition between mental fatigue states.
Human-related issues play an important role in accidents and causalities in demanding maritime operations. The industry lacks an approach capable of preventively assessing maritime operators’ mental fatigue and awareness levels before accidents happen. Aiming to reduce intrusiveness, we focused on improving the mental fatigue assessment capabilities of a combination of electroencephalogram and electrocardiogram sensors by investigating the optimization of convolutional neural networks by Bayesian optimization with Gaussian process. We proposed a mapping function to optimize the network structure without the need for a tree-like structure to define the domain of variables for the optimization process. We applied the proposed approach in a simulated vessel piloting task. Even though the mental fatigue assessment for the cross-subject case is a complex classification task, the trained convolutional neural network could achieve good generalization performance (97.6% test accuracy). Finally, we also proposed a method to improve the depiction of the mental fatigue build up process. The framework presented in this work can contribute for reducing accident risk in maritime operations by improving the accuracy and assessment quality of neural network-based mental fatigue assessment tools.
With the increasing demand for renewable energy sources in the past years, the interest in expanding the use of wind energy has grown. The next frontier in this expansion process is the use of floating wind turbines offshore. One of the main factors dictating the economic feasibility of such wind turbines is the complexity of their installation process. The dimensions of modern