Large amounts of electro-oculographic (EOG) data, recorded during electroencephalographic (EEG) measurements, go underutilized. We present an automatic, auto-calibrating algorithm that allows efficient analysis of such data sets. The auto-calibration is based on automatic threshold value estimation. Amplitude threshold values for saccades and blinks are determined based on features in the recorded signal. The performance of the developed algorithm was tested by analyzing 4854 saccades and 213 blinks recorded in two different conditions: a task where the eye movements were controlled (saccade task) and a task with free viewing (multitask). The results were compared with results from a video-oculography (VOG) device and manually scored blinks. The algorithm achieved 93% detection sensitivity for blinks with 4% false positive rate. The detection sensitivity for horizontal saccades was between 98% and 100%, and for oblique saccades between 95% and 100%. The classification sensitivity for horizontal and large oblique saccades (10 deg) was larger than 89%, and for vertical saccades larger than 82%. The duration and peak velocities of the detected horizontal saccades were similar to those in the literature. In the multitask measurement the detection sensitivity for saccades was 97% with a 6% false positive rate. The developed algorithm enables reliable analysis of EOG data recorded both during EEG and as a separate metrics.
We present a computationally light real-time algorithm which automatically detects blinks, saccades, and fixations from electro-oculography (EOG) data and calculates their temporal parameters. The method is probabilistic which allows to consider the uncertainties in the detected events. The method is real-time in the sense that it processes the data sample-by-sample, without a need to process the whole data as a batch. Prior to the actual measurements, a short, unsupervised training period is required. The parameters of the Gaussian likelihoods are learnt using an expectation maximization algorithm. The results show the promise of the method in detecting blinks, saccades, and fixations, with detection rates close to 100 %. The presented method is published as an open source tool.
Human cognitive capabilities are under constant pressure in the modern information society. Cognitive load detection would be beneficial in several applications of human–computer interaction, including attention management and user interface adaptation. However, current research into accurate and real-time biosignal-based cognitive load detection lacks understanding of the optimal and minimal window length in data segmentation which would allow for more timely, continuous state detection. This study presents a comparative analysis of ultra-short (30 s or less) window lengths in cognitive load detection with a wearable device. Heart rate, heart rate variability, galvanic skin response, and skin temperature features are extracted at six different window lengths and used to train an Extreme Gradient Boosting classifier to detect between cognitive load and rest. A 25 s window showed the highest accury (67.6%), which is similar to earlier studies using the same dataset. Overall, model accuracy tended to decrease as the window length decreased, and lowest performance (60.0%) was observed with a 5 s window. The contribution of different physiological features to the classification performance and the most useful features that react in short windows are also discussed. The analysis provides a promising basis for future real-time applications with wearable sensors.
Acute stress and high workload are part of everyday work at safety critical fields (e.g. health care). Adaptive human computer interaction systems could support and guide a nurse or a doctor in these hectic situations. Seamless interaction between human and computer requires accurate cognitive state estimation of the person. Currently studies are mainly focused on detecting between two cognitive states with full set of physiologically inspired features. This study demonstrates a classification of different types of stress during Maastricht Acute Stress Test by using feature combinations from electro-oculogram (EOG) and electrocardiogram (ECG) signals in general and personalized approaches, comparing three different classifiers. The classification is evaluated for features extracted from both signals separately and together, and the most important features are selected and reported. Results indicate that the best performance is achieved when features from both EOG and ECG signals are used, and approximately twenty features from EOG and ECG signals are enough to distinguish the two/three states. A personalized approach together with feature selection and support vector machine classifier achieves accuracies of 96.9% and 86.3% in classifying between two states (relaxation and stress) and three states (relaxation, psycho-social stress, and physiological stress), respectively, which exceed state-of-the-art performance. Thus cognitive state estimation benefits from combining selected eye and heart parameters which suggests a promising basis for real-time estimation in the future.
Easier recognition and enhanced visibility of healthy options supposedly increase healthy choices, but real-world evidence remains scarce. Addressing this knowledge gap, we promoted nutritionally favourable foods in a workplace cafeteria with three choice-architectural strategies—priming posters, point-of-choice nutrition labels, and improved product placement—and assessed their effects on visual attention, food choices, and food consumption. Additionally, we developed a method for analysing real-world eye-tracking data. The study followed a pretest–posttest design whereby control and intervention condition lasted five days each. We monitored visual attention (i.e., total number and duration of fixations) and food choices with eye tracking, interviewed customers about perceived influences on food choices, and measured cafeteria-level food consumption (g). Individual-level data represents 22 control and 19 intervention participants recruited at the cafeteria entrance. Cafeteria-level data represents food consumption during the trial (556/589 meals sold). Results indicated that the posters and labels captured participants’ visual attention (~13% of fixations on defined areas of interest before food choices), but the intervention had insignificant effects on visual attention to foods, on food choices, and on food consumption. Interviews revealed 17 perceived influences on food choices, the most common being sensory appeal, healthiness, and familiarity. To conclude, the intervention appeared capable of attracting visual attention, yet ineffective in increasing healthier eating. The developed method enabled a rigorous analysis of visual attention and food choices in a natural choice setting. We discuss ways to boost the impact of the intervention on behaviour, considering target groups’ motives. The work contributes with a unique, mixed-methods approach and a real-world setting that enabled a multi-dimensional effects evaluation with high external validity.
Dietary components may affect brain function and influence behaviour by inducing the synthesis of neurotransmitters. The aim of the present study was to examine the influence of consumption of a whey protein-containing breakfast drink v. a carbohydrate drink v. control on subjective and physiological responses to mental workload in simulated work. In a randomised cross-over design, ten healthy subjects (seven women, median age 26 years, median BMI 23 kg/m2) participated in a single-blinded, placebo-controlled study. The subjects performed demanding work-like tasks after having a breakfast drink high in protein (HP) or high in carbohydrate (HC) or a control drink on separate sessions. Subjective states were assessed using the NASA Task Load Index (NASA-TLX), the Karolinska sleepiness scale (KSS) and the modified Profile of Mood States. Heart rate was recorded during task performance. The ratio of plasma tryptophan (Trp) to the sum of the other large neutral amino acids (LNAA) and salivary cortisol were also analysed. The plasma Trp:LNAA ratio was 30 % higher after the test drinks HP (median 0·13 (μmol/l)/(μmol/l)) and HC (median 0·13 (μmol/l)/(μmol/l)) than after the control drink (median 0·10 (μmol/l)/(μmol/l)). The increase in heart rate was smaller after the HP (median 2·7 beats/min) and HC (median 1·9 beats/min) drinks when compared with the control drink (median 7·2 beats/min) during task performance. Subjective sleepiness was reduced more after the HC drink (median KSS − 1·5) than after the control drink (median KSS − 0·5). There were no significant differences between the breakfast types in the NASA-TLX index, cortisol levels or task performance. We conclude that a breakfast drink high in whey protein or carbohydrates may improve coping with mental tasks in healthy subjects.