Experiencing frustration while driving can harm cognitive processing, result in aggressive behavior and hence negatively influence driving performance and traffic safety. Being able to automatically detect frustration would allow adaptive driver assistance and automation systems to adequately react to a driver’s frustration and mitigate potential negative consequences. To identify reliable and valid indicators of driver’s frustration, we conducted two driving simulator experiments. In the first experiment, we aimed to reveal facial expressions that indicate frustration in continuous video recordings of the driver’s face taken while driving highly realistic simulator scenarios in which frustrated or non-frustrated emotional states were experienced. An automated analysis of facial expressions combined with multivariate logistic regression classification revealed that frustrated time intervals can be discriminated from non-frustrated ones with accuracy of 62.0% (mean over 30 participants). A further analysis of the facial expressions revealed that frustrated drivers tend to activate muscles in the mouth region (chin raiser, lip pucker, lip pressor). In the second experiment, we measured cortical activation with almost whole-head functional near-infrared spectroscopy (fNIRS) while participants experienced frustrating and non-frustrating driving simulator scenarios. Multivariate logistic regression applied to the fNIRS measurements allowed us to discriminate between frustrated and non-frustrated driving intervals with higher accuracy of 78.1% (mean over 12 participants). Frustrated driving intervals were indicated by increased activation in the inferior frontal, putative premotor and occipito-temporal cortices. Our results show that facial and cortical markers of frustration can be informative for time resolved driver state identification in complex realistic driving situations. The markers derived here can potentially be used as an input for future adaptive driver assistance and automation systems that detect driver frustration and adaptively react to mitigate it.

Motion sickness (MS) is a syndrome associated with symptoms like nausea, dizziness, and other forms of physical discomfort. Automated vehicles (AVs) are potent at inducing MS because users are not adapted to this novel form of transportation, are provided with less information about the own vehicle’s trajectory, and are likely to engage in non-driving related tasks. Because individuals with an especially high MS susceptibility could be limited in their use of AVs, the demand for MS mitigation strategies is high. Passenger anticipation has been shown to have a modulating effect on symptoms, thus mitigating MS. To find an effective mitigation strategy, the prototype of a human–machine interface (HMI) that presents anticipatory ambient light cues for the AV’s next turn to the passenger was evaluated. In a realistic driving study with participants (N = 16) in an AV on a test track, an MS mitigation effect was evaluated based on the MS increase during the trial. An MS mitigation effect was found within a highly susceptible subsample through the presentation of anticipatory ambient light cues. The HMI prototype was proven to be effective regarding highly susceptible users. Future iterations could alleviate MS in field settings and improve the acceptance of AVs.

Driving is a complex task concurrently drawing on multiple cognitive resources. Yet, there is a lack of studies investigating interactions at the brain-level among different driving subtasks in dual-tasking. This study investigates how visuospatial attentional demands related to increased driving difficulty interacts with different working memory load (WML) levels at the brain level. Using multichannel whole-head high density functional near-infrared spectroscopy (fNIRS) brain activation measurements, we aimed to predict driving difficulty level, both separate for each WML level and with a combined model. Participants drove for approximately 60 min on a highway with concurrent traffic in a virtual reality driving simulator. In half of the time, the course led through a construction site with reduced lane width, increasing visuospatial attentional demands. Concurrently, participants performed a modified version of the n-back task with five different WML levels (from 0-back up to 4-back), forcing them to continuously update, memorize, and recall the sequence of the previous ‘n’ speed signs and adjust their speed accordingly. Using multivariate logistic ridge regression, we were able to correctly predict driving difficulty in 75.0% of the signal samples (1.955 Hz sampling rate) across 15 participants in an out-of-sample cross-validation of classifiers trained on fNIRS data separately for each WML level. There was a significant effect of the WML level on the driving difficulty prediction accuracies [range 62.2–87.1%; χ²(4) = 19.9, p < 0.001, Kruskal–Wallis H test] with highest prediction rates at intermediate WML levels. On the contrary, training one classifier on fNIRS data across all WML levels severely degraded prediction performance (mean accuracy of 46.8%). Activation changes in the bilateral dorsal frontal (putative BA46), bilateral inferior parietal (putative BA39), and left superior parietal (putative BA7) areas were most predictive to increased driving difficulty. These discriminative patterns diminished at higher WML levels indicating that visuospatial attentional demands and WML involve interacting underlying brain processes. The changing pattern of driving difficulty related brain areas across WML levels could indicate potential changes in the multitasking strategy with level of WML demand, in line with the multiple resource theory.

Studies examining the relationship between alexithymia and personality exclusively employed self-report measures of alexithymia. In the present study, we examined the relationship of both observer-rated and self-reported alexithymia with the Big Five personality dimensions. We administered the Toronto Structured Interview for Alexithymia (TSIA) as an interview-based measure of alexithymia and, in addition, two self-report questionnaires, the 20-item Toronto Alexithymia Scale (TAS-20) and the Bermond-Vorst Alexithymia Questionnaire (BVAQ). Fifty-one university students were interviewed and completed the alexithymia scales and the NEO Five-Factor Inventory. In contrast to TAS-20 and BVAQ, the Difficulty identifying feelings (DIF) scale of the TSIA was found to be unrelated to neuroticism, suggesting that the frequently reported association between DIF and neuroticism could be due to the use of self-report scales. In contrast, the affective dimension of alexithymia, measured by the BVAQ, was even negatively related with neuroticism. Thus, a paucity of fantasy and little emotional arousal goes together with increased emotional stability. Furthermore, we revealed negative correlations between interview-based alexithymia scores and openness to experience and agreeableness, which cross-validated the self-report findings. Finally, extraversion and conscientiousness each showed only one negative correlation, namely with subscales of the BVAQ. Taken together, our findings show that on the basis of interviews there is no evidence for a relation of DIF with neuroticism, while associations of alexithymia with low openness to experience and low agreeableness emerged irrespective of assessment approach. The relations of alexithymia with personality are discussed in the light of different measurement approaches.