Autonomous vehicles are expected to take complete control of the driving process, enabling the former drivers to act as passengers only. This could lead to increased sickness as they can be engaged in tasks other than driving. Adopting different sickness mitigation techniques gives us unique types of motion sickness in autonomous vehicles to be studied. In this paper, we report on a study where we explored the possibilities of assessing motion sickness with electrogastrography (EGG), a non-invasive method used to measure the myoelectric activity of the stomach, and its potential usage in autonomous vehicles (AVs). The study was conducted in a high-fidelity driving simulator with a virtual reality (VR) headset. There separate EGG measurements were performed: before, during and after the driving AV simulation video in VR. During the driving, the participants encountered two driving environments: a straight and less dynamic highway road and a highly dynamic and curvy countryside road. The EGG signal was recorded with a proprietary 3-channel recording device and Ag/AgCl cutaneous electrodes. In addition, participants were asked to signalize whenever they felt uncomfortable and nauseated by pressing a special button. After the drive they completed also the Simulator Sickness Questionnaire (SSQ) and reported on their overall subjective perception of sickness symptoms. The EGG results showed a significant increase of the dominant frequency (DF) and the percentage of the high power spectrum density (FSD) as well as a significant decrease of the power spectrum density Crest factor (CF) during the AV simulation. The vast majority of participants reported nausea during more dynamic conditions, accompanied by an increase in the amplitude and the RMS value of EGG. Reported nausea occurred simultaneously with the increase in EGG amplitude. Based on the results, we conclude that EGG could be used for assessment of motion sickness in autonomous vehicles. DF, CF and FSD can be used as overall sickness indicators, while the relative increase in amplitude of EGG signal and duration of that increase can be used as short-term sickness indicators where the driving environment may affect the driver.

General introduction of unconditionally and conditionally automated vehicles is expected to have a highly positive impact on the society, from increased accessibility to mobility and road traffic safety, to decreased environmental and economic negative impacts. However, there are several obstacles and risks slowing down the adoption of this technology, which are primarily related to the human-machine interaction (HMI) and exchange of control between the vehicle and the human driver. In this article, we present key takeaways for HMI design of take-over requests (TOR) that the vehicle issues to inform the driver to take over control of the vehicle. The key takeaways were developed based on the results of a user study, where directional tactile-ambient (visual) and auditory-ambient (visual) TOR user interfaces (UI) were evaluated with regards to commonly used take-over quality aspects (attention redirection, take-over time, correct interpretation of stimuli, off-road drive, brake application, lateral acceleration, minimal time-to-collision and occurrence of collision). 36 participants took part in the mixed design study, which was conducted in a driving simulator. The results showed that drivers' attention was statistically significantly faster redirected with the auditory-ambient UI, however using the tactile-ambient UI resulted in less off-road driving and slightly less collisions. The results also revealed that drivers correctly interpreted the directional TOR stimuli more often than the non-directional one. Based on the study results, a list of key takeaways was developed and is presented in the conclusion of the paper. The results from this study are especially relevant to the TOR UI designers and the automotive industry, which tend to provide the most usable UI for ensuring safer end efficient human-vehicle interaction during the TOR task.

The ability to measure drivers’ physiological responses is important for understanding their state and behavior under different driving conditions. Such measurements can be used in the development of novel user interfaces, driver profiling, advanced driver assistance systems, etc. In this paper, we present a user study in which we performed an evaluation of two commercially available wearable devices for assessment of drivers’ physiological signals. Empatica’s E4 wristband measures blood volume pulse (BVP), inter-beat interval (IBI), galvanic skin response (GSR), temperature, and acceleration. Bittium’s Faros 360 is an electrocardiographic (ECG) device that can record up to 3-channel ECG signals. The aim of this study was to explore the use of such devices in a dynamic driving environment and their ability to differentiate between different levels of driving demand. Twenty-two participants (eight female, 14 male) aged between 18 and 45 years old participated in the study. The experiment compared three phases: Baseline (no driving), easy driving scenario, and demanding driving scenario. Mean and median heart rate variability (HRV), standard deviation of R–R intervals (SDNN), HRV variables for shorter time frames (standard deviation of the average R–R intervals over a shorter period—SDANN and mean value of the standard deviations calculated over a shorter period—SDNN index), HRV variables based on successive differences (root mean square of successive differences—RMSSD and percentage of successive differences, greater than 50 ms—pNN50), skin temperature, and GSR were observed in each phase. The results showed that motion artefacts due to driving affect the GSR recordings, which may limit the use of wrist-based wearable devices in a driving environment. In this case, due to the limitations of the photoplethysmography (PPG) sensor, E4 only showed differences between non-driving and driving phases but could not differentiate between different levels of driving demand. On the other hand, the results obtained from the ECG signals from Faros 360 showed statistically significant differences also between the two levels of driving demand.

This paper discusses the concept of take-over (TO) in conditionally automated vehicles. Most of the current studies consider TO as a discrete event that is completed when the driver takes full control of the vehicle. Two problems with this approach are that the driver 1) needs time to gain sufficient situational awareness and 2) sometimes takes over only the lateral or only the longitudinal coordination of the vehicle, neglecting the other. To overcome these two problems and increase the quality (effectiveness, efficiency, and satisfaction) of TO, we propose two new approaches to the take-over process: partial take-overs (PTO) and assisted take-overs (ATO). The proposed PTO approach allows the driver to take over only the lateral or longitudinal coordination of the vehicle separately, instead of assuming a full TO. With ATO, the driver is monitored even after taking control of the vehicle and is assisted with automatic soft braking as well as additional warning and emergency braking if the time to collision falls below the appropriate critical levels. The approaches were evaluated in a user study with 44 participants in a driving simulator. We were able to confirm that the proposed ATO approach significantly improves the TO quality in terms of both effectiveness and efficiency without compromising driver satisfaction. Contrary to our expectations, the PTO approach did not have a significant effect on the effectiveness of TO, but only provided significantly lower reaction time to first braking and longer time to lane crossing. When combined, ATO and PTO were at least as useful as either approach individually and should be considered in future TOR user interfaces.

In the realm of conditionally automated driving, understanding the crucial transition phase after a takeover is paramount. This study delves into the concept of post-takeover stabilization by analyzing data recorded in two driving simulator experiments. By analyzing both driving and physiological signals, we investigate the time required for the driver to regain full control and adapt to the dynamic driving task following automation. Our findings show that the stabilization time varies between measured parameters. While the drivers achieved driving-related stabilization (winding, speed) in eight to ten seconds, physiological parameters (heart rate, phasic skin conductance) exhibited a prolonged response. By elucidating the temporal and cognitive dynamics underlying the stabilization process, our results pave the way for the development of more effective and user-friendly automated driving systems, ultimately enhancing safety and driving experience on the roads.

In conditionally automated driving, a vehicle issues a take-over request when it reaches the functional limits of self-driving, and the driver must take control. The key driving parameters affecting the quality of the take-over (TO) process have yet to be determined and are the motivation for our work. To determine these parameters, we used a dataset of 41 driving and non-driving parameters from a previous user study with 216 TOs while performing a non-driving-related task on a handheld device in a driving simulator. Eight take-over quality aspects, grouped into pre-TO predictors (attention), during-TO predictors (reaction time, solution suitability), and safety performance (off-road drive, braking, lateral acceleration, time to collision, success), were modeled using multiple linear regression, support vector machines, M5’, 1R, logistic regression, and J48. We interpreted the best-suited models by highlighting the most influential parameters that affect the overall quality of a TO. The results show that these are primarily maximal acceleration (88.6% accurate prediction of collisions) and the TOR-to-first-brake interval. Gradual braking, neither too hard nor too soft, as fast as possible seems to be the strategy that maximizes the overall TO quality. The position of the handheld device and the way it was held prior to TO did not affect TO quality. However, handling the device during TO did affect driver attention when shorter attention times were observed and drivers held their mobile phones in only one hand. In the future, automatic gradual braking maneuvers could be considered instead of immediate full TOs.