This article provides an interdisciplinary perspective on driver monitoring systems by discussing state-of-the-art signal processing solutions in the context of road safety issues identified in human factors research. Recently, the human factors community has made significant progress in understanding driver behaviors and assessed the efficacy of various interventions for unsafe driving practices. In parallel, the signal processing community has had significant advancements in developing signal acquisition and processing methods for driver monitoring systems. This article aims to bridge these efforts and help initiate new collaborations across the two fields. Toward this end, we discuss how vehicle measures, facial/body expressions, and physiological signals can assist in improving driving safety through adaptive interactions with the driver, based on the driver's state and driving environment. Moreover, by highlighting the current human factors research in road safety, we provide insights for building feedback and mitigation technologies, which can act both in real time and postdrive. We provide insights into areas with great potential to improve driver monitoring systems, which have not yet been extensively studied in the literature, such as affect recognition and data fusion. Finally, a high-level discussion is given on the challenges and possible future directions for driver monitoring systems.
There will be circumstances where partial or conditionally automated vehicles fail to drive safely and require human interventions. Within the human factors community, the taxonomies surrounding control transitions have primarily focused on characterizing the stages and sequences of the transition between the automated driving system (ADS) and the human driver. Recognizing the variance in operational design domains (ODDs) across vehicles equipped with ADS and how variable the takeover situations may be, we describe a simple taxonomy of takeover situations to aid the identification and discussions of takeover scenarios in future takeover studies. By considering the ODD structure and the human information processing stages, we constructed a fault tree analysis (FTA) aimed to identify potential failure sources that would prevent successful control transitions. The FTA was applied in analyzing two real-world accidents involving ADS failures, illustrating how this approach can help identify areas for improvements in the system, interface, or training design to support drivers in level 2 and level 3 automated driving.
This study examines driver engagement with smartwatches and smartphones while driving. Twelve participants (7 novice and 5 experienced smartwatch users) drove in a high-fidelity simulator while receiving notifications from either a smartwatch (Pebble) or a smartphone (LG Nexus 5). It was found that participants had more glances, on average, per notification while using the smartwatch compared to the smartphone. Further, their brake response times were longer when they received notifications prior to a lead vehicle braking event on the smartwatch compared to when they did not receive any notifications and when they received notifications on the smartphone. Contrary to these glance and driving performance findings, participants perceived similar levels of risk for the two devices, and they largely reported that smartwatch use while driving should receive penalties equal to or less than smartphone use with respect to distracted driving legislation. Thus, there appears to be a disconnection between drivers' actual performance while using smartwatches and their perceptions.