Detecting the factors affecting drivers’ safe driving and taking early warning measures can effectively reduce the probability of automobile safety accidents and improve vehicle driving safety. Considering the two factors of driver fatigue and distraction state, their influences on driver behavior are elaborated from both experimental data and an accident library analysis. Starting from three modes and six types, intelligent detection methods for driver fatigue and distraction detection from the past five years are reviewed in detail. Considering its wide range of applications, the research on machine vision detection based on facial features in the past five years is analyzed, and the methods are carefully classified and compared according to their innovation points. Further, three safety warning and response schemes are proposed in light of the development of autonomous driving and intelligent cockpit technology. Finally, the paper summarizes the current state of research in the field, presents five conclusions, and discusses future trends.

Autonomous vehicle technology has developed at an unprecedented rate in recent years. An increasing number of vehicles are equipped with different levels of driving assist systems to reduce the human driver’s burden. However, because of the conservative design of its programming framework, there is still a large gap between the performance of current autonomous driving systems and experienced veteran drivers. This gap can cause drivers to distrust decisions or behaviors made by autonomous vehicles, thus affecting the effectiveness of drivers’ use of auto-driving systems. To further estimate the expected acceptance of autonomous driving systems in real human–machine co-driving situations, a characterization model of driver confidence has to be constructed. This paper conducts a survey of driver confidence in riding autonomous vehicles. Based on the analysis of results, the paper proposes a confidence quantification model called “the Virtual Confidence (VC)” by quantifying three main factors affecting driver confidence in autonomous vehicles, including (1) the intrusive movements of surrounding traffic participants, (2) the abnormal behavior of the ego vehicle, and (3) the complexity of the driving environment. The model culminates in a dynamic confidence bar with values ranging from 0 to 100 to represent the levels of confidence. The validation of the confidence model was verified by doing comparisons between the real-time output of the VC and the real-time feeling of human drivers on an autonomous vehicle simulator. The proposed VC model can potentially identify features that need improvement for auto-driving systems in unmanned tests and provide data reference.

As the demand for private vehicles rises, there has been a gradual increase in the number of motor vehicles on the roads, leading to a growing concern about addressing traffic safety. Currently, China’s approach to assessing driver capabilities remains rooted in traditional, non-intelligent, and standardized evaluation methods based on examination subjects. The traditional model often falls short in providing constructive feedback on a driver’s real-world vehicle handling abilities, as many of the examination subjects can be practiced in advance to achieve a mere passing result, which, undoubtedly, increases the likelihood of underqualified drivers on the road. To address the issues of the current examination-oriented driver evaluation system in China, we propose a road performance assessment model (RPAM) that assesses drivers comprehensively by evaluating their road environment perception and vehicle operation abilities based on an in-vehicle and out-vehicle perception system. The model leverages patterns of the driver’s head posture, along with real-time information on the vehicle’s behavior and the road conditions, to quantify various performance metrics related to reasonable operation processes. These metrics are then integrated to generate a holistic assessment of the driving capabilities. This paper ultimately conducted tests of the RPAM on one actual examination route in Beijing. Two drivers were randomly selected for the examination. The model successfully computed the overall ability scores for each driver, validating the effectiveness.