30 August 2022 in Accident Analysis & Prevention
9 July 2024 in IEEE Transactions on Intelligent Transportation Systems
Detecting driver fatigue is critical to ensuring road safety. Existing fatigue detection methods typically rely on traditional hand-picked features as inputs. However, these hand-picked features can hardly respond accurately to the driver’s fatigue state due to a certain degree of subjectivity and the extraction of these features requires a long time window, which limits the accuracy and real-time performance of the detection. This paper proposes a novel fatigue detection method based on multi-source information fusion, which relies entirely on neural networks for automatic feature extraction. Through simulated driving experiments, we recorded physiological signals and facial videos from 21 participants for model training and testing. The results show that our model outperforms existing methods in terms of accuracy and real-time performance, achieving a detection accuracy of 93.15% within a 3-second time window (specificity $=$ 94.04%, sensitivity $=$ 91.71%). The visualization results of the model reveal potential relationships between facial regions for the first time, validating the rationality and effectiveness of our method. The practical issues of fatigue detection methods and future research directions are also explored.
10 April 2024 in IEEE Transactions on Intelligent Vehicles
In recent years, non-contact physiological signal monitoring based on facial video has garnered significant attention due to its convenience and low cost. Unlike traditional methods for physiological signal monitoring, which necessitate complex equipment and stringent monitoring conditions, remote photoplethysmography (rPPG) technology relies solely on a camera to recover photoplethysmography (PPG) signals and analyze a broad spectrum of physiological metrics. This approach can be easily integrated into existing sensors in smart vehicles, enabling in-vehicle occupant status monitoring. In this paper, we conduct a comprehensive review of current research progress in detecting physiological signals using rPPG technology, specifically focusing on smart vehicles. This includes benchmark datasets, video preprocessing methods, unsupervised, supervised, and self-supervised signal restoration techniques, as well as post-processing methods applied to the signals. We also provide a performance summary of all these methods across various datasets. Additionally, we delve into the primary applications of rPPG technology in intelligent vehicles and highlight the current challenges. Finally, we conclude with a discussion on future research directions in this area to facilitate broader application of rPPG technology in the field of intelligent vehicles.
17 September 2024 in IEEE Transactions on Intelligent Transportation Systems
In the context of vehicle intelligence, smart cockpits are widely used in modern vehicle design. However, with the popularity of smart cockpits, their impact on drivers’ driving behavior have not been evaluated. This study investigated the degree of visual-manual distraction and secondary task performance of drivers by four center screen layouts (single, joint, vertical and horizontal screens) in smart cockpits. Twenty-four drivers used the four smart cockpit layouts to complete three secondary tasks on real roads: a dashboard viewing task, a song switching task and a specified music playing task. Drivers’ visual-manual demands were measured by eye-tracking and task completion performance, and drivers’ cognitive demands were assessed by Likert scales. The results showed that the type of smart cockpit layout had a significant effect on both drivers visual-manual behavior and task performance, with the horizontal cockpit layout having the least effect on driver visual-manual distraction, while the vertical layout resulted in the highest level of visual demand and distraction. Performance on complex secondary tasks was more likely to be affected by the smart cockpit layout than on simple secondary tasks. Cognitive load was not significantly affected by the smart cockpit layout condition.
19 June 2025 in Transportation Research Part F: Traffic Psychology and Behaviour
8 January 2026 in Biomedical Signal Processing and Control