A variety of technologies that could enhance driving safety are being actively explored, with the aim of reducing traffic accidents by accurately recognizing the driver’s state. In this field, three mainstream detection methods have been widely applied, namely visual monitoring, physiological indicator monitoring and vehicle behavior analysis. In order to achieve more accurate driver state recognition, we adopted a multi-sensor fusion approach. We monitored driver physiological signals, electroencephalogram (EEG) signals and electrocardiogram (ECG) signals to determine fatigue state, while an in-vehicle camera observed driver behavior and provided more information for driver state assessment. In addition, an outside camera was used to monitor vehicle position to determine whether there were any driving deviations due to distraction or fatigue. After a series of experimental validations, our research results showed that our multi-sensor approach exhibited good performance for driver state recognition. This study could provide a solid foundation and development direction for future in-depth driver state recognition research, which is expected to further improve road safety.

Heart rate variability (HRV) serves as a significant physiological measure that mirrors the regulatory capacity of the cardiac autonomic nervous system. It not only indicates the extent of the autonomic nervous system’s influence on heart function but also unveils the connection between emotions and psychological disorders. Currently, in the field of emotion recognition using HRV, most methods focus on feature extraction through the comprehensive analysis of signal characteristics; however, these methods lack in-depth analysis of the local features in the HRV signal and cannot fully utilize the information of the HRV signal. Therefore, we propose the HRV Emotion Recognition (HER) method, utilizing the amplitude level quantization (ALQ) technique for feature extraction. First, we employ the emotion quantification analysis (EQA) technique to impartially assess the semantic resemblance of emotions within the domain of emotional arousal. Then, we use the ALQ method to extract rich local information features by analyzing the local information in each frequency range of the HRV signal. Finally, the extracted features are classified using a logistic regression (LR) classification algorithm, which can achieve efficient and accurate emotion recognition. According to the experiment findings, the approach surpasses existing techniques in emotion recognition accuracy, achieving an average accuracy rate of 84.3%. Therefore, the HER method proposed in this paper can effectively utilize the local features in HRV signals to achieve efficient and accurate emotion recognition. This will provide strong support for emotion research in psychology, medicine, and other fields.

Heart Rate Variability (HRV) refers to the capability of the heart rhythm to vary at different times, typically reflecting the regulation of the heart by the autonomic nervous system. In recent years, with advancements in Electrocardiogram (ECG) signal processing technology, HRV features reflect various aspects of cardiac activity, such as variability in heart rate, cardiac health status, and responses. We extracted key features of HRV and used them to develop and evaluate an automatic recognition model for cardiac diseases. Consequently, we proposed the HRV Heart Disease Recognition (HHDR) method, employing the Spectral Magnitude Quantification (SMQ) technique for feature extraction. Firstly, the HRV signals are extracted through electrocardiogram signal processing. Then, by analyzing parts of the HRV signal within various frequency ranges, the SMQ method extracts rich features of partial information. Finally, the Random Forest (RF) classification computational method is employed to classify the extracted information, achieving efficient and accurate cardiac disease recognition. Experimental results indicate that this method surpasses current technologies in recognizing cardiac diseases, with an average accuracy rate of 95.1% for normal/diseased classification, and an average accuracy of 84.8% in classifying five different disease categories. Thus, the proposed HHDR method effectively utilizes the local information of HRV signals for efficient and accurate cardiac disease recognition, providing strong support for cardiac disease research in the medical field.