Traffic accidents due to drivers falling asleep while driving is an important cause of death, and effective techniques for coping with this phenomenon are needed. In this paper we present a simple, yet effective algorithm, based on heart rate variability analysis. Results of the experimental validation are reported: two test sessions were performed, one in domestic environments and one in realistic driving environments by using a dynamic driving simulator. The results confirm the results obtained in the previous work (Groppo et al. , 2020), and the capability of the proposed algorithm in predicting sleep while driving using a physiological signal that can be collected at the wrist of the driver.

Teaching is an activity that requires understanding the class’s reaction to evaluate the teaching methodology effectiveness. This operation can be easy to achieve in small classrooms, while it may be challenging to do in classes of 50 or more students. This paper proposes a novel Internet of Things (IoT) system to aid teachers in their work based on the redundant use of non-invasive techniques such as facial expression recognition and physiological data analysis. Facial expression recognition is performed using a Convolutional Neural Network (CNN), while physiological data are obtained via Photoplethysmography (PPG). By recurring to Russel’s model, we grouped the most important Ekman’s facial expressions recognized by CNN into active and passive. Then, operations such as thresholding and windowing were performed to make it possible to compare and analyze the results from both sources. Using a window size of 100 samples, both sources have detected a level of attention of about 55.5% for the in-presence lectures tests. By comparing results coming from in-presence and pre-recorded remote lectures, it is possible to note that, thanks to validation with physiological data, facial expressions alone seem useful in determining students’ level of attention for in-presence lectures.

In many applications, recognizing the depth of sleep (e.g., light, deep, REM sleep) while the subject is sleeping enables innovative features. For instance, in SAE Level 4 autonomous driving, a driver may need to takeover the vehicle control in case the autopilot is exiting its operational design domain. Depending on the depth of the sleep, the subject may need time to takeover effectively; hence, it is particularly relevant to know in which sleep stage the subject is (e.g., light sleep, deep sleep, and REM sleep), and possibly initiate actions to prevent the subject to remain in those sleep stages that lead to longer takeover time. Sleep stage classification can be achieved through an on-the-fly algorithm, which generates output in response to each input portion without knowledge of future inputs, unlike an off-Line algorithm that provides output just after receiving the entire input sequence. Various studies have analyzed algorithms or devices that identify sleep stages during the night; however, these typically require electroencephalography (EEG), which is obtrusive, or specialized devices. This study describes the development of an on-the-fly sleep-scoring algorithm using Heart Rate (HR), RR intervals, which is the distance between two consecutive heartbeats, and accelerometer data from a smartwatch, widespread, non-invasive, and affordable but accurate device. The subjects involved in our study wore a commercial off-the-shelf wearable device during a full night’s sleep, and were also monitored using a reference medical device to establish the ground truth by means of a full polysomnography (PSG) analysis. The on-the-fly sleep scoring algorithm based on smartwatch data was tested against PSG-based scoring, achieving 88.46% accuracy, 91.42% precision, and 93.52% sensitivity in sleep–wake identification. Deep sleep was correctly identified 69.38% of times, light sleep in 50.62%, REM sleep 62.02% and wakefulness 73.48% of times.

The last decade's market has been characterized by wearable devices, mainly smartwatches, edge, and cloud computing. A possible application of these technologies is to improve the safety of dangerous activities, especially driving motor vehicles. Common enabling technologies, such as system-on-chip, ultra-low-power computational platforms, and wide-band wireless connectivity, push all these trends. On the one hand, wearable devices, thanks to the continuous contact with the user's body, can measure physiological parameters. On the other hand, edge computing and machine learning techniques, alongside cameras, allow the implementation of contactless computer vision systems capable of providing information about the user's current behavior. Another trend is the usage of RADARs in automotive applications, both for collision avoidance and monitoring driver behavior. These technologies can be combined to develop systems designed to aid the driver. For the sake of this paper, we are focusing on warning drivers, allowing them to know whenever they are drowsy and hence risking a sleep onset or are not paying attention to the road. Developing such systems poses many challenges, such as automatic classification of physiological signal patterns, facial expression recognition, head movements and eye gaze detection. These challenges have been individually addressed in the literature. Anyway, we noticed a need for more description on implementing data fusion. Two main reasons for adopting the fusion approach are to improve the quality of the overall representation (increasing accuracy and specificity against drowsy) and make a more reliable system due to redundancy.