Worldwide inflation in the count of road accidents has raised an alarming scenario wherein driver distraction is identified as one of the main causes. According to the National Highway Traffic Safety Administration survey, talking over the mobile or fellow passengers, eating or drinking while driving, and operating in-vehicle menus can lead to distract the driver. Therefore, this paper presents a new driver distraction detection method to cater such scenarios. The proposed method is a convolution-based capsule network with attention mechanism, termed as CAT-CapsNet, that combines the computation capabilities of capsule network with attention module and convolution filters. We evaluate the proposed CAT-CapsNet on two publicly available driver distraction datasets namely, American University in Cairo (AUC) distracted driver dataset and Statefarmŝ dataset. A comparative analysis of the proposed model is conducted against 16 (approx) state-of-the-art methods in terms of accuracy, number of parameters, and AUC curves. Experiments affirm that CAT-CapsNet outperforms with the accuracy of $99.88\%$ on SFD dataset and $96.7\%$ accuracy on the AUC dataset. Moreover, the proposed model has only $8.5M$ parameters to train and no data augmentation is needed in-case training samples are less.
In this paper, we propose a novel, real-time driver emotion monitoring system “in the wild” based on face detection and racial expression analysis. A camera is placed inside the vehicle that continuously looks at the driver's face and monitors the driver's emotional state at regular time intervals. Camera based monitoring of the driver's attentiveness based on the driver's emotional state in naturalistic driving environments is a non-intrusive approach and an important part of an automated driver assistance system (ADAS). Our work employs a face detection model based on mixture of trees with shared pool of parts to robustly detect the drivers face in varied environmental conditions. We also extract racial landmark points, and use them to enhance our emotion recognition system. In our proposed work, we use convolution neural networks. In the first, we use VGG16 to extract appearance features from the detected face image and in the second VGG16 network, to extract geometrical features from the racial landmark points. We then combine these two features using an integration method to accurately recognize the emotions. Based on the recognized emotional state of the driver, the driver can be made aware of his emotional state in case necessary. Experimental results on publicly available driver and face expression datasets show that our system is robust and accurate for driver emotion detection.
In this study, the authors propose a novel and robust approach to control auxiliary tasks in vehicles using hand gestures. First, they create a three‐dimensional video volume by appending one frame to other that captures the motion history of frames. Then, they extract features using histogram of oriented gradients on each video volume. These features are represented in the form of subspaces on Grassmann manifold. To improve the recognition accuracy, they map the data from one manifold to another manifold with the help of a Grassmann kernel. Grassmann graph embedding discriminant analysis framework is used to classify the gestures. They perform experiments on two datasets: LISA and Cambridge Hand Gesture in three different testing methods such as 1/3‐subject, 2/3‐subject and cross‐subject. Experimental results show that their proposed model outperforms and is comparable with the state‐of‐the‐art methods.
21 February 2023 in Multimedia Tools and Applications
Coronavirus, a virus that spread worldwide rapidly and was eventually declared a pandemic. The rapid spread made it essential to detect Coronavirus infected people to control the further spread. Recent studies show that radiological images such as X-Rays and CT scans provide essential information in detecting infection using deep learning models. This paper proposes a shallow architecture based on Capsule Networks with convolutional layers to detect COVID-19 infected persons. The proposed method combines the ability of the capsule network to understand spatial information with convolutional layers for efficient feature extraction. Due to the model’s shallow architecture, it has 23M parameters to train and requires fewer training samples. The proposed system is fast and robust and correctly classifies the X-Ray images into three classes, i.e. COVID-19, No Findings, and Viral Pneumonia. Experimental results on the X-Ray dataset show that our model performs well despite having fewer samples for the training and achieved an average accuracy of 96.47% for multi-class and 97.69% for binary classification on 5-fold cross-validation. The proposed model would be useful to researchers and medical professionals for assistance and prognosis for COVID-19 infected patients.
31 August 2023 in Multimedia Tools and Applications