Facial Expression recognition is a computer vision problem that took relevant benefit from the research in deep learning. Recent deep neural networks achieved superior results, demonstrating the feasibility of recognizing the expression of a user from a single picture or a video recording the face dynamics. Research studies reveal that the most discriminating portions of the face surfaces that contribute to the recognition of facial expressions are located on the mouth and the eyes. The restrictions for COVID pandemic reasons have also revealed that state-of-the-art solutions for the analysis of the face can severely fail due to the occlusions of using the facial masks. This study explores to what extend expression recognition can deal with occluded faces in presence of masks. To a fairer comparison, the analysis is performed in different occluded scenarios to effectively assess if the facial masks can really imply a decrease in the recognition accuracy. The experiments performed on two public datasets show that some famous top deep classifiers expose a significant reduction in accuracy in presence of masks up to half of the accuracy achieved in non-occluded conditions. Moreover, a relevant decrease in performance is also reported also in the case of occluded eyes but the overall drop in performance is not as severe as in presence of the facial masks, thus confirming that, like happens for face biometric recognition, occluded faces by facial mask still represent a challenging limitation for computer vision solutions.
27 May 2022 in IEEE Transactions on Industrial Informatics
Smart factories are fostered by integrating intelligent systems and ICT technologies. The role they play is crucial in the spread of Industry 4.0 and the economic growth of developed countries. Smart factories can be empowered by using several sensors aimed at making them more and more “smart.” Unfortunately, work accidents are still very common resulting in human losses and permanent injuries. This makes it urgent and key to implementing security and safety measures also in the context of a smart factory. In this article, a novel framework for supporting smart devices in a smart factory, using multiple sensors to monitor different biometric features, both physical and behavioral is proposed. Thanks to the fusion of several biometric traits with the support of machine learning technologies working together with different kinds of sensors, it is possible to guarantee three fundamental aspects within the interaction between an operator of a smart device and the device itself: continuous authentication (i.e., continuous face recognition), drowsiness detection, and liveness detection. With the application of the proposed framework, it is possible to significantly improve the safety of operators avoiding fatal accidents for them. Experiments made using COTS-hardware showed that the authors’ idea is easy to implement in a large-scale smart factory and further improves the spread of Industry 4.0.
1 December 2021 in Future Generation Computer Systems