3 March 2025 in IEEE Transactions on Instrumentation and Measurement
Despite numerous advances, research on facial expression recognition (FER) has recently been proceeding from confined lab circumstances to in-the-wild environments because it is still a arduous and demanding problem due to occlusion and pose changes, intra-class and intensity variations caused by illumination, and insufficient training data. Moreover, most state-of-the-art approaches typically use the entire face as a homogenous source of features for FER. It is observed from past studies on psychology and physiology that the mouth and eyes reflect the variations of various facial expressions, which are closely related to the manifestation of emotion. A novel method is proposed in this study to address some of the issues mentioned above. Firstly, modified homomorphic filtering is employed to normalize the illumination, which reduces the intra-class and intensity differences. Secondly, the normalized face image is cropped into five local regions to emphasize expression-specific characteristics. Thirdly, a unique blended feature attention network (BFAN) is designed for FER. The first module of the BFAN is devised to improve both high-level (HL) and low-level (LL) spatial structural properties of the individual region and normalized face image, which are fed into a residual dilated multi-scale feature extraction module to retrieve rich contextual information. Furthermore, spatial and channel-wise attention modules are employed to extract the most relevant and discriminative features from the LL and HL features. Then, both feature maps are integrated by performing element-wise addition. These features are inputted into dense layers followed by a softmax layer to compute probability scores. Finally, the Choquet fuzzy integral is applied to the computed probability scores to get the final outcome. The significance and superiority of the proposed method are exemplify by performing several experiments with fourteen existing approaches on six benchmark datasets.
20 November 2023 in Modern Physics Letters A
22 January 2015 in International Journal of Theoretical Physics
15 May 2025 in Modern Physics Letters A