30 December 2019 in IEEE Access
Multitask sparse representation method improves the detection performance by constructing multiple associated sub-sparse representation tasks and jointly learning multiple sub-sparse representation tasks, and this method can make use of the spectral information. However, the using of spatial information needs to be improved. This paper designs a hyperspectral image target detection method which can both make use of spectral and spatial information, that is a weighted joint k-nearest neighbor and multitask learning sparse representation method (WJNN-MTL-SR) is proposed. This method mainly consists of the following steps:1) using multitask sparse representation to obtain the representation residuals. 2) weighted joint k-nearest neighbor is used into the joint region of test pixels to obtain the weighted joint Euclidean distance. 3) a decision function, combining the weighted joint Euclidean distance and residuals of the multitask sparse representation, is used to get target detection result. Experimental results demonstrate that the proposed method show better detection performance than state-of-the-art methods.
13 June 2024 in IEEE Transactions on Computational Social Systems
The purpose of facial expression recognition is to recognize the corresponding emotions. However, people tend to hide their emotions by displaying facial expressions that differ from those evoked by emotions. These inconsistent facial expressions are referred to as masked facial expressions (MFEs). The automatic recognition of hidden emotions within an MFE using image data is challenging. In this study, we find distinctive movement patterns in the facial action units (AUs) of MFE sequences through a detailed analysis. Considering our findings, we propose handcrafted features called dynamic AU intensity features (DAIFs) to represent AU movement. Furthermore, we develop a decoupled AU transformer (DAUT) model for recognition, where the decoupled convolution operators ensure that the temporal information in the DAIF is not damaged. To further improve the recognition performance, we design self-supervised clip prediction for pretraining of DAUT. Experimental results demonstrate that our proposed method performs exceptionally well across all tasks in the MFE dataset, particularly improving accuracy by nearly double on the most challenging 36-class task. This suggests that leveraging temporal information from facial AU movements is a reliable and effective technique for recognizing MFEs.
1 September 2023 in IEEE Access
It is challenging to accurately mode the local and global context during complex scene segmentation. To solve this problem, a scene semantic segmentation network contains local to global self-attention module and feature alignment module is proposed in this paper. The local to global self-attention module is designed to combine the local and global features, in which the transformer backbone treats all patches equally in the global scope, to extract high-level features. The improved masked transformer with feature alignment module (MtFAM), which combines the masked transformer and feature alignment module to form a new decoder structure, is designed to fuse the features obtained from the vision transformer backbone and the local to global self-attention module. Experimental results demonstrate that the proposed structure show better performance, which can improve the value of mIoU by 3.63% on the ADE20K validation dataset compared to the Vit-Tiny. In particular, it can obtain 2.23% higher mIoU value than the segmenter method using the same transformer backbone on the challenging scene segmentation benchmark.
26 December 2025 in Pattern Recognition