The proposed method has 30 streams, i.e., 15 spatial streams and 15 temporal streams. Each spatial stream corresponds to each temporal stream. Therefore, this work correlates with the symmetry concept. It is a difficult task to classify video-based facial expression owing to the gap between the visual descriptors and the emotions. In order to bridge the gap, a new video descriptor for facial expression recognition is presented to aggregate spatial and temporal convolutional features across the entire extent of a video. The designed framework integrates a state-of-the-art 30 stream and has a trainable spatial–temporal feature aggregation layer. This framework is end-to-end trainable for video-based facial expression recognition. Thus, this framework can effectively avoid overfitting to the limited emotional video datasets, and the trainable strategy can learn to better represent an entire video. The different schemas for pooling spatial–temporal features are investigated, and the spatial and temporal streams are best aggregated by utilizing the proposed method. The extensive experiments on two public databases, BAUM-1s and eNTERFACE05, show that this framework has promising performance and outperforms the state-of-the-art strategies.
A motor bearing system is a nonlinear dynamics system with nonlinear support stiffness. It is an asymmetry system, which plays an extremely important role in rotating machinery. In this paper, a center frequency method of double thresholds is proposed to improve the variational mode decomposition (VMD) method, then an adaptive VMD (called DTCFVMD) method is obtained to extract the fault feature. In the DTCFVMD method, a center frequency method of double thresholds is a symmetry method, which is used to determine the decomposed mode number of VMD according to the power spectrum of the signal. The proposed DTCFVMD method is used to decompose the nonlinear and non-stationary vibration signals of motor bearing in order to obtain a series of intrinsic mode functions (IMFs) under different scales. Then, the Hilbert transform is used to analyze the envelope of each mode component and calculate the power spectrum of each mode component. Finally, the power spectrum is used to extract the fault feature frequency for determining the fault type of the motor bearing. To test and verify the effectiveness of the DTCFVMD method, the actual fault vibration signal of the motor bearing is selected in here. The experimental results show that the center frequency method of double thresholds can effectively determine the mode number of the VMD method, and the proposed DTCFVMD method can accurately extract the clear time frequency characteristics of each mode component, and obtain the fault characteristics of characteristics; frequency, rotating frequency, and frequency doubling and so on.