Currently, speech emotion recognition models still could not show satisfactory performance due to the complexity of emotions. In most of the previous studies, there is a common problem that some of the particular emotions are severely misclassified. In this paper, we propose a novel framework integrating cascaded attention network and adversarial joint loss strategy for speech emotion recognition, aiming at discriminating the confusions by emphasizing more on the emotions which are difficult to be correctly classified. First, we extract log-Mels, deltas and delta-deltas of log-Mels as 3D features to effectively reduce the interference of external factors. Next, we introduce a cascaded attention network to extract effective emotional features, where spatiotemporal attention selectively locates the targeted emotional regions from the input features. In these targeted regions, the self attention with head fusion captures the long-distance dependence of temporal features. Finally, an adversarial joint loss strategy is proposed to distinguish the emotional embeddings with high similarity by the generated hard triplets in an adversarial fashion. To evaluate our proposed method, experiments are performed with the IEMOCAP, CASIA, and EMODB corpora. The experimental results demonstrate that our proposed method significantly outperforms the state-of-the-art approaches on all datasets.
24 October 2024 in Reliability Engineering & System Safety
Aiming at the problem of traffic congestion prediction based on taxi big data, a CNN-LSTM based traffic prediction model using spatial-temporal trajectory topology is proposed. First, the trajectory information is abstracted into a trajectory topology map with spatial-temporal characteristics according to the time and space dimensions. The topology map solves the problem that the road network map does not have stationarity, and extracts a variety of road condition influence factors. Then, the spatial characteristics of the trajectory traffic flow are extracted by CNN, and the temporal characteristics of the trajectory traffic flow are extracted according to the memory characteristics of LSTM. The experimental results show that the RMSE, MAPE and Spearman correlation coefficients of the proposed method on JT-T809-2011 dataset have an absolute improvement of 1%~2% over state-of-the-art strategies.
31 August 2024 in Engineering Applications of Artificial Intelligence