Multimodal sentiment analysis has gained popularity as a research field for its ability to predict users’ emotional tendencies more comprehensively. The data fusion module is a critical component of multimodal sentiment analysis, as it allows for integrating information from multiple modalities. However, it is challenging to combine modalities and remove redundant information effectively. In our research, we address these challenges by proposing a multimodal sentiment analysis model based on supervised contrastive learning, which leads to more effective data representation and richer multimodal features. Specifically, we introduce the MLFC module, which utilizes a convolutional neural network (CNN) and Transformer to solve the redundancy problem of each modal feature and reduce irrelevant information. Moreover, our model employs supervised contrastive learning to enhance its ability to learn standard sentiment features from data. We evaluate our model on three widely-used datasets, namely MVSA-single, MVSA-multiple, and HFM, demonstrating that our model outperforms the state-of-the-art model. Finally, we conduct ablation experiments to validate the efficacy of our proposed method.

Currently, attention mechanisms are widely used in aspect-level sentiment analysis tasks. Previous studies have only used attention mechanisms combined with neural networks for aspect-level sentiment classification, and the feature extraction of the model is insufficient. When the same aspect and sentiment polarity appear in multiple sentences, the semantic information sharing of the same domain is also ignored, resulting in low model performance. To address these problems, the paper proposes an aspect-level sentiment analysis model, GCAT-GTCU, which combines a Graph-connected Attention Network containing symmetry with Gate Than Change Unit. Three nodes of words, sentences, and aspects are constructed, and local and deep-level features of sentences are extracted using CNN splicing BiGRU; node connection information is added to GAT to form a GCAT containing symmetry to realize the information interaction of three nodes, pay attention to the contextual information, and update the shared information of three nodes at any time; a new gating mechanism GTCU is constructed to filter noisy information and control the flow of sentiment information; finally, the three nodes are extracted information to predict the final sentiment polarity. The experimental results on four publicly available datasets show that the model outperforms the baseline model against which it is compared in some very controlled situations.

Infrared (IR) small-target-detection performance restricts the development of infrared search and track (IRST) systems. Existing detection methods easily lead to missed detection and false alarms under complex backgrounds and interference, and only focus on the target position while ignoring the target shape features, which cannot further identify the category of IR targets. To address these issues and guarantee a certain runtime, a weighted local difference variance measure (WLDVM) algorithm is proposed. First, Gaussian filtering is used to preprocess the image by using the idea of a matched filter to purposefully enhance the target and suppress noise. Then, the target area is divided into a new tri-layer filtering window according to the distribution characteristics of the target area, and a window intensity level (WIL) is proposed to represent the complexity level of each layer of windows. Secondly, a local difference variance measure (LDVM) is proposed, which can eliminate the high-brightness background through the difference-form, and further use the local variance to make the target area appear brighter. The background estimation is then adopted to calculate the weighting function to determine the shape of the real small target. Finally, a simple adaptive threshold is used after obtaining the WLDVM saliency map (SM) to capture the true target. Experiments on nine groups of IR small-target datasets with complex backgrounds illustrate that the proposed method can effectively solve the above problems, and its detection performance is better than seven classic and widely used methods.

Because multimodal data contains more modal information, multimodal sentiment analysis has become a recent research hotspot. However, redundant information is easily involved in feature fusion after feature extraction, which has a certain impact on the feature representation after fusion. Therefore, in this papaer, we propose a new multimodal sentiment analysis model. In our model, we use BERT + BiLSTM as new feature extractor to capture the long-distance dependencies in sentences and consider the position information of input sequences to obtain richer text features. To remove redundant information and make the network pay more attention to the correlation between image and text features, CNN and CBAM attention are added after splicing text features and picture features, to improve the feature representation ability. On the MVSA-single dataset and HFM dataset, compared with the baseline model, the ACC of our model is improved by 1.78% and 1.91%, and the F1 value is enhanced by 3.09% and 2.0%, respectively. The experimental results show that our model achieves a sound effect, similar to the advanced model.