Multimodal video sentiment analysis aims to integrate multiple modal information to analyze the opinions and attitudes of speakers. Most previous work focuses on exploring the semantic interactions of intra- and inter-modality. However, these works ignore the reliability of multimodality, i.e., modalities tend to contain noise, semantic ambiguity, missing modalities, etc. In addition, previous multimodal approaches treat different modalities equally, largely ignoring their different contributions. Furthermore, existing multimodal sentiment analysis methods directly regress sentiment scores without considering ordinal relationships within sentiment categories, with limited performance. To address the aforementioned problems, we propose a trustworthy multimodal sentiment ordinal network (TMSON) to improve performance in sentiment analysis. Specifically, we first devise a unimodal feature extractor for each modality to obtain modality-specific features. Then, an uncertainty distribution estimation network is customized, which estimates the unimodal uncertainty distributions. Next, Bayesian fusion is performed on the learned unimodal distributions to obtain multimodal distributions for sentiment prediction. Finally, an ordinal-aware sentiment space is constructed, where ordinal regression is used to constrain the multimodal distributions. Our proposed TMSON outperforms baselines on multimodal sentiment analysis tasks, and empirical results demonstrate that TMSON is capable of reducing uncertainty to obtain more robust predictions.
Bearing fault diagnosis is critical for the reliability and safety of rotating machinery in industrial applications. Traditional fault diagnosis methods and single-view deep learning models often fail to capture the complex, multi-dimensional nature of vibration signals, limiting their effectiveness in accurately identifying faults under varying conditions. To address this, we propose a novel multi-view framework that leverages complementary views—time, frequency, and wavelet domains—of vibration signals for robust fault diagnosis. Our framework integrates a cross-attention mechanism (CAM) that combines self-attention and cross-attention to capture both intra-view and inter-view dependencies, enabling the effective fusion of multi-domain information. By modeling the interactions between different views, the proposed approach enhances feature representation, leading to improved diagnostic accuracy even under noisy industrial conditions. Experimental results on public bearing datasets demonstrate the superior performance of our method compared to state-of-the-art approaches, with significant improvements in robustness and accuracy. This framework provides a promising solution for intelligent fault diagnosis in complex industrial environments.
1 October 2026 in IEEE Transactions on Computational Social Systems