Xianbing Zhao

Xianbing Zhao

Auto-generated profile, based on publicly available information

Xianbing Zhao

School of Artificial Intelligence and Computer Science, Jiangnan University, Wuxi, China

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
14 November 2022 in IEEE Transactions on Affective Computing
Verified
Journal Article
Closed access
XZXianbing Zhao
Xianbing Zhao
YCYinxin Chen
Yinxin Chen
SLSicen Liu
Sicen Liu
BTBuzhou Tang
Buzhou Tang
Text, visual, and acoustic are usually complementary in the Multimodal Sentiment Analysis (MSA) task. However, current methods primarily concern shared representations while neglecting the critical private aspects of data within individual modalities. In this work, we propose shared-private memory networks based on the recent advances in the attention mechanism, called SPMN, to decouple multimodal representation from shared and private perspectives. It contains three components: a) a shared memory to learn the shared representations of multimodal data; b) three private memories to learn the private representations of individual modalities, respectively; c) and adaptive fusion gates to fuse multimodal private and shared representations. To evaluate the effectiveness of SPMN, we integrate it into different pre-trained language representation models, such as BERT and XLNET, and conduct experiments on two public datasets, CMU-MOSI and CMU-MOSEI. Experimental results indicate that the performances of pre-trained language representation models are significantly improved because of SPMN and demonstrate the superiority of our model compared to the state-of-the-art methods. SPMN's source code is publicly available at: https://github.com/xiaobaicaihhh/SPMN.

28 September 2023 in IEEE Journal of Biomedical and Health Informatics
Verified
Journal Article
Open access
SLSicen Liu
Sicen Liu
XWXiaolong Wang
Xiaolong Wang
JDJingcheng Du
Jingcheng Du
YHYongshuai Hou
Yongshuai Hou
XZXianbing Zhao
Xianbing Zhao
BTBuzhou Tang
Buzhou Tang
Effectively medication recommendation with complex multimorbidity conditions is a critical task in healthcare. Most existing works predicted medications based on longitudinal records, which assumed the information transmitted patterns of learning longitudinal sequence data are stable and intra-visit medical events are seriaized. However, the following conditions may have been ignored: 1) A more compact encoder for intra-relationship in the intra-visit medical event is urgent; 2) Strategies for learning accurate representations of the variable longitudinal sequences of patients are different. In this paper, we proposed a novel Sample-adaptive Hierarchical medicAtion Prediction nEtwork, termed SHAPE, to tackle the above challenges in the medication recommendation task. Specifically, we design a compact intra-visit set encoder to encode the relationship in the medical event for obtaining visit-level representation and then develop an inter-visit longitudinal encoder to learn the patient-level longitudinal representation efficiently. To endow the model with the capability of modeling the variable visit length, we introduce a soft curriculum learning method to assign the difficulty of each sample automatically by the visit length. Extensive experiments on a benchmark dataset verify the superiority of our model compared with several state-of-the-art baselines.

5 March 2025 in Expert Systems with Applications
Verified
Journal Article
Closed access
XZXianbing Zhao
Xianbing Zhao
SPSoujanya Poria
Soujanya Poria
XLXuejiao Li
Xuejiao Li
YCYixin Chen
Yixin Chen
BTBuzhou Tang
Buzhou Tang

30 April 2023
Verified
Conference Paper
Open access
XZXianbing Zhao
Xianbing Zhao
YCYixin Chen
Yixin Chen
SLSicen Liu
Sicen Liu
XZXuan Zang
Xuan Zang
Yang XiangYang Xiang
Yang Xiang
BTBuzhou Tang
Buzhou Tang
Existing methods for Multimodal Sentiment Analysis (MSA) mainly focus on integrating multimodal data effectively on limited multimodal data. Learning more informative multimodal representation often relies on large-scale labeled datasets, which are difficult and unrealistic to obtain. To learn informative multimodal representation on limited labeled datasets as more as possible, we proposed TMMDA for MSA, a new Token Mixup Multimodal Data Augmentation, which first generates new virtual modalities from the mixed token-level representation of raw modalities, and then enhances the representation of raw modalities by utilizing the representation of the generated virtual modalities. To preserve semantics during virtual modality generation, we propose a novel cross-modal token mixup strategy based on the generative adversarial network. Extensive experiments on two benchmark datasets, i.e., CMU-MOSI and CMU-MOSEI, verify the superiority of our model compared with several state-of-the-art baselines. The code is available at https://github.com/xiaobaicaihhh/TMMDA.

1 November 2024 in Information Fusion
Verified
Journal Article
Closed access
XZXianbing Zhao
Xianbing Zhao
XLXuejiao Li
Xuejiao Li
RJRonghuan Jiang
Ronghuan Jiang
BTBuzhou Tang
Buzhou Tang

18 July 2022
Verified
Conference Paper
Closed access
XZXianbing Zhao
Xianbing Zhao
YCYixin Chen
Yixin Chen
YCYiting Chen
Yiting Chen
SLSicen Liu
Sicen Liu
BTBuzhou Tang
Buzhou Tang
Human language is multimodal, including textual, visual and acoustic information. The task of multimodal sentiment analysis is to use human multimodal information for sentiment recognition. Among the three modalities, text contains richer information than other modalities. With the development of pre-trained representation models on text, most of multimodal sentiment analysis methods use text as primary information and the other modalities as supplementary information. The existing methods suffer from the following limitations: 1) inherent heterogeneity of multimodal data, which makes multimodal fusion difficult as different modalities reside in different feature spaces; 2) asynchronism caused by the inconsistent sampling rates of the time series data of different modalities. To alleviate the heterogeneity and asynchronism of multimodal data, we propose HMAI-BERT, a hierarchical multimodal alignment and interaction network-enhanced BERT. In HMAI-BERT, to improve the efficiency of multimodal interaction, we introduce a memory network to align the different multimodal representations before fusion. After multimodal alignment, we propose a modal update method to address the problem of asynchronism, where each modality is reinforced by interacting with other modalities. In addition, we introduce a fusion module to integrate the three reinforced modalities, and a sentiment enhanced memory to enhance multimodal representation. Our experiments on two public datasets show that the proposed HMAI-BERT outperforms the state-of-the-art methods.