Zhaoyu Xiong

Zhaoyu Xiong

Auto-generated profile, based on publicly available information

Zhaoyu Xiong

University of Siegen, 57072, Siegen, Germany

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
21 January 2025 in Computers in Biology and Medicine
Verified
Journal Article
Closed access
JQJiacheng Qin
Jiacheng Qin
DXDan Xu
Dan Xu
HZHao Zhang
Hao Zhang
ZXZhaoyu Xiong
Zhaoyu Xiong
YYYejing Yuan
Yejing Yuan
KHKangjian He
Kangjian He

19 December 2023 in Complex & Intelligent Systems
Verified
Journal Article
Open access
PDF file
HZHao Zhang
Hao Zhang
YLYanan Liu
Yanan Liu
ZXZhaoyu Xiong
Zhaoyu Xiong
ZWZhichao Wu
Zhichao Wu
DXDan Xu
Dan Xu
Visual sentiment analysis is in great demand as it provides a computational method to recognize sentiment information in abundant visual contents from social media sites. Most of existing methods use CNNs to extract varying visual attributes for image sentiment prediction, but they failed to comprehensively consider the correlation among visual components, and are limited by the receptive field of convolutional layers as a result. In this work, we propose a visual semantic correlation network VSCNet, a Transformer-based visual sentiment prediction model. Precisely, global visual features are captured through an extended attention network stacked by a well-designed extended attention mechanism like Transformer. An off-the-shelf object query tool is used to determine the local candidates of potential affective regions, by which redundant and noisy visual proposals are filtered out. All candidates considered affective are embedded into a computable semantic space. Finally, a fusion strategy integrates semantic representations and visual features for sentiment analysis. Extensive experiments reveal that our method outperforms previous studies on 5 annotated public image sentiment datasets without any training tricks. More specifically, it achieves 1.8% higher accuracy on FI benchmark compared with other state-of-the-art methods.

6 January 2023
Verified
Conference Paper
Open access
XHXiao Han
Xiao Han
HZHao Zhang
Hao Zhang
ZXZhaoyu Xiong
Zhaoyu Xiong
YLYanan Liu
Yanan Liu
KHKangjian He
Kangjian He
DXDan Xu
Dan Xu
Image emotion analysis aims to determine an author's attitude toward the overall contextual polarity of a topic or document. It is an instrumental but challenging task, especially when analyzing fine-grained emotions. Existing techniques based on convolutional neural networks learn affective representations from local visual features while ignoring that both the global semantics of images and objects impact emotional representation learning. To address this limitation, we propose a unique Coupling Dependent Attentive Model (CDA) for image emotion analysis. The model extracts image semantics through several residual blocks and transforms the semantic feature maps obtained from fully convolutional networks through spatial attention. It then implants a self-attention mechanism to mine the correlations between local visual features and achieve the final affective representation. Finally, considering the affective image, we proposed an automated image augmentation proxy to increase model generalization. Extensive experiments on six benchmark datasets show that the proposed model outperforms state-of-the-art methods in image emotion analysis.