Shiyao Cui

Shiyao Cui

Auto-generated profile, based on publicly available information

Shiyao Cui

The Conversational AI (CoAI) group, DCST, Tsinghua University, Beijing, China

Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 May 2024 in IEEE Transactions on Neural Networks and Learning Systems
Verified
Journal Article
Closed access
QLQian Li
Qian Li
JLJianxin Li
Jianxin Li
JSJiawei Sheng
Jiawei Sheng
SCShiyao Cui
Shiyao Cui
Jia WUJia WU
Jia WU
PYPhilip S. Yu
Philip S. Yu

24 January 2024 in IEEE/ACM Transactions on Audio, Speech, and Language Processing
Verified
Journal Article
Closed access
SCShiyao Cui
Shiyao Cui
JCJiangxia Cao
Jiangxia Cao
XCXin Cong
Xin Cong
JSJiawei Sheng
Jiawei Sheng
QLQuangang Li
Quangang Li
JSJinqiao Shi
Jinqiao Shi
This paper studies the multimodal named entity recognition (MNER) and multimodal relation extraction (MRE), which are important for content analysis and various applications. The core of MNER and MRE lies in incorporating evident visual information to enhance textual semantics, where two issues inherently demand investigations. The first issue is modality-noise, where the task-irrelevant information in each modality may be noises misleading the task prediction. The second issue is modality-gap, where representations from different modalities are inconsistent, preventing from building the semantic alignment between the text and image. To address these issues, we propose a novel method for MNER and MRE by M ulti M odal representation learning with I nformation B ottleneck (MMIB). For the first issue, a refinement-regularizer probes the information-bottleneck principle to balance the predictive evidence and noisy information, yielding expressive representations for prediction. For the second issue, an alignment-regularizer is proposed, where a mutual information-based item works in a contrastive manner to regularize the consistent text-image representations. To our best knowledge, we are the first to explore variational IB estimation for MNER and MRE. Experiments show that MMIB achieves the state-of-the-art performances on three public benchmarks.


27 October 2025
Verified
Conference Paper
Open access
RCRenmiao Chen
Renmiao Chen
SCShiyao Cui
Shiyao Cui
XHXuancheng Huang
Xuancheng Huang
CPChengwei Pan
Chengwei Pan
VHVictor Shea-Jay Huang
Victor Shea-Jay Huang
MHMinlie Huang
Minlie Huang

10 July 2024
Verified
Conference Paper
Open access
XZXinghua Zhang
Xinghua Zhang
GCGaode Chen
Gaode Chen
SCShiyao Cui
Shiyao Cui
JSJiawei Sheng
Jiawei Sheng
TLTingwen Liu
Tingwen Liu
HXHongbo Xu
Hongbo Xu
Low-resource Complex Named Entity Recognition aims to detect entities with the form of any linguistic constituent under scenarios with limited manually annotated data. Existing studies augment the text through the substitution of same type entities or language modeling, but suffer from the lower quality and the limited entity context patterns within low-resource corpora. In this paper, we propose a novel data augmentation method E2DA from both exogenous and endogenous perspectives. As for exogenous augmentation, we treat the limited manually annotated data as anchors, and leverage the powerful instruction-following capabilities of Large Language Models (LLMs) to expand the anchors by generating data that are highly dissimilar from the original anchor texts in terms of entity mentions and contexts. As regards the endogenous augmentation, we explore diverse semantic directions in the implicit feature space of the original and expanded anchors for effective data augmentation. Our complementary augmentation method from two perspectives not only continuously expands the global text-level space, but also fully explores the local semantic space for more diverse data augmentation. Extensive experiments on 10 diverse datasets across various low-resource settings demonstrate that the proposed method excels significantly over prior state-of-the-art data augmentation methods.

30 January 2024 in Journal of Computer Science and Technology
Verified
Journal Article
Closed access
PDF file
SCShi-Yao Cui
Shi-Yao Cui
BYBo-Wen Yu
Bo-Wen Yu
XCXin Cong
Xin Cong
TLTing-Wen Liu
Ting-Wen Liu
QTQingfeng Tan
Qingfeng Tan
JSJin-Qiao Shi
Jin-Qiao Shi