Xin Cong

Xin Cong

Auto-generated profile, based on publicly available information

Xin Cong

Department of Statistics and Data Science, Tsinghua University, Beijing, China

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
24 December 2024 in ACM Computing Surveys
Verified
Journal Article
Open access
YQYujia Qin
Yujia Qin
SHShengding Hu
Shengding Hu
YLYankai Lin
Yankai Lin
WCWeize Chen
Weize Chen
NDNing Ding
Ning Ding
MSMaosong Sun
Maosong Sun
Humans possess an extraordinary ability to create and utilize tools. With the advent of foundation models, artificial intelligence systems have the potential to be equally adept in tool use as humans. This paradigm, which is dubbed as tool learning with foundation models , combines the strengths of tools and foundation models to achieve enhanced accuracy, efficiency, and automation in problem-solving. This article presents a systematic investigation and comprehensive review of tool learning. We first introduce the background of tool learning, including its cognitive origins, the paradigm shift of foundation models, and the complementary roles of tools and models. Then we recapitulate existing tool learning research and formulate a general framework: starting from understanding the user instruction, models should learn to decompose a complex task into several subtasks, dynamically adjust their plan through reasoning, and effectively conquer each sub-task by selecting appropriate tools. We also discuss how to train models for improved tool-use capabilities and facilitate generalization in tool learning. Finally, we discuss several open problems that require further investigation, such as ensuring trustworthy tool use, enabling tool creation with foundation models, and addressing personalization challenges. Overall, we hope this article could inspire future research in integrating tools with foundation models.

24 January 2024 in IEEE/ACM Transactions on Audio, Speech, and Language Processing
Verified
Journal Article
Closed access
SCShiyao Cui
Shiyao Cui
JCJiangxia Cao
Jiangxia Cao
XCXin Cong
Xin Cong
JSJiawei Sheng
Jiawei Sheng
QLQuangang Li
Quangang Li
JSJinqiao Shi
Jinqiao Shi
This paper studies the multimodal named entity recognition (MNER) and multimodal relation extraction (MRE), which are important for content analysis and various applications. The core of MNER and MRE lies in incorporating evident visual information to enhance textual semantics, where two issues inherently demand investigations. The first issue is modality-noise, where the task-irrelevant information in each modality may be noises misleading the task prediction. The second issue is modality-gap, where representations from different modalities are inconsistent, preventing from building the semantic alignment between the text and image. To address these issues, we propose a novel method for MNER and MRE by M ulti M odal representation learning with I nformation B ottleneck (MMIB). For the first issue, a refinement-regularizer probes the information-bottleneck principle to balance the predictive evidence and noisy information, yielding expressive representations for prediction. For the second issue, an alignment-regularizer is proposed, where a mutual information-based item works in a contrastive manner to regularize the consistent text-image representations. To our best knowledge, we are the first to explore variational IB estimation for MNER and MRE. Experiments show that MMIB achieves the state-of-the-art performances on three public benchmarks.

30 January 2024 in Journal of Computer Science and Technology
Verified
Journal Article
Closed access
PDF file
SCShi-Yao Cui
Shi-Yao Cui
BYBo-Wen Yu
Bo-Wen Yu
XCXin Cong
Xin Cong
TLTing-Wen Liu
Ting-Wen Liu
QTQingfeng Tan
Qingfeng Tan
JSJin-Qiao Shi
Jin-Qiao Shi

13 May 2024 in ACM Transactions on Information Systems
Verified
Journal Article
Open access
XZXinghua Zhang
Xinghua Zhang
BYBowen Yu
Bowen Yu
XCXin Cong
Xin Cong
TSTaoyu Su
Taoyu Su
QLQuangang Li
Quangang Li
HXHongbo Xu
Hongbo Xu
Cross-domain Named Entity Recognition (NER) transfers knowledge learned from a rich-resource source domain to improve the learning in a low-resource target domain. Most existing works are designed based on the sequence labeling framework, defining entity detection and type prediction as a monolithic process. However, they typically ignore the discrepant transferability of these two sub-tasks: the former locating spans corresponding to entities is largely domain-robust, whereas the latter owns distinct entity types across domains. Combining them into an entangled learning problem may contribute to the complexity of domain transfer. In this work, we propose the novel divide-and-transfer paradigm in which different sub-tasks are learned using separate functional modules for respective cross-domain transfer. To demonstrate the effectiveness of divide-and-transfer, we concretely implement two NER frameworks by applying this paradigm with different cross-domain transfer strategies. Experimental results on 10 different domain pairs show the notable superiority of our proposed frameworks. Experimental analyses indicate that significant advantages of the divide-and-transfer paradigm over prior monolithic ones originate from its better performance on low-resource data and a much greater transferability. It gives us a new insight into cross-domain NER. Our code is available on GitHub. 1

8 August 2026
Verified
Conference Paper
Open access
WCWentong Chen
Wentong Chen
XCXin Cong
Xin Cong
ZZZhong Zhang
Zhong Zhang
YLYaxi Lu
Yaxi Lu
SZSiyuan Zhao
Siyuan Zhao
MSMaosong Sun
Maosong Sun

8 August 2026
Verified
Conference Paper
Open access
SFShengda Fan
Shengda Fan
XYXuyan Ye
Xuyan Ye
YHYupeng Huo
Yupeng Huo
ZCZhi-Yuan Chen
Zhi-Yuan Chen
YGYiju Guo
Yiju Guo
YLYankai Lin
Yankai Lin