Xiao Liu

Xiao Liu

Auto-generated profile, based on publicly available information

Xiao Liu

Microsoft Research

Research Focus & Metrics

Academic Career Length

10Years (2017-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
11 April 2025 in Proceedings of the AAAI Conference on Artificial Intelligence
Verified
Journal Article
Open access
PDF file
YHYiming Huang
Yiming Huang
XLXiao Liu
Xiao Liu
YGYeyun Gong
Yeyun Gong
ZGZhibin Gou
Zhibin Gou
YSYelong Shen
Yelong Shen
WCWeizhu Chen
Weizhu Chen
Large language models have shown great potential in complex reasoning tasks, yet their performance is often hampered by the scarcity of high-quality and reasoning-focused training datasets. Addressing this challenge, we propose Key-PointDriven Data Synthesis (KPDDS), a novel data synthesis framework that synthesizes question-answer pairs by leveraging key points and exemplar practices from authentic data sources. KPDDS ensures the generation of novel questions with rigorous quality control and substantial scalability. As a result, we present KPMath, an extensive synthetic dataset tailored for mathematical reasoning, comprising over 800K questionanswer pairs. Utilizing KPMath and augmenting it with additional reasoning-intensive corpora, we create the comprehensive KPMath-Plus dataset. Our experiments demonstrate that this dataset can enhance the mathematical reasoning performance of models across various architectures and sizes. The Qwen1.5-72B model, fine-tuned on KPMath-Plus, achieves 87.0% accuracy on GSM8K and 58.3% on MATH, surpassing competitors in the 7B to 72B range and best commercial models like GPT-4 across multiple math reasoning datasets.

1 January 2024
Verified
Conference Paper
Open access
PDF file
YHYiming Huang
Yiming Huang
ZLZhenghao Lin
Zhenghao Lin
XLXiao Liu
Xiao Liu
YGYeyun Gong
Yeyun Gong
SLShuai Lu
Shuai Lu
WCWeizhu Chen
Weizhu Chen
Yiming Huang, Zhenghao Lin, Xiao Liu, Yeyun Gong, Shuai Lu, Fangyu Lei, Yaobo Liang, Yelong Shen, Chen Lin, Nan Duan, Weizhu Chen. Findings of the Association for Computational Linguistics ACL 2024. 2024.

30 April 2023
Verified
Conference Paper
Open access
ZLZhenghao Lin
Zhenghao Lin
YGYeyun Gong
Yeyun Gong
XLXiao Liu
Xiao Liu
HZHang Zhang
Hang Zhang
CLChen Lin
Chen Lin
NDNan Duan
Nan Duan
Knowledge distillation is an effective way to transfer knowledge from a strong teacher to an efficient student model. Ideally, we expect the better the teacher is, the better the student performs. However, this expectation does not always come true. It is common that a strong teacher model results in a bad student via distillation due to the nonnegligible gap between teacher and student. To bridge the gap, we propose PROD, a PROgressive Distillation method, for dense retrieval. PROD consists of a teacher progressive distillation and a data progressive distillation to gradually improve the student. To alleviate catastrophic forgetting, we introduce a regularization term in each distillation process. We conduct extensive experiments on seven datasets including five widely-used publicly available benchmarks: MS MARCO Passage, TREC Passage 19, TREC Document 19, MS MARCO Document, and Natural Questions, as well as two industry datasets: Bing-Rel and Bing-Ads. PROD achieves the state-of-the-art in the distillation methods for dense retrieval. Our 6-layer student model even surpasses most of the existing 12-layer models on all five public benchmarks. The code and models are released in https://github.com/microsoft/SimXNS.

12 April 2023 in IEEE Transactions on Knowledge and Data Engineering
Verified
Journal Article
Closed access
HHHeyan Huang
Heyan Huang
XLXiao Liu
Xiao Liu
GSGe Shi
Ge Shi
QLQian Liu
Qian Liu
We consider event extraction in a generative manner with template-based conditional generation. Although there is a rising trend of casting the task of event extraction as a sequence generation problem with prompts, these generation-based methods have several significant challenges, including using suboptimal prompts, static event type information, and the overwhelming number of irrelevant event types. In this article, we propose a generative template-based method with dynamic prefixes and a relevance retrieval framework for event extraction ( GREE ) by first integrating context information with type-specific prefixes to learn a context-specific prefix for each context, and then retrieving the relevant event types with an adaptive threshold. Experimental results show that our model achieves competitive results with the state-of-the-art classification-based model OneIE on ACE 2005 and achieves the best performances on ERE. Additionally, our model is proven to be portable to new types of events effectively.

17 September 2023
Verified
Book Chapter
Closed access
PDF file
KZKun Zhou
Kun Zhou
XLXiao Liu
Xiao Liu
YGYeyun Gong
Yeyun Gong
WZWayne Xin Zhao
Wayne Xin Zhao
DJDaxin Jiang
Daxin Jiang
JWJi-Rong Wen
Ji-Rong Wen