Jiaqing Liang

Jiaqing Liang

Auto-generated profile, based on publicly available information

Jiaqing Liang

Fudan University, Shanghai, China

Research Focus & Metrics

Academic Career Length

11Years (2016-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 January 2024
Verified
Conference Paper
Open access
PDF file
QHQianyu He
Qianyu He
JZJie Zeng
Jie Zeng
QHQianxi He
Qianxi He
JLJiaqing Liang
Jiaqing Liang
YXYanghua Xiao
Yanghua Xiao
Qianyu He, Jie Zeng, Qianxi He, Jiaqing Liang, Yanghua Xiao. Findings of the Association for Computational Linguistics: EMNLP 2024. 2024.

6 February 2024
Verified
Conference Paper
Open access
LMLipeng Ma
Lipeng Ma
WYWeidong Yang
Weidong Yang
BXBo Xu
Bo Xu
SJSihang Jiang
Sihang Jiang
BFBen Fei
Ben Fei
YXYanghua Xiao
Yanghua Xiao

1 January 2024
Verified
Conference Paper
Open access
PDF file
SYSiyu Yuan
Siyu Yuan
Jiangjie ChenJiangjie Chen
Jiangjie Chen
CSChangzhi Sun
Changzhi Sun
JLJiaqing Liang
Jiaqing Liang
YXYanghua Xiao
Yanghua Xiao
DYDeqing Yang
Deqing Yang
Siyu Yuan, Jiangjie Chen, Changzhi Sun, Jiaqing Liang, Yanghua Xiao, Deqing Yang. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2024.

24 March 2024 in Proceedings of the AAAI Conference on Artificial Intelligence
Verified
Journal Article
Open access
PDF file
QHQianyu He
Qianyu He
JZJie Zeng
Jie Zeng
WHWenhao Huang
Wenhao Huang
LCLina Chen
Lina Chen
JXJin Xiao
Jin Xiao
YXYanghua Xiao
Yanghua Xiao
Large language models (LLMs) can understand human instructions, showing their potential for pragmatic applications beyond traditional NLP tasks. However, they still struggle with complex instructions, which can be either complex task descriptions that require multiple tasks and constraints, or complex input that contains long context, noise, heterogeneous information and multi-turn format. Due to these features, LLMs often ignore semantic constraints from task descriptions, generate incorrect formats, violate length or sample count constraints, and be unfaithful to the input text. Existing benchmarks are insufficient to assess LLMs’ ability to understand complex instructions, as they are close-ended and simple. To bridge this gap, we propose CELLO, a benchmark for evaluating LLMs' ability to follow complex instructions systematically. We design eight features for complex instructions and construct a comprehensive evaluation dataset from real-world scenarios. We also establish four criteria and develop corresponding metrics, as current ones are inadequate, biased or too strict and coarse-grained. We compare the performance of representative Chinese-oriented and English-oriented models in following complex instructions through extensive experiments. Resources of CELLO are publicly available at https://github.com/Abbey4799/CELLO.

10 February 2022 in Knowledge-Based Systems
Verified
Journal Article
Closed access
LCLihan Chen
Lihan Chen
SJSihang Jiang
Sihang Jiang
JLJingping Liu
Jingping Liu
CWChao Wang
Chao Wang
SZSheng Zhang
Sheng Zhang
RSRui Song
Rui Song

1 January 2025
Verified
Conference Paper
Open access
PDF file
SXSirui Xia
Sirui Xia
XWXintao Wang
Xintao Wang
JLJiaqing Liang
Jiaqing Liang
YZYifei Zhang
Yifei Zhang
WZWeikang Zhou
Weikang Zhou
YXYanghua Xiao
Yanghua Xiao
Sirui Xia, Xintao Wang, Jiaqing Liang, Yifei Zhang, Weikang Zhou, Jiaji Deng, Fei Yu, Yanghua Xiao. Findings of the Association for Computational Linguistics: NAACL 2025. 2025.