Fengqing Jiang

Fengqing Jiang

Auto-generated profile, based on publicly available information

Fengqing Jiang

University of Washington

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 January 2024
Verified
Conference Paper
Open access
PDF file
FJFengqing Jiang
Fengqing Jiang
ZXZhangchen Xu
Zhangchen Xu
LNLuyao Niu
Luyao Niu
ZXZhen Xiang
Zhen Xiang
BRBhaskar Ramasubramanian
Bhaskar Ramasubramanian
RPRadha Poovendran
Radha Poovendran
Fengqing Jiang, Zhangchen Xu, Luyao Niu, Zhen Xiang, Bhaskar Ramasubramanian, Bo Li, Radha Poovendran. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2024.

1 January 2024
Verified
Conference Paper
Open access
PDF file
ZXZhangchen Xu
Zhangchen Xu
FJFengqing Jiang
Fengqing Jiang
LNLuyao Niu
Luyao Niu
JJJinyuan Jia
Jinyuan Jia
BLBill Yuchen Lin
Bill Yuchen Lin
RPRadha Poovendran
Radha Poovendran
Zhangchen Xu, Fengqing Jiang, Luyao Niu, Jinyuan Jia, Bill Yuchen Lin, Radha Poovendran. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2024.

1 January 2025
Verified
Conference Paper
Open access
PDF file
FJFengqing Jiang
Fengqing Jiang
ZXZhangchen Xu
Zhangchen Xu
YLYuetai Li
Yuetai Li
LNLuyao Niu
Luyao Niu
ZXZhen Xiang
Zhen Xiang
RPRadha Poovendran
Radha Poovendran
Fengqing Jiang, Zhangchen Xu, Yuetai Li, Luyao Niu, Zhen Xiang, Bo Li, Bill Yuchen Lin, Radha Poovendran. Findings of the Association for Computational Linguistics: ACL 2025. 2025.

1 January 2025
Verified
Conference Paper
Open access
PDF file
YLYuetai Li
Yuetai Li
XYXiang Yue
Xiang Yue
ZXZhangchen Xu
Zhangchen Xu
FJFengqing Jiang
Fengqing Jiang
LNLuyao Niu
Luyao Niu
RPRadha Poovendran
Radha Poovendran
Yuetai Li, Xiang Yue, Zhangchen Xu, Fengqing Jiang, Luyao Niu, Bill Yuchen Lin, Bhaskar Ramasubramanian, Radha Poovendran. Findings of the Association for Computational Linguistics: ACL 2025. 2025.

1 January 2024
Verified
Conference Paper
Open access
PDF file
YLYuetai Li
Yuetai Li
ZXZhangchen Xu
Zhangchen Xu
FJFengqing Jiang
Fengqing Jiang
LNLuyao Niu
Luyao Niu
DSDinuka Sahabandu
Dinuka Sahabandu
RPRadha Poovendran
Radha Poovendran
Yuetai Li, Zhangchen Xu, Fengqing Jiang, Luyao Niu, Dinuka Sahabandu, Bhaskar Ramasubramanian, Radha Poovendran. Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing. 2024.

11 April 2025 in Proceedings of the AAAI Conference on Artificial Intelligence
Verified
Journal Article
Open access
PDF file
FJFengqing Jiang
Fengqing Jiang
ZXZhangchen Xu
Zhangchen Xu
LNLuyao Niu
Luyao Niu
BLBill Yuchen Lin
Bill Yuchen Lin
RPRadha Poovendran
Radha Poovendran
Large language models (LLMs) are expected to follow instructions from users and engage in conversations. Techniques to enhance LLMs' instruction-following capabilities typically fine-tune them using data structured according to a predefined chat template. Although chat templates are shown to be effective in optimizing LLM performance, their impact on safety alignment of LLMs has been less understood, which is crucial for deploying LLMs safely at scale. In this paper, we investigate how chat templates affect safety alignment of LLMs. We identify a common vulnerability, named ChatBug, that is introduced by chat templates. Our key insight to identify ChatBug is that the chat templates provide a rigid format that need to be followed by LLMs, but not by users. Hence, a malicious user may not necessarily follow the chat template when prompting LLMs. Instead, malicious users could leverage their knowledge of the chat template and accordingly craft their prompts to bypass safety alignments of LLMs. We study two attacks to exploit the ChatBug vulnerability. Additionally, we demonstrate that the success of multiple existing attacks can be attributed to the ChatBug vulnerability. We show that a malicious user can exploit the ChatBug vulnerability of eight state-of-the-art (SOTA) LLMs and effectively elicit unintended responses from these models. Moreover, we show that ChatBug can be exploited by existing jailbreak attacks to enhance their attack success rates. We investigate potential countermeasures to ChatBug. Our results show that while adversarial training effectively mitigates the ChatBug vulnerability, the victim model incurs significant performance degradation. These results highlight the trade-off between safety alignment and helpfulness. Developing new methods for instruction tuning to balance this trade-off is an open and critical direction for future research.