Shuaiqiang Wang

Shuaiqiang Wang

Auto-generated profile, based on publicly available information

Shuaiqiang Wang

Baidu Inc., Beijing, China

Research Focus & Metrics

Academic Career Length

21Years (2006-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
22 February 2024 in ACM Transactions on Intelligent Systems and Technology
Verified
Journal Article
Open access
HZHaiyan Zhao
Haiyan Zhao
HCHanjie Chen
Hanjie Chen
FYFan Yang
Fan Yang
NLNinghao Liu
Ninghao Liu
HDHuiqi Deng
Huiqi Deng
MDMengnan Du
Mengnan Du
Large language models (LLMs) have demonstrated impressive capabilities in natural language processing. However, their internal mechanisms are still unclear and this lack of transparency poses unwanted risks for downstream applications. Therefore, understanding and explaining these models is crucial for elucidating their behaviors, limitations, and social impacts. In this article, we introduce a taxonomy of explainability techniques and provide a structured overview of methods for explaining Transformer-based language models. We categorize techniques based on the training paradigms of LLMs: traditional fine-tuning-based paradigm and prompting-based paradigm. For each paradigm, we summarize the goals and dominant approaches for generating local explanations of individual predictions and global explanations of overall model knowledge. We also discuss metrics for evaluating generated explanations and discuss how explanations can be leveraged to debug models and improve performance. Lastly, we examine key challenges and emerging opportunities for explanation techniques in the era of LLMs in comparison to conventional deep learning models.

1 November 2016 in Knowledge-Based Systems
Verified
Journal Article
Closed access
DKDenis Kotkov
Denis Kotkov
SWShuaiqiang Wang
Shuaiqiang Wang
JVJari Veijalainen
Jari Veijalainen

28 August 2024 in IEEE Transactions on Services Computing
Verified
Journal Article
Closed access
HXHaoyi Xiong
Haoyi Xiong
JBJiang Bian
Jiang Bian
YLYuchen Li
Yuchen Li
XLXuhong Li
Xuhong Li
MDMengnan Du
Mengnan Du
SHSumi Helal
Sumi Helal
Combining Large Language Models (LLMs) with search engine services marks a significant shift in the field of services computing, opening up new possibilities to enhance how we search for and retrieve information, understand content, and interact with internet services. This paper conducts an in-depth examination of how integrating LLMs with search engines can mutually benefit both technologies. We focus on two main areas: using search engines to improve LLMs (Search4LLM) and enhancing search engine functions using LLMs (LLM4Search). For Search4LLM, we investigate how search engines can provide diverse high-quality datasets for pre-training of LLMs, how they can use the most relevant documents to help LLMs learn to answer queries more accurately, how training LLMs with Learning-To-Rank (LTR) tasks can enhance their ability to respond with greater precision, and how incorporating recent search results can make LLM-generated content more accurate and current. In terms of LLM4Search, we examine how LLMs can be used to summarize content for better indexing by search engines, improve query outcomes through optimization, enhance the ranking of search results by analyzing document relevance, and help in annotating data for learning-to-rank tasks in various learning contexts. However, this promising integration comes with its challenges, which include addressing potential biases and ethical issues in training models, managing the computational and other costs of incorporating LLMs into search services, and continuously updating LLM training with the ever-changing web content. We discuss these challenges and chart out required research directions to address them. We also discuss broader implications for service computing, such as scalability, privacy concerns, and the need to adapt search engine architectures for these advanced models.

1 December 2014 in Neurocomputing
Verified
Journal Article
Closed access
FLFei Liu
Fei Liu
Gongping YangGongping Yang
Gongping Yang
YYYilong Yin
Yilong Yin
SWShuaiqiang Wang
Shuaiqiang Wang

1 January 2025
Verified
Conference Paper
Open access
PDF file
SWShijie Wang
Shijie Wang
WFWenqi Fan
Wenqi Fan
YFYue Feng
Yue Feng
LSLin Shanru
Lin Shanru
XMXinyu Ma
Xinyu Ma
DYDawei Yin
Dawei Yin
Shijie Wang, Wenqi Fan, Yue Feng, Lin Shanru, Xinyu Ma, Shuaiqiang Wang, Dawei Yin. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2025.

1 January 2024
Verified
Conference Paper
Open access
PDF file
JRJie Ren
Jie Ren
HXHan Xu
Han Xu
YLYiding Liu
Yiding Liu
YCYingqian Cui
Yingqian Cui
SWShuaiqiang Wang
Shuaiqiang Wang
JTJiliang Tang
Jiliang Tang
Jie Ren, Han Xu, Yiding Liu, Yingqian Cui, Shuaiqiang Wang, Dawei Yin, Jiliang Tang. Findings of the Association for Computational Linguistics: NAACL 2024. 2024.