Xiaokai Chu

Xiaokai Chu

Auto-generated profile, based on publicly available information

Xiaokai Chu

Baidu Inc., Shanghai, USA

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
20 December 2022 in ACM Transactions on the Web
Verified
Journal Article
Open access
LZLixin Zou
Lixin Zou
WLWeixue Lu
Weixue Lu
YLYiding Liu
Yiding Liu
HCHengyi Cai
Hengyi Cai
XCXiaokai Chu
Xiaokai Chu
DYDawei Yin
Dawei Yin
Pre-trained language representation models (PLMs) such as BERT and Enhanced Representation through kNowledge IntEgration (ERNIE) have been integral to achieving recent improvements on various downstream tasks, including information retrieval. However, it is nontrivial to directly utilize these models for the large-scale web search due to the following challenging issues: (1) the prohibitively expensive computations of massive neural PLMs, especially for long texts in the web document, prohibit their deployments in the web search system that demands extremely low latency; (2) the discrepancy between existing task-agnostic pre-training objectives and the ad hoc retrieval scenarios that demand comprehensive relevance modeling is another main barrier for improving the online retrieval and ranking effectiveness; and (3) to create a significant impact on real-world applications, it also calls for practical solutions to seamlessly interweave the resultant PLM and other components into a cooperative system to serve web-scale data. Accordingly, we contribute a series of successfully applied techniques in tackling these exposed issues in this work when deploying the state-of-the-art Chinese pre-trained language model, i.e., ERNIE, in the online search engine system. We first present novel practices to perform expressive PLM-based semantic retrieval with a flexible poly-interaction scheme and cost-efficiently contextualize and rank web documents with a cheap yet powerful Pyramid-ERNIE architecture. We then endow innovative pre-training and fine-tuning paradigms to explicitly incentivize the query-document relevance modeling in PLM-based retrieval and ranking with the large-scale noisy and biased post-click behavioral data. We also introduce a series of effective strategies to seamlessly interwoven the designed PLM-based models with other conventional components into a cooperative system. Extensive offline and online experimental results show that our proposed techniques are crucial to achieving more effective search performance. We also provide a thorough analysis of our methodology and experimental results.

13 May 2024
Verified
Conference Paper
Open access
HMHaitao Mao
Haitao Mao
LZLixin Zou
Lixin Zou
YZYujia Zheng
Yujia Zheng
JTJiliang Tang
Jiliang Tang
XCXiaokai Chu
Xiaokai Chu
DYDawei Yin
Dawei Yin