Zhengyan Zhang

Zhengyan Zhang

Auto-generated profile, based on publicly available information

Zhengyan Zhang

Department of Computer Science and Technology, Tsinghua University, Beijing, China

Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 January 2020 in AI Open
Verified
Journal Article
Open access
JZJie Zhou
Jie Zhou
GCGanqu Cui
Ganqu Cui
SHShengding Hu
Shengding Hu
ZZZhengyan Zhang
Zhengyan Zhang
CYCheng Yang
Cheng Yang
MSMaosong Sun
Maosong Sun

11 March 2021 in Transactions of the Association for Computational Linguistics
Verified
Journal Article
Open access
PDF file
XWXiaozhi Wang
Xiaozhi Wang
TGTianyu Gao
Tianyu Gao
ZZZhaocheng Zhu
Zhaocheng Zhu
ZZZhengyan Zhang
Zhengyan Zhang
ZLZhiyuan Liu
Zhiyuan Liu
JTJian Tang
Jian Tang
Pre-trained language representation models (PLMs) cannot well capture factual knowledge from text. In contrast, knowledge embedding (KE) methods can effectively represent the relational facts in knowledge graphs (KGs) with informative entity embeddings, but conventional KE models cannot take full advantage of the abundant textual information. In this paper, we propose a unified model for Knowledge Embedding and Pre-trained LanguagERepresentation (KEPLER), which can not only better integrate factual knowledge into PLMs but also produce effective text-enhanced KE with the strong PLMs. In KEPLER, we encode textual entity descriptions with a PLM as their embeddings, and then jointly optimize the KE and language modeling objectives. Experimental results show that KEPLER achieves state-of-the-art performances on various NLP tasks, and also works remarkably well as an inductive KE model on KG link prediction. Furthermore, for pre-training and evaluating KEPLER, we construct Wikidata5M 1 , a large-scale KG dataset with aligned entity descriptions, and benchmark state-of-the-art KE methods on it. It shall serve as a new KE benchmark and facilitate the research on large KG, inductive KE, and KG with text. The source code can be obtained from https://github.com/THU-KEG/KEPLER.

1 January 2024 in AI Open
Verified
Journal Article
Open access
YYYuan Yao
Yuan Yao
AZAo Zhang
Ao Zhang
ZZZhengyan Zhang
Zhengyan Zhang
ZLZhiyuan Liu
Zhiyuan Liu
TCTat-Seng Chua
Tat-Seng Chua
MSMaosong Sun
Maosong Sun

1 January 2021 in AI Open
Verified
Journal Article
Open access
ZZZhengyan Zhang
Zhengyan Zhang
YGYuxian Gu
Yuxian Gu
XHXu Han
Xu Han
SCShengqi Chen
Shengqi Chen
CXChaojun Xiao
Chaojun Xiao
MSMaosong Sun
Maosong Sun

1 January 2021 in AI Open
Verified
Journal Article
Open access
ZZZhengyan Zhang
Zhengyan Zhang
XHXu Han
Xu Han
HZHao Zhou
Hao Zhou
PKPei Ke
Pei Ke
YGYuxian Gu
Yuxian Gu
MSMaosong Sun
Maosong Sun

1 January 2022
Verified
Conference Paper
Open access
PDF file
XWXiaozhi Wang
Xiaozhi Wang
KWKaiyue Wen
Kaiyue Wen
ZZZhengyan Zhang
Zhengyan Zhang
LHLei Hou
Lei Hou
ZLZhiyuan Liu
Zhiyuan Liu
JLJuanzi Li
Juanzi Li
Xiaozhi Wang, Kaiyue Wen, Zhengyan Zhang, Lei Hou, Zhiyuan Liu, Juanzi Li. Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing. 2022.