Houyu Zhang

Houyu Zhang

Auto-generated profile, based on publicly available information

Houyu Zhang

Amazon Search AI, Seattle, WA, USA

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
4 August 2023 in Proceedings of the Acm Sigkdd Conference on Knowledge Discovery and Data Mining
Verified
Conference Paper
Open access
HXHan Xie
Han Xie
DZDa Zheng
Da Zheng
JMJun Ma
Jun Ma
HZHouyu Zhang
Houyu Zhang
VIVassilis N. Ioannidis
Vassilis N. Ioannidis
TCTrishul Chilimbi
Trishul Chilimbi
Model pre-training on large text corpora has been demonstrated effective for various downstream applications in the NLP domain. In the graph mining domain, a similar analogy can be drawn for pre-training graph models on large graphs in the hope of benefiting downstream graph applications, which has also been explored by several recent studies. However, no existing study has ever investigated the pre-training of text plus graph models on large heterogeneous graphs with abundant textual information (a.k.a. large graph corpora) and then fine-tuning the model on different related downstream applications with different graph schemas. To address this problem, we propose a framework of graph-aware language model pre-training (GaLM) on a large graph corpus, which incorporates large language models and graph neural networks, and a variety of fine-tuning methods on downstream applications. We conduct extensive experiments on Amazon's real internal datasets and large public datasets. Comprehensive empirical results and in-depth analysis demonstrate the effectiveness of our proposed methods along with lessons learned.

24 August 2024
Verified
Conference Paper
Open access
DZDa Zheng
Da Zheng
XSXiang Song
Xiang Song
QZQi Zhu
Qi Zhu
JZJian Zhang
Jian Zhang
TVTheodore Vasiloudis
Theodore Vasiloudis
GKGeorge Karypis
George Karypis
Graph machine learning (GML) is effective in many business applications. However, making GML easy to use and applicable to industry applications with massive datasets remain challenging. We developed GraphStorm, which provides an end-to-end solution for scalable graph construction, graph model training and inference. GraphStorm has the following desirable properties: (a) Easy to use: it can perform graph construction and model training and inference with just a single command; (b) Expert-friendly: GraphStorm contains many advanced GML modeling techniques to handle complex graph data and improve model performance; (c) Scalable: every component in GraphStorm can operate on graphs with billions of nodes and can scale model training and inference to different hardware without changing any code. GraphStorm has been used and deployed for over a dozen billion-scale industry applications after its release in May 2023. It is open-sourced in Github: https://github.com/awslabs/graphstorm.