Hairui Zhao

Hairui Zhao

Auto-generated profile, based on publicly available information

Hairui Zhao

Jilin University

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications

8 November 2024 in Future Generation Computer Systems
Verified
Journal Article
Closed access
HLHongliang Li
Hongliang Li
ZWZichen Wang
Zichen Wang
HZHairui Zhao
Hairui Zhao
MZMeng Zhang
Meng Zhang
XLXiang Li
Xiang Li
HXHaixiao Xu
Haixiao Xu


13 July 2026
Verified
Conference Paper
Open access
MLMan Liu
Man Liu
XLXingchen Liu
Xingchen Liu
XTXingjian Tian
Xingjian Tian
BLBing Lu
Bing Lu
SLShengkai Lyu
Shengkai Lyu
DTDingwen Tao
Dingwen Tao
Handling communication overhead in large-scale tensor-parallel training remains a critical challenge due to the dense, near-zero distributions of intermediate tensors, which exacerbate errors under frequent communication and introduce significant computational overhead during compression. To this end, we propose TACO (Tensor-parallel Adaptive COmmunication compression), a robust FP8-based framework for compressing TP intermediate tensors. First, we employ a data-driven reshaping strategy combined with an Adaptive Scale–Hadamard Transform to enable high-fidelity FP8 quantization, while its Dual-Scale Quantization mechanism ensures numerical stability throughout training. Second, we design a highly fused compression operator to reduce memory traffic and kernel launch overhead, allowing efficient overlap with communication. Finally, we integrate TACO with existing state-of-the-art methods for Data and Pipeline Parallelism to develop a compression-enabled 3D-parallel training framework. Detailed experiments on GPT models and Qwen model demonstrate up to 1.87 × end-to-end throughput improvement while maintaining near-lossless accuracy, validating the effectiveness and efficiency of TACO in large-scale training.

28 January 2026
Verified
Conference Paper
Open access
YGYida Gu
Yida Gu
FWFakang Wang
Fakang Wang
JFJianhao Fu
Jianhao Fu
ZSZhenhang Sun
Zhenhang Sun
QZQianyu Zhang
Qianyu Zhang
DTDingwen Tao
Dingwen Tao

27 February 2025 in Future Generation Computer Systems
Verified
Journal Article
Closed access
HLHongliang Li
Hongliang Li
QTQi Tian
Qi Tian
DXDong Xu
Dong Xu
HZHairui Zhao
Hairui Zhao
ZXZhewen Xu
Zhewen Xu