Huizhi Yang

Huizhi Yang

Auto-generated profile, based on publicly available information

Huizhi Yang

Bytedance, Beijing, China

Research Focus & Metrics

Academic Career Length

2Years (2025-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
10 November 2025
Verified
Conference Paper
Open access
JZJie Zhu
Jie Zhu
ZFZhifang Fan
Zhifang Fan
XZXiaoxie Zhu
Xiaoxie Zhu
YJYuchen Jiang
Yuchen Jiang
HWHangyu Wang
Hangyu Wang
ZLZuotao Liu
Zuotao Liu

22 September 2025
Verified
Conference Paper
Open access
ZCZheng Chai
Zheng Chai
QRQin Ren
Qin Ren
XXXijun Xiao
Xijun Xiao
HYHuizhi Yang
Huizhi Yang
BHBo Han
Bo Han
DWDi Wu
Di Wu

8 August 2026
Verified
Conference Paper
Open access
YJYuchen Jiang
Yuchen Jiang
JZJie Zhu
Jie Zhu
XHXintian Han
Xintian Han
HLHui Lu
Hui Lu
KBKunmin Bai
Kunmin Bai
PXPeng Xu
Peng Xu
While scaling laws for recommendation models have gained significant traction, existing architectures such as Wukong, HiFormer, and DHEN often struggle with sub-optimal designs and hardware under-utilization, limiting their practical scalability. Our previous TokenMixer architecture (introduced in the RankMixer paper) balanced effectiveness and efficiency by replacing self-attention with a lightweight token mixing operator; however, it encountered critical bottlenecks in deeper configurations, including sub-optimal residual paths, vanishing gradients, incomplete MoE sparsification, and constrained scalability. In this paper, we propose TokenMixer-Large, a systematically evolved architecture designed for extreme-scale recommendation. By introducing a mixing-and-reverting operation, inter-layer residuals, and an auxiliary loss, we ensure stable gradient propagation as model depth increases. Furthermore, we incorporate a Sparse Per-token MoE to enable efficient parameter expansion. TokenMixer-Large successfully scales to 7 billion parameters for online traffic and 15 billion in offline experiments. Currently deployed in multiple scenarios at ByteDance, TokenMixer-Large has achieved substantial performance gains: delivering a 1.66% increase in orders and a 2.98% boost in per-capita preview payment GMV for e-commerce; improving ADSS by 2.0% in advertising; and achieving 1.4% revenue growth in live streaming.