Sai Jayesh Bondu

Sai Jayesh Bondu

Auto-generated profile, based on publicly available information

Sai Jayesh Bondu

Meta, Menlo Park, CA, USA

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
4 August 2024
Verified
Conference Paper
Open access
AGAdithya Gangidi
Adithya Gangidi
RMRui Miao
Rui Miao
SZShengbao Zheng
Shengbao Zheng
SBSai Jayesh Bondu
Sai Jayesh Bondu
GGGuilherme Goes
Guilherme Goes
HZHongyi Zeng
Hongyi Zeng
The rapid growth in both computational density and scale in AI models in recent years motivates the construction of an efficient and reliable dedicated network infrastructure. This paper presents the design, implementation, and operation of Meta's Remote Direct Memory Access over Converged Ethernet (RoCE) networks for distributed AI training. Our design principles involve a deep understanding of the workloads, and we translated these insights into the design of various network components: Network Topology - To support the rapid evolution of generations of AI hardware platforms, we separated GPU-based training into its own "backend" network. Routing - Training workloads inherently impose load imbalance and burstiness, so we deployed several iterations of routing schemes to achieve near-optimal traffic distribution. Transport - We outline how we initially attempted to use DCQCN for congestion management but then pivoted away from DCQCN to instead leverage the collective library itself to manage congestion. Operations - We share our experience operating large-scale AI networks, including toolings we developed and troubleshooting examples.