Shuai Wang

Shuai Wang

Auto-generated profile, based on publicly available information

Shuai Wang

Zhongguancun Laboratory, Beijing, China

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
8 October 2021 in IEEE/ACM Transactions on Networking
Verified
Journal Article
Closed access
SWShuai Wang
Shuai Wang
Jinkun GengJinkun Geng
Jinkun Geng
DLDan Li
Dan Li
To tackle the increasingly larger training data and models, researchers and engineers resort to multiple servers in a data center for distributed machine learning (DML). On one hand, DML enables us to leverage the computation power of multiple servers, which can effectively accelerate those computation-intensive tasks. On the other hand, DML also incurs significant communication cost due to parameter synchronization among these servers. In this paper, we want to explore the impact of synchronization topology, including both logical topology and physical topology, on the DML performance. First, we revisit the existing logical topologies, e.g., parameter server and ring allreduce, for parameter synchronization, and we find that these flat synchronization topologies is inefficient when running a large-scale DML training. Therefore, we propose a hierarchical parameter synchronization topology, called HiPS, which can achieve efficient parameter synchronization even on a large scale. Then, we compare two representative physical network topologies, namely, Fat-Tree and BCube. Based on our analyses, BCube has many advantages over Fat-Tree, e.g., higher bandwidth, better load balance, and lower hardware cost. The simulation results also show that BCube is more friendly to RDMA. Relying on the advantages of HiPS and BCube, the GST of “HiPS+BCube” is 12% ~ 70% lower than other combinations. Moreover, when the cluster size increases from 16 to 1024, the performance of “HiPS+BCube” only drops by 6.5%, while the performance of “Ring+BCube” drops by 44.6%. Hence, we believe “HiPS+BCube” is the optimal solution to benefit DML in large scale.

29 June 2023
Verified
Conference Paper
Open access
XWXizheng Wang
Xizheng Wang
SWShuai Wang
Shuai Wang
DLDan Li
Dan Li

13 January 2023 in IEEE/ACM Transactions on Networking
Verified
Journal Article
Closed access
KGKaihui Gao
Kaihui Gao
SWShuai Wang
Shuai Wang
KQKun Qian
Kun Qian
DLDan Li
Dan Li
RMRui Miao
Rui Miao
TSTao Sun
Tao Sun
In modern multi-tenant data centers, each tenant desires reassuring dependability from the virtualized network fabric – bandwidth guarantee with work conservation, bounded tail latency and resilient reachability. However, the slow convergence of prior works under network dynamics and uncertainties can hardly provide the dependability for tenants. Further, state-of-the-art load balance schemes are guarantee-agnostic and bring great risks on breaking bandwidth guarantee, which is overlooked in prior works. In this paper, we propose, a dependable virtualized fabric framework which can (1) quickly detect network failure in data plane, (2) explicitly select proper paths for all flows, and (3) converge to ideal bandwidth allocation at sub-millisecond. The core idea of is to leverage the programmable data plane to build a fusion of an active edge (e.g., NIC) and an informative core (e.g., switch), where the core sends link status and tenant information to the edge via telemetry to help the latter make a timely and accurate decision on path selection and traffic admission. We fully implement with commodity SmartNICs and programmable switches. Extensive evaluations show that can keep bandwidth guarantee with high bandwidth utilization, low and bounded latency, and resilient reachability under various network scenarios with limited overhead. Application-level experiments show that can improve QPS by 2.4 $\times$ and cut tail latency by 10 $\times$ compared to the alternatives.


30 November 2025
Verified
Conference Paper
Open access
HPHannah B. Pasandi
Hannah B. Pasandi
SWShuai Wang
Shuai Wang