Chaoyang Shui

Chaoyang Shui

Auto-generated profile, based on publicly available information

Chaoyang Shui

Institute of Computing Technology, Chinese Academy of Sciences, China and University of Chinese Academy of Sciences, China

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
22 March 2021 in IEEE Transactions on Parallel and Distributed Systems
Verified
Journal Article
Closed access
GTGuangming Tan
Guangming Tan
CSChaoyang Shui
Chaoyang Shui
YWYinshan Wang
Yinshan Wang
XYXianzhi Yu
Xianzhi Yu
YYYujin Yan
Yujin Yan
There is a widening gap between GPU and other components (CPU, PCIe bus and communication network) in heterogeneous parallel system. The gap forces us to orchestrate cooperative execution among these components much more carefully than ever before. By taking the LINPACK benchmark as a case study, this article proposes a fine-grained pipelining algorithm on large-scale CPU-GPU heterogeneous cluster systems. First, we build an algorithmic model that reveals a new approach to GPU-centric and fine-grained pipelining algorithm design. Then, we present four model-driven pipelining algorithms that incrementally squeeze bubbles in the pipeline so that it is occupied by more useful floating-point calculations. The algorithms are implemented on both the AMD and NVIDIA GPU platforms. The finally optimized LINPACK program achieves 107 PFlops on 25, 600 GPUs (70 percent floating-point efficiency). Several insights have been drawn to suggest tradeoff of algorithm design, programming support, and architecture design.

20 February 2024
Verified
Conference Paper
Open access
ZLZhiheng Lin
Zhiheng Lin
KMKe Meng
Ke Meng
CSChaoyang Shui
Chaoyang Shui
KZKewei Zhang
Kewei Zhang
JXJunmin Xiao
Junmin Xiao
GTGuangming Tan
Guangming Tan

30 May 2024
Verified
Conference Paper
Open access
MLMingyi Li
Mingyi Li
JXJunmin Xiao
Junmin Xiao
KZKewei Zhang
Kewei Zhang
ZLZhiheng Lin
Zhiheng Lin
CSChaoyang Shui
Chaoyang Shui
GTGuangming Tan
Guangming Tan
Graph Neural Networks (GNNs) have garnered significant interest across various domains due to their efficacy in learning from graph-structured data. In pursuit of heightened performance, numerous GNN frameworks have emerged recently. However, recent work tends to study performance optimization at the computational graph level and operator level separately, and the existing optimization techniques rely on pattern matching and manual intervention, driven by human expertise. Consequently, their performances remain sub-optimal and sensitive to input graphs and GNN models. In this work, we develop an efficient coordinated strategy named AlphaGNN, which achieves an effective combination of computational graph optimization and operator optimization. To render this coordinated optimization impactful, a rule-based computational graph optimization and a performance-driven operator optimization are proposed. The experimental results confirm that AlphaGNN achieves up to 12.39 × (2.94 × on average) performance improvement over the state-of-the-art methods on diverse GNN models.

11 November 2023
Verified
Conference Paper
Open access
JXJunmin Xiao
Junmin Xiao
CSChaoyang Shui
Chaoyang Shui
DCDi Cai
Di Cai
KWKangyu Wang
Kangyu Wang
YPYunfei Pang
Yunfei Pang
GTGuangming Tan
Guangming Tan
Global ocean data assimilation is a crucial technique to estimate the actual oceanic state by combining numerical model outcomes and observation data, which is widely used in climate research. Due to the imbalanced distribution of observation data in global ocean, the parallel efficiency of recent methods suffers from workload imbalance. When massive GPUs are applied for global ocean data assimilation, the workload imbalance becomes more severe, resulting in poor scalability. In this work, we propose a novel adaptive workload-balance scheduling strategy, Bassimilation, which successfully estimates the total workload prior to execution and ensures a balanced workload assignment. Further, we design a parallel dynamic programming approach to accelerate the schedule decision, and develop a factored dataflow to exploit the parallel potential of GPUs. Evaluation demonstrates that our algorithm outperforms the state-of-the-art method by up to 9.1× speedup. This work is the first to scale global ocean data assimilation to 4, 000 GPUs.