Chao Li

Chao Li

Auto-generated profile, based on publicly available information

Chao Li

Shanghai Jiao Tong University, Shanghai, China

Research Focus & Metrics

Academic Career Length

12Years (2015-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 January 2022
Verified
Conference Paper
Open access
PDF file
LZLi Zhongli
Li Zhongli
WZWenxuan Zhang
Wenxuan Zhang
Chao YanChao Yan
Chao Yan
QZQingyu Zhou
Qingyu Zhou
CLChao Li
Chao Li
YCYunbo Cao
Yunbo Cao
Zhongli Li, Wenxuan Zhang, Chao Yan, Qingyu Zhou, Chao Li, Hongzhi Liu, Yunbo Cao. Findings of the Association for Computational Linguistics: ACL 2022. 2022.

22 February 2022
Verified
Conference Paper
Open access
ZLZihan Liu
Zihan Liu
JLJingwen Leng
Jingwen Leng
ZZZhihui Zhang
Zhihui Zhang
QCQuan Chen
Quan Chen
CLChao Li
Chao Li
MGMinyi Guo
Minyi Guo
Deep learning (DL) models have achieved great success in many application domains. As such, many industrial companies such as Google and Facebook have acknowledged the importance of multi-tenant DL services. Although the multi-tenant service has been studied in conventional workloads, it is not been deeply studied on deep learning service, especially on general-purpose hardware. In this work, we systematically analyze the opportunities and challenges of providing multi-tenant deep learning services on the general-purpose CPU architecture from the aspects of scheduling granularity and code generation. We propose an adaptive granularity scheduling scheme to both guarantee resource usage efficiency and reduce the scheduling conflict rate. We also propose an adaptive compilation strategy, by which we can dynamically and intelligently pick a program with proper exclusive and shared resource usage to reduce overall interference-induced performance loss. Compared to the existing works, our design can serve more requests under the same QoS target in various scenarios (e.g., +71%, +62%, +45% for light, medium, and heavy workloads, respectively), and reduce the averaged query latency by 50%.

21 April 2020 in IEEE Computer Architecture Letters
Verified
Journal Article
Closed access
ZZZhihui Zhang
Zhihui Zhang
JLJingwen Leng
Jingwen Leng
LMLingxiao Ma
Lingxiao Ma
YMYoushan Miao
Youshan Miao
CLChao Li
Chao Li
MGMinyi Guo
Minyi Guo
Graph neural networks (GNN) represent an emerging line of DNN algorithms that operate on graph structures. It is becoming more and more popular due to its high accuracy achieved in many graph-related tasks. However, GNN is not as well understood in the system and architecture community as its counterparts such as MLP and CNN. This work tries to introduce the GNN to our community by comprehensively evaluating and analyzing the computation of a set of representative GNN algorithms. The algorithms are selected based on a general GNN computation model and constructed on top of two widely-used GNN libraries. With comprehensive experiments, we make an analysis of GNN computation with respect to general-purpose and application-specific architectures and hope our work can foster more system and architecture research for GNNs.

9 March 2026 in ACM Computing Surveys
Verified
Journal Article
Open access
JLJiacheng Liu
Jiacheng Liu
PTPeng Tang
Peng Tang
WWWenfeng Wang
Wenfeng Wang
YRYuhang Ren
Yuhang Ren
XHXiaofeng Hou
Xiaofeng Hou
CLChao Li
Chao Li
The emergence of large-scale Mixture of Experts (MoE) models represents a significant advancement in artificial intelligence, offering larger model capacity and computational efficiency through conditional computation. However, deploying and running inference on these models presents significant challenges in computational resources, latency, and energy efficiency. This comprehensive survey analyzes optimization techniques for MoE models across the entire system stack. We first establish a taxonomical framework that categorizes optimization approaches into model-level, system-level, and hardware-level optimizations. At the model level, we examine architectural innovations including efficient expert design, attention mechanisms, various compression techniques such as pruning, quantization, and knowledge distillation, as well as algorithm improvement including dynamic routing strategies and expert merging methods. At the system level, we investigate distributed computing approaches, load balancing mechanisms, and efficient scheduling algorithms that enable scalable deployment. Furthermore, we delve into hardware-specific optimizations and co-design strategies that maximize throughput and energy efficiency. This survey provides both a structured overview of existing solutions and identifies key challenges and promising research directions in MoE inference optimization. To facilitate ongoing updates and the sharing of cutting-edge advances in MoE inference optimization research, we have established a repository accessible at https://github.com/MoE-Inf/awesome-moe-inference/ .

1 August 2019 in Proceedings of the VLDB Endowment
Verified
Journal Article
Open access
PDF file
YHYuzhen Huang
Yuzhen Huang
YSYingjie Shi
Yingjie Shi
ZZZheng Zhong
Zheng Zhong
YFYihui Feng
Yihui Feng
JCJames Cheng
James Cheng
JZJingren Zhou
Jingren Zhou
Companies like Alibaba operate tens of data centers (DCs) across geographically distributed locations. These DCs collectively provide the storage space and computing power for the company, storing EBs of data and serving millions of batch analytics jobs every day. In Alibaba, as our businesses grow, there are more and more cross-DC dependencies caused by jobs reading data from remote DCs. Consequently, the precious wide area network bandwidth becomes a major bottleneck for operating geo-distributed DCs at scale. In this paper, we present Yugong --- a system that manages data placement and job placement in Alibaba's geo-distributed DCs, with the objective to minimize cross-DC bandwidth usage. Yugong uses three methods, namely project placement, table replication, and job outsourcing, to address the issues of high bandwidth consumption across the DCs. We give the details of Yugong's design and implementation for the three methods, and describe how it cooperates with other systems (e.g., Alibaba's big data analytics platform and cluster scheduler) to improve the productivity of the DCs. We also report comprehensive performance evaluation results, which validate the design of Yugong and show that significant reduction in cross-DC bandwidth usage has been achieved.

7 June 2017 in IEEE Transactions on Parallel and Distributed Systems
Verified
Journal Article
Open access
LLLongjun Liu
Longjun Liu
HSHongbin Sun
Hongbin Sun
CLChao Li
Chao Li
TLTao Li
Tao Li
JXJingmin Xin
Jingmin Xin
NZNanning Zheng
Nanning Zheng
Energy storage devices (ESD), such as UPS batteries, have been repurposed in datacenter as a promising tuning knob for peak power shaving and power cost reducing. However, batteries progressively aging due to irregular usage patterns, which result in less effective capacity and even pose serious threat to server availability. Nevertheless, prior proposals largely ignore the aging issues of battery which may lead to low energy availability for datacenter servers. To fill this critical void, we thoroughly investigate battery aging on a heavily instrumented prototype system over an observation period of ten months. We propose Battery Anti-Aging Treatment Plus (BAAT-P), a novel power delivery architecture included aging management algorithms from the perspective of computing system to hide, reduce, mitigate and plan the battery aging effects for high energy availability in datacenter. Our techniques exploit diverse battery aging mechanisms and dynamic aging management algorithms to provide system-level availability guarantee for datacenter. We evaluate the BAAT-P design with a real prototype. Compared with a battery powered datacenter without aging management policies, the results show that BAAT-P can extend battery lifetime by 72 percent, reduce battery cost by 33 percent and effectively improve energy availability for datacenter servers while maintaining workload performance for the performance critical workloads.