Dong Zhang

Dong Zhang

Auto-generated profile, based on publicly available information

Dong Zhang

Inspur Data Technology Co, Ltd, Jinan, Shandong, China

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
20 November 2024
Verified
Conference Paper
Open access
QPQiangyu Pei
Qiangyu Pei
LWLin Wang
Lin Wang
DZDong Zhang
Dong Zhang
BYBingheng Yan
Bingheng Yan
YCYu Chen
Yu Chen
FLFangming Liu
Fangming Liu
The increasing power consumption of AI inference in modern datacenters has escalated cooling demands significantly, necessitating the adoption of potent cooling approaches like water cooling. Unlike traditional cloud workloads, AI inference has unique characteristics that create substantial gaps in achieving optimal cooling efficiency. In this work, we present the first comprehensive measurement study of AI inference cooling across various models within an industrial-ready scheduling framework, highlighting significant inefficiencies and their causes. To fill the gap while following the fundamental requirements of cooling systems, we explore a new opportunity presented by modern Multi-Instance GPU-enabled inference serving, where the scheduling dimension is naturally orthogonal to the cooling dimension. Building on this insight, we develop InferCool, a cooling middleware designed to enhance cooling efficiency for inference serving through transparent, non-intrusive task reassignment. It includes a streamlined power and temperature prediction approach and a thermal-aware, adaptive application deployment and request scheduling mechanism. Real-world experiments on a water-cooled testbed and a three-node cluster demonstrate that InferCool can reduce the maximum GPU temperature by 5°C across eight A100 GPUs, equivalent to cooling energy savings of about 20%. Importantly, InferCool requires no modifications to existing cooling infrastructures and is compatible with existing scheduling systems.

17 February 2025 in IEEE Transactions on Sustainable Computing
Verified
Journal Article
Closed access
QPQiangyu Pei
Qiangyu Pei
YYYongjie Yuan
Yongjie Yuan
HHHaichuan Hu
Haichuan Hu
LWLin Wang
Lin Wang
DZDong Zhang
Dong Zhang
FLFangming Liu
Fangming Liu
The proliferation of deep-learning-based mobile and IoT applications has driven the increasing deployment of edge datacenters equipped with domain-specific accelerators. The unprecedented computing power offered by these accelerators puts a heavy burden on the cooling system, motivating more potent cooling techniques like cold water cooling. However, we observe that cold water cooling results in significant energy waste in edge datacenters due to the fluctuating resource utilization both spatially and temporally. To tackle this issue, we propose the concept of “working smarter” by slowing down accelerators deliberately whenever possible and enabling warm water cooling during these times to achieve cooling efficiency. Based on this concept, we develop Hyco—a hybrid water cooling system tailored for edge datacenters running deep learning workloads. First, Hyco features a zone-based cooling architecture enabling dynamic switching between cold water and warm water cooling. Then, based on a lightweight latency estimation method, Hyco incorporates a learning-based scheduling scheme to determine “which” accelerator workers and “when” to slow down through an adaptive and intelligent power-latency trade-off for deep learning models. The simulation with real-world traces shows that Hyco reduces the cooling energy consumption by up to 34.74× while satisfying latency constraints more than 99% of the time for deep-learning-based applications.

26 July 2024
Verified
Conference Paper
Open access
YYYuhan Ye
Yuhan Ye
DZDong Zhang
Dong Zhang
GFGuo Feng
Guo Feng
Over the past few years, with the continuous maturity of cloud computing technology and the continuous expansion of application fields, more and more enterprises and institutions have begun to migrate their business and data to the container cloud platform. How to effectively predict the container workload has become the core issue to ensure the efficient use of cloud resources. Through accurate prediction, resource allocation can be optimized, thus improving service efficiency and cost-effectiveness. However, due to the large fluctuations in container workload, traditional prediction models often find it difficult to accurately capture the characteristics of its dynamic changes, thus accurately predicting container load in the cloud remains a significant challenge. In this paper, we introduced a patch-based convolutional neural network for predicting docker workload, which can capture both short-term and long-term dependencies in container resource time series. We used Alibaba cluster tracking to train our model and use MSE and MAE to evaluate our proposed method. The experiment results show that the PCNN model exhibits superior workload forecasting performance in comparison to commonly used workload forecasting models.

7 November 2026 in IEEE Transactions on Mobile Computing
Verified
Journal Article
Closed access
YZYunfeng Zhao
Yunfeng Zhao
Guoxian YuGuoxian Yu
Guoxian Yu
JWJun Wang
Jun Wang
LCLizhen Cui
Lizhen Cui
DWDong Wu
Dong Wu
CDCarlotta Domeniconi
Carlotta Domeniconi

14 January 2026 in IEEE Transactions on Computers
Verified
Journal Article
Closed access
FLFangming Liu
Fangming Liu
QPQiangyu Pei
Qiangyu Pei
SCShutong Chen
Shutong Chen
YYYongjie Yuan
Yongjie Yuan
QZQixia Zhang
Qixia Zhang
BYBingheng Yan
Bingheng Yan
As computing shifts toward the edge, edge datacenters are becoming essential for supporting diverse real-time applications. Unlike traditional cloud datacenters, edge datacenters face unique cooling challenges due to their requirements for proximity to end users, high density, and hardware heterogeneity. While warm water cooling is a promising technique for this infrastructure, current one-size-fits-all cooling strategies significantly compromise efficiency due to severe inter- and intra-component hotspots. In this work, we present CoolEdge${}^{+}$, a cost-effective component-level water cooling system for enhancing the cooling efficiency of edge datacenters. Specifically, CoolEdge${}^{+}$ dynamically adjusts the inlet water temperature for each component through a carefully designed water circulation architecture to mitigate inter-component hotspots. To address intra-component hotspots, it employs vapor chamber–based cold plates that rapidly dissipate heat without manual intervention or additional energy consumption. We further design a fine-grained cooling control framework that leverages a well-managed power capping approach to decide on customized inlet water temperatures and hardware power limits. Based on a hardware prototype and a real-world trace from Alibaba PAI, evaluation results show that CoolEdge${}^{+}$ reduces cooling energy consumption by up to 27.19% compared to existing coarse-grained systems, while maintaining performance guarantees. Compared to the state-of-the-art CoolEdge, CoolEdge${}^{+}$ saves 35.24% more cooling costs with comparable energy consumption and no latency violations.