Yanduo Duan

Yanduo Duan

Auto-generated profile, based on publicly available information

Yanduo Duan

WaterDrop Inc., Beijing, China

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
18 January 2023 in IEEE Transactions on Emerging Topics in Computational Intelligence
Verified
Journal Article
Closed access
JWJianxiong Wan
Jianxiong Wan
YDYanduo Duan
Yanduo Duan
XGXiang Gui
Xiang Gui
CLChuyi Liu
Chuyi Liu
LLLeixiao Li
Leixiao Li
ZMZhiqiang Ma
Zhiqiang Ma
Optimizing the cooling system plays a central role for capping the data center power consumption. However, the performance of traditional cooling management strategies is not satisfactory due to the complexity of thermodynamic process. Recently, several works leveraged Reinforcement Learning (RL) to improve the energy efficiency of data center cooling system. While they demonstrated that it is possible to reduce the cooling power consumption via RL, there are still some key challenges that have to be addressed before field deployment, such as safe operation guarantee and sample complexity, etc. In this paper, we propose SafeCool , an actor-critic Model-Based Reinforcement Learning (MBRL) algorithm for data center cooling management. SafeCool incorporates two system models, i.e., a transition model to predict the future system state and a risk model to estimate the negative effect of executing an action. The safety of proposed algorithm is ensured by Model Predictive Control (MPC) and risk-guided exploration. In addition, by employing the MBRL framework, SafeCool achieves higher sample efficiency and accelerated convergence. Simulations using real-world workload trace reveal that SafeCool saves up to 13.18% cooling power compared with state-of-the-art MBRL data center cooling solutions.