Qiqi Wang

Dr. Qiqi Wang

orcid

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
12 October 2021 in Applied Sciences
Verified
Journal Article
Open access
PDF file
QWQiqi Wang
Qiqi Wang
Hongjie ZhangHongjie Zhang
Hongjie Zhang
CQCheng Qu
Cheng Qu
YSYu Shen
Yu Shen
XLXiaohui Liu
Xiaohui Liu
JLJing Li
Jing Li
The job scheduler plays a vital role in high-performance computing platforms. It determines the execution order of the jobs and the allocation of resources, which in turn affect the resource utilization of the entire system. As the scale and complexity of HPC continue to grow, job scheduling is becoming increasingly important and difficult. Existing studies relied on user-specified or regression techniques to give fixed runtime prediction values and used the values in static heuristic scheduling algorithms. However, these approaches require very accurate runtime predictions to produce better results, and fixed heuristic scheduling strategies cannot adapt to changes in the workload. In this work, we propose RLSchert, a job scheduler based on deep reinforcement learning and remaining runtime prediction. Firstly, RLSchert estimates the state of the system by using a dynamic job remaining runtime predictor, thereby providing an accurate spatiotemporal view of the cluster status. Secondly, RLSchert learns the optimal policy to select or kill jobs according to the status through imitation learning and the proximal policy optimization algorithm. Extensive experiments on real-world job logs at the USTC Supercomputing Center showed that RLSchert is superior to static heuristic policies and outperforms the learning-based scheduler DeepRM. In addition, the dynamic predictor gives a more accurate remaining runtime prediction result, which is essential for most learning-based schedulers.

8 June 2022 in The Journal of Supercomputing
Verified
Journal Article
Closed access
PDF file
QWQiqi Wang
Qiqi Wang
Hongjie ZhangHongjie Zhang
Hongjie Zhang
JLJing Li
Jing Li
YSYu Shen
Yu Shen
XLXiaohui Liu
Xiaohui Liu