Deep learning (DL) has become essential across various computer science domains. Accurately predicting iteration time for DL models in diverse cloud data center environments is critical for making high-quality scheduling decisions. Existing approaches neglect the sequential features inherent in the runtime execution, leading to issues such as overlooking DL framework overhead and struggling to handle diverse sizes of DL models, resulting in either low accuracy or slow convergence of the prediction model. This paper introduces ETS, a novel iteration time prediction method utilizing execution trace sliding windows. Our observation reveals that DL models exhibit a highly sequential runtime execution nature. Building upon this insight, we leverage sliding windows to extract a novel type of sequential features from the runtime execution trace. These features comprehensively capture DL framework overhead and address the diversity challenge in DL model sizes. By combining a best-practice method to train a prediction model, we achieve high accuracy and rapid convergence simultaneously. Experimental validation on over 14,000 DL model configurations demonstrates ETS's effectiveness in predicting the iteration time of DL models, achieving a mere 5.9% prediction error with a training time at the 10-minute level, and improving scheduling outcomes by reducing job completion time by 17%.
JointCloud gives developers the freedom to create applications that are portable across multiple clouds (e.g., Amazon EC2, Aliyun ECS). However, any modification in a vendor-lock API will make JointCloud unusable due to the problem of API synchronization. We assume that adapter flows should be decoupled from the manners in which they are executed. To verify this idea, we built Wukong, a framework that can dynamically map front-end adapter flows' descriptions to a broad range of back-end clouds by the generic APIs. Generic APIs for VM services have been proposed to evaluate our Wukong framework. The experimental results have shown three contributions: (1) the overhead of reflection is acceptable when WuKong generates the generic APIs, (2) the feasibility of Wukong has been verified by the major cloud vendor-lock APIs, (3) the usability of Wukong heuristic rules can accelerate the generation of APIs.