Xinyuan Lin

Xinyuan Lin

Auto-generated profile, based on publicly available information

Xinyuan Lin

University of California, Irvine, Irvine, CA, USA

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
30 July 2024 in Scientia Horticulturae
Verified
Journal Article
Closed access
ZQZihao Qiu
Zihao Qiu
ALAnsheng Li
Ansheng Li
WHWei Huang
Wei Huang
JCJiahao Chen
Jiahao Chen
XLXinyuan Lin
Xinyuan Lin
PZPeng Zheng
Peng Zheng

18 December 2024 in Proceedings of the ACM on Management of Data
Verified
Journal Article
Open access
XLXiaozhen Liu
Xiaozhen Liu
YHYicong Huang
Yicong Huang
XLXinyuan Lin
Xinyuan Lin
AKAvinash Kumar
Avinash Kumar
SASadeem Alsudais
Sadeem Alsudais
CLChen Li
Chen Li
Data analytics tasks are often formulated as data workflows represented as directed acyclic graphs (DAGs) of operators. The recent trend of adopting machine learning (ML) techniques in workflows results in increasingly complicated DAGs with many operators and edges. Compared to the operator-at-a-time execution paradigm, pipelined execution has benefits of reducing the materialization cost of intermediate results and allowing operators to produce results early, which are critical in iterative analysis on large data volumes. Correctly scheduling a workflow DAG for pipelined execution is non-trivial due to the richer semantics of operators and the increasing complexity of DAGs. Several existing data systems adopt simple heuristics to solve the problem without considering costs such as materialization sizes. In this paper, we systematically study the problem of scheduling a workflow DAG for pipelined execution, and develop a novel cost-based optimizer called Pasta for generating a high-quality schedule. The Pasta optimizer is not only general and applicable to a wide variety of cost functions, but also capable of utilizing properties inherent in a broad class of cost functions to improve its performance significantly. We conducted a thorough evaluation of developed techniques on real-world workflows and show the efficiency and efficacy of these solutions.