Siyuan Feng

Siyuan Feng

Auto-generated profile, based on publicly available information

Siyuan Feng

Shanghai Jiao Tong University, Shanghai, China

Research Focus & Metrics

Academic Career Length

2Years (2025-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
30 March 2025
Verified
Conference Paper
Open access
RLRuihang Lai
Ruihang Lai
JSJunru Shao
Junru Shao
SFSiyuan Feng
Siyuan Feng
SLSteven Lyubomirsky
Steven Lyubomirsky
BHBohan Hou
Bohan Hou
TCTianqi Chen
Tianqi Chen

15 November 2025
Verified
Conference Paper
Open access
YZYangjie Zhou
Yangjie Zhou
HZHonglin Zhu
Honglin Zhu
QQQian Qiu
Qian Qiu
WCWeihao Cui
Weihao Cui
ZLZihan Liu
Zihan Liu
MDMinwen Deng
Minwen Deng

22 June 2025 in Proceedings of the ACM on Software Engineering
Verified
Journal Article
Open access
SFSiyuan Feng
Siyuan Feng
JLJiawei Liu
Jiawei Liu
RLRuihang Lai
Ruihang Lai
CRCharlie Ruan
Charlie Ruan
YYYong Yu
Yong Yu
TCTianqi Chen
Tianqi Chen
While existing machine learning (ML) frameworks focus on established platforms, like running CUDA on server-grade GPUs, there have been growing demands to enable emerging AI applications in a broader set of scenarios, such as running Large Language Models (LLMs) within browsers and mobile phones. However, deploying emerging models on new platforms (such as Metal and WebGPU) presents significant software engineering challenges due to rapid model evolution and limited tooling and practices for these platforms. Previous practice for ML model deployment often follows a bottom-up fashion, where engineers first implement individual required operators and then put them together. However, this traditional development approach fails to meet the productivity requirements when deploying emerging ML applications, with the testing and debugging part as a bottleneck. To this end, we introduce TapML, a top-down approach designed to streamline model deployment on diverse platforms. While the traditional bottom-up approach requires crafting manual tests, TapML automatically creates high-quality, realistic test data through operator-wise test carving. Furthermore, TapML uses a migration-based strategy to gradually offload model implementation from the mature source platform to the target platform, minimizing the debugging scope of compound errors. TapML has been used as the default development method in the MLC-LLM project to deploy emerging ML models. Within 2 years, TapML has accelerated the deployment of 105 emerging models in 27 model architectures across 5 emerging platforms. We show that TapML effectively boosts developer productivity while ensuring the quality of deployed models. Furthermore, we summarize comprehensive case studies from our real-world development, offering best practices for developing emerging ML systems.

28 February 2025
Verified
Conference Paper
Open access
ZDZhanyuan Di
Zhanyuan Di
LWLeping Wang
Leping Wang
ZRZiyi Ren
Ziyi Ren
ESEn Shao
En Shao
JZJie Zhao
Jie Zhao
NSNinghui Sun
Ninghui Sun
Deep neural networks (DNNs) increasingly rely on parallel structures to enhance performance and efficiency. However, existing machine learning compilers (MLCs) face challenges in optimizing these structures due to limited parallel fusion scopes and insufficient consideration of intra-operator information. This paper introduces Magneto, a novel framework designed to accelerate parallel structures in DNNs through the co-optimization of parallel operators. By expanding the scope of parallel operator fusion and introducing a dedicated co-tuning algorithm, Magneto unlocks new opportunities for co-optimization. Experimental results demonstrate that Magneto outperforms NVIDIA TensorRT and AMD MIGraphX, achieving speedups of 3.02× and 4.19×, respectively.

16 June 2025 in ACM Transactions on Architecture and Code Optimization
Verified
Journal Article
Open access
ZDZhanyuan Di
Zhanyuan Di
LWLeping Wang
Leping Wang
ZMZhaojia Ma
Zhaojia Ma
ESEn Shao
En Shao
JZJie Zhao
Jie Zhao
NSNinghui Sun
Ninghui Sun
Parallel structures have become a key pattern in deep neural networks (DNNs), offering improved efficiency and scalability. However, existing machine learning compilers (MLCs) face challenges in optimizing these structures due to limited parallel fusion scope and insufficient analysis of intra-operator characteristics. This paper introduces Magneto, a framework designed to accelerate DNN inference by co-optimizing parallel operators. Magneto broadens the fusion scope and incorporates a specialized co-tuning algorithm to optimize operators jointly. Our approach addresses the unique challenges inherent in optimizing parallel structures, enabling significant performance improvements across various hardware platforms. Experimental results show that Magneto outperforms state-of-the-art NVIDIA TensorRT and AMD MIGraphX, achieving geometric mean speedups of 2.27 × and 2.88 ×, respectively.