Yu Gan

Yu Gan

Auto-generated profile, based on publicly available information

Yu Gan

Google, Seattle, USA

Research Focus & Metrics

Academic Career Length

9Years (2018-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
17 April 2021
Verified
Conference Paper
Open access
YGYu Gan
Yu Gan
MLMingyu Liang
Mingyu Liang
SDSundar Dev
Sundar Dev
DLDavid Lo
David Lo
CDChristina Delimitrou
Christina Delimitrou
Cloud applications are increasingly shifting from large monolithic services to complex graphs of loosely-coupled microservices. Despite the advantages of modularity and elasticity microservices offer, they also complicate cluster management and performance debugging, as dependencies between tiers introduce backpressure and cascading QoS violations. Prior work on performance debugging for cloud services either relies on empirical techniques, or uses supervised learning to diagnose the root causes of performance issues, which requires significant application instrumentation, and is difficult to deploy in practice. We present Sage, a machine learning-driven root cause analysis system for interactive cloud microservices that focuses on practicality and scalability. Sage leverages unsupervised ML models to circumvent the overhead of trace labeling, captures the impact of dependencies between microservices to determine the root cause of unpredictable performance online, and applies corrective actions to recover a cloud service’s QoS. In experiments on both dedicated local clusters and large clusters on Google Compute Engine we show that Sage consistently achieves over 93% accuracy in correctly identifying the root cause of QoS violations, and improves performance predictability.

22 May 2018 in IEEE Computer Architecture Letters
Verified
Journal Article
Closed access
YGYu Gan
Yu Gan
CDChristina Delimitrou
Christina Delimitrou
Cloud services have recently undergone a shift from monolithic applications to microservices, with hundreds or thousands of loosely-coupled microservices comprising the end-to-end application. Microservices present both opportunities and challenges when optimizing for quality of service (QoS) and cloud utilization. In this paper we explore the implications cloud microservices have on system bottlenecks, and datacenter server design. We first present and characterize an end-to-end application built using tens of popular open-source microservices that implements a movie renting and streaming service, and is modular and extensible. We then use the end-to-end service to study the scalability and performance bottlenecks of microservices, and highlight implications they have on the design of datacenter hardware. Specifically, we revisit the long-standing debate of brawny versus wimpy cores in the context of microservices, we quantify the I-cache pressure they introduce, and measure the time spent in computation versus communication between microservices over RPCs. As more cloud applications switch to this new programming model, it is increasingly important to revisit the assumptions we have previously used to build and manage cloud systems.

25 March 2023
Verified
Conference Paper
Open access
YGYu Gan
Yu Gan
GLGuiyang Liu
Guiyang Liu
XZXin Zhang
Xin Zhang
QZQi Zhou
Qi Zhou
JWJiesheng Wu
Jiesheng Wu
JJJiangwei Jiang
Jiangwei Jiang
Cloud microservices are being scaled up due to the rising demand for new features and the convenience of cloud-native technologies. However, the growing scale of microservices complicates the remote procedure call (RPC) dependency graph, exacerbates the tail-of-scale effect, and makes many of the empirical rules for detecting the root cause of end-to-end performance issues unreliable. Additionally, existing open-source microservice benchmarks are too small to evaluate performance debugging algorithms at a production-scale with hundreds or even thousands of services and RPCs. To address these challenges, we present Sleuth, a trace-based root cause analysis (RCA) system for large-scale microservices using un-supervised graph learning. Sleuth leverages a graph neural network to capture the causal impact of each span in a trace, and trace clustering using a trace distance metric to reduce the amount of traces required for root cause localization. A pre-trained Sleuth model can be transferred to different microservice applications without any retraining or with few-shot fine-tuning. To quantitatively evaluate the performance and scalability of Sleuth, we propose a method to generate microservice benchmarks comparable to a production-scale. The experiments on the existing benchmark suites and synthetic large-scale microservices indicate that Sleuth has significantly outperformed the prior work in detection accuracy, performance, and adaptability on a large-scale deployment.

1 May 2020 in IEEE Micro
Verified
Journal Article
Closed access
YGYu Gan
Yu Gan
YZYanqi Zhang
Yanqi Zhang
DCDailun Cheng
Dailun Cheng
ASAnkitha Shetty
Ankitha Shetty
PRPriyal Rathi
Priyal Rathi
CDChristina Delimitrou
Christina Delimitrou
Cloud services are shifting from monolithic applications, to graphs of hundreds of loosely-coupled microservices. Microservices fundamentally change many assumptions current cloud systems are designed with, and present both opportunities and challenges when optimizing for quality of service and utilization. We explore the implications of microservices across the cloud system stack. We first present DeathStarBench, a novel, open-source benchmark suite built with microservices that is representative of large end-to-end services, modular and extensible. DeathStarBench includes a social network, a media service, an e-commerce site, a banking system, and IoT applications for coordination control of UAV swarms. We then use DeathStarBench to study the architectural characteristics of microservices, their implications in networking and operating systems, their challenges with respect to cluster management, and their trade-offs in terms of programming framework design. Finally, we explore their tail at scale effects, and their implications on performance predictability.

21 April 2022 in IEEE Micro
Verified
Journal Article
Closed access
YGYu Gan
Yu Gan
MLMingyu Liang
Mingyu Liang
SDSundar Dev
Sundar Dev
DLDavid Lo
David Lo
CDChristina Delimitrou
Christina Delimitrou
Cloud applications are increasingly shifting from large monolithic services to complex graphs of loosely coupled microservices. Despite their benefits, microservices are prone to cascading performance issues, and can lead to prolonged periods of degraded performance. We present Sage, a machine-learning-driven root cause analysis system for interactive cloud microservices that is both accurate and practical. We show that Sage correctly identifies the root causes of performance issues across a diverse set of microservices and takes action to address them, leading to more predictable, performant, and efficient cloud systems.

12 October 2025
Verified
Conference Paper
Open access
YYYifan Yu
Yifan Yu
YGYu Gan
Yu Gan
NSNikhil Sarda
Nikhil Sarda
LTLillian Tsai
Lillian Tsai
JSJiaming Shen
Jiaming Shen
DCDavid Culler
David Culler