Qiong Chen

Qiong Chen

Auto-generated profile, based on publicly available information

Qiong Chen

Huawei, Hangzhou, China

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
30 October 2023
Verified
Conference Paper
Open access
QPQiangyu Pei
Qiangyu Pei
YYYongjie Yuan
Yongjie Yuan
HHHaichuan Hu
Haichuan Hu
QCQiong Chen
Qiong Chen
FLFangming Liu
Fangming Liu
Recent advances in deep learning (DL) have spawned various intelligent cloud services with well-trained DL models. Nevertheless, it is nontrivial to maintain the desired end-to-end latency under bursty workloads, raising critical challenges on high-performance while resource-efficient inference services. To handle burstiness, some inference services have migrated to the serverless paradigm for its rapid elasticity. However, they neglect the impact of the time-consuming and resource-hungry model-loading process when scaling out function instances, leading to considerable resource inefficiency for maintaining high performance under burstiness. To address the issue, we open up the black box of DL models and find an interesting phenomenon that the sensitivity of each layer to the computing resources is mostly anti-correlated with its memory resource usage. Motivated by this, we propose asymmetric functions, where the original Body Function still loads a complete model to meet stable demands, while the proposed lightweight Shadow Function only loads a portion of resource-sensitive layers to deal with sudden demands effortlessly. By parallelizing computations on resource-sensitive layers, the surging demand can be well satisfied, though the rest of the layers are performed serially in Body Functions only. We implement asymmetric functions on top of Knative and build a high-performance and resource-efficient inference serving system named AsyFunc with a new auto-scaling and scheduling engine. Evaluation results driven by production traces show that compared with the state of the art, AsyFunc saves computing and memory resources by up to 31.1% and 32.5%, respectively, while providing consistent performance guarantees under burstiness.

4 August 2024
Verified
Conference Paper
Open access
QCQiong Chen
Qiong Chen
JQJianmin Qian
Jianmin Qian
YCYulin Che
Yulin Che
ZLZiqi Lin
Ziqi Lin
JWJianfeng Wang
Jianfeng Wang
KTKun Tan
Kun Tan
We design, implement, and evaluate YuanRong, the first production general-purpose serverless platform with a unified programming interface, multi-language runtime, and a distributed computing kernel for cloud-based applications. YuanRong addresses many limitations of existing Function-as-a-Service (FaaS) systems, particularly in performance and lack of important features. First, our fast function system supports sub-millisecond function invocation and locality-aware hierarchical scheduling. Second, our multi-semantic built-in data system achieves object exchange latency of 200 microseconds, enabling end-to-end latency of 2 milliseconds for streaming elements at 5Gbps throughput. Third, the extensible, portable Service Bridge bridges stateless and stateful operations, allowing connection reuse and distributed transactions, and offers unified backend abstraction for multi-cloud portability. YuanRong has been deployed for over 3 years at Huawei across nearly 20 datacenter regions, processing up to 30 billion requests per day on more than 100,000 CPU cores, with a daily average CPU usage of 53%. It serves various serverless workloads, including enhanced FaaS services, microservices, data analytics, deep model training and serving, and some HPC workloads. Our experience shows that Spring-based microservices can be migrated to YuanRong within one day, reducing resource costs by 90%, demonstrating its generality and efficiency in supporting a broad spectrum of applications.

30 July 2019 in IEEE Transactions on Sustainable Computing
Verified
Journal Article
Closed access
ZZZimu Zheng
Zimu Zheng
QCQiong Chen
Qiong Chen
Cheng FanCheng Fan
Cheng Fan
NGNan Guan
Nan Guan
AVArun Vishwanath
Arun Vishwanath
FLFangming Liu
Fangming Liu
It is well-known that the HVAC (heating, ventilation and air conditioning) dominates electricity consumption in commercial buildings. In this paper, we focus on one of the core problems in building operation, namely chiller sequencing to reduce HVAC electricity consumption. Our contributions are threefold. First, we make a case for why it is important to quantify the performance profile of a chiller, namely coefficient of performance (COP), at run-time, by developing a data-driven COP estimation methodology. Second, we show that predicting COP accurately is a non-trivial problem, requiring considerable computation time. To overcome this barrier, we develop a data-driven COP prediction model and an edge-based chiller sequencing framework integrating the COP predictions, and show that they strike a good balance between electricity saving and ease of use for real-world deployment. Finally, we evaluate the performance of our scheme by applying it to real-world data, spanning 4 years, obtained from multiple chillers across 3 large commercial buildings in Hong Kong. The results show an electricity saving of over 30% compared to baselines. We offer our edge based data-driven chiller sequencing framework as a cost-effective and practical mechanism to reduce electricity consumption associated with HVAC operation in commercial buildings.

13 February 2024 in IEEE Transactions on Parallel and Distributed Systems
Verified
Journal Article
Closed access
ZWZhaojie Wen
Zhaojie Wen
QCQiong Chen
Qiong Chen
YNYipei Niu
Yipei Niu
ZSZhen Song
Zhen Song
QDQuanfeng Deng
Quanfeng Deng
FLFangming Liu
Fangming Liu
Function-as-a-Service (FaaS) offers a fine-grained resource provision model, enabling developers to build highly elastic cloud applications. User requests are handled by a series of serverless functions step by step, which forms a multi-step workflow. The developers are required to set proper configurations for functions to meet service level objectives (SLOs) and save costs. However, developing the configuration strategy is challenging. This is mainly because the execution of serverless functions often suffers from cold starts and performance fluctuation, which requires a dynamic configuration strategy to guarantee the SLOs. In this article, we present StepConf, a framework that automates the configuration as the workflow runs. StepConf optimizes memory size for each function step in the workflow and takes inter and intra-function parallelism into consideration, which has been overlooked by existing work. StepConf intelligently predicts the potential configurations for subsequent function steps, and proactively prewarms function instances in a configuration-aware manner to reduce the cold start overheads. We evaluate StepConf on AWS and Knative. Compared to existing work, StepConf improves performance by up to 5.6× under the same cost budget and achieves up to a 40% cost reduction while maintaining the same level of performance.

3 September 2024 in IEEE Transactions on Parallel and Distributed Systems
Verified
Journal Article
Closed access
ZWZhaojie Wen
Zhaojie Wen
QCQiong Chen
Qiong Chen
QDQuanfeng Deng
Quanfeng Deng
YNYipei Niu
Yipei Niu
ZSZhen Song
Zhen Song
FLFangming Liu
Fangming Liu
Serverless computing provides developers with a maintenance-free approach to resource usage, but it also transfers resource management responsibility to the cloud platform. However, the fine granularity of serverless function resources can lead to performance bottlenecks and resource fragmentation on nodes when creating many function containers. This poses challenges in effectively scaling function resources and optimizing node resource allocation, hindering overall agility. To address these challenges, we have introduced ComboFunc, an innovative resource scaling system for serverless platforms. ComboFunc associates function with heterogeneous containers of varying specifications and optimizes their resource combination and placement. This approach not only selects appropriate nodes for container creation, but also leverages the new feature of Kubernetes In-place Pod Vertical Scaling to enhance resource scaling agility and efficiency. By allowing a single function to correspond to heterogeneous containers with varying resource specifications and providing the ability to modify the resource specifications of existing containers in place, ComboFunc effectively utilizes fragmented resources on nodes. This, in turn, enhances the overall resource utilization of the entire cluster and improves scaling agility. We also model the problem of combining and placing heterogeneous containers as an NP-hard problem and design a heuristic solution based on a greedy algorithm that solves it in polynomial time. We implemented a prototype of ComboFunc on the Kubernetes platform and conducted experiments using real traces on a local cluster. The results demonstrate that, compared to existing strategies, ComboFunc achieves up to 3.01 × faster function resource scaling and reduces resource costs by up to 42.6%.

14 November 2026
Verified
Conference Paper
Open access
ZJZhida Jiang
Zhida Jiang
ZXZhaolong Xing
Zhaolong Xing
JLJiawei Lu
Jiawei Lu
YNYipei Niu
Yipei Niu
QSQingyuan Sang
Qingyuan Sang
KZKe Zhang
Ke Zhang