Jing Wu

Jing Wu

Auto-generated profile, based on publicly available information

Jing Wu

National Engineering Research Center for Big Data Technology and System, Services Computing Technology and System Laboratory, Cluster and Grid Computing Laboratory, School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan, China

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 August 2022 in IEEE Transactions on Parallel and Distributed Systems
Verified
Journal Article
Closed access
JWJing Wu
Jing Wu
LWLin Wang
Lin Wang
QPQiangyu Pei
Qiangyu Pei
XCXingqi Cui
Xingqi Cui
FLFangming Liu
Fangming Liu
TYTingting Yang
Tingting Yang
Deep neural networks (DNNs) have become a critical component for inference in modern mobile applications, but the efficient provisioning of DNNs is non-trivial. Existing mobile- and server-based approaches compromise either the inference accuracy or latency. Instead, a hybrid approach can reap the benefits of the two by splitting the DNN at an appropriate layer and running the two parts separately on the mobile and the server respectively. Nevertheless, the DNN throughput in the hybrid approach has not been carefully examined, which is particularly important for edge servers where limited compute resources are shared among multiple DNNs. This article presents HiTDL, a runtime framework for managing multiple DNNs provisioned following the hybrid approach at the edge. HiTDL's mission is to improve edge resource efficiency by optimizing the combined throughput of all co-located DNNs, while still guaranteeing their SLAs. To this end, HiTDL first builds comprehensive performance models for DNN inference latency and throughout with respect to multiple factors including resource availability, DNN partition plan, and cross-DNN interference. HiTDL then uses these models to generate a set of candidate partition plans with SLA guarantees for each DNN. Finally, HiTDL makes global throughput-optimal resource allocation decisions by selecting partition plans from the candidate set for each DNN via solving a fairness-aware multiple-choice knapsack problem. Experimental results based on a prototype implementation show that HiTDL improves the overall throughput of the edge by $4.3\times$ compared with the state-of-the-art.

7 December 2023 in IEEE Transactions on Parallel and Distributed Systems
Verified
Journal Article
Closed access
JWJing Wu
Jing Wu
LWLin Wang
Lin Wang
QJQirui Jin
Qirui Jin
FLFangming Liu
Fangming Liu
Deep neural networks (DNNs) have been widely adopted for various mobile inference tasks, yet their ever-increasing computational demands are hindering their deployment on resource-constrained mobile devices. Hybrid deep learning partitions a DNN into two parts and deploys them across the mobile device and a server, aiming to reduce inference latency or prolong battery life of mobile devices. However, such partitioning produces (non-uniform) DNN fragments which are hard to serve efficiently on the server. This article presents Graft—an efficient inference serving system for hybrid deep learning with latency service-level objective (SLO) guarantees. Our main insight is to mitigate the non-uniformity by a core concept called DNN re-alignment, allowing multiple heterogeneous DNN fragments to be restructured to share layers. To fully exploit the potential of DNN re-alignment, Graft employs fine-grained GPU resource sharing. Based on that, we propose efficient algorithms for merging, grouping, and re-aligning DNN fragments to maximize request batching opportunities, minimizing resource consumption while guaranteeing the inference latency SLO. We implement a Graft prototype and perform extensive experiments with five types of widely used DNNs and real-world network traces. Our results show that Graft improves resource efficiency by up to 70% compared with the state-of-the-art inference serving systems.

5 November 2025 in IEEE Transactions on Computers
Verified
Journal Article
Open access
QDQuanfeng Deng
Quanfeng Deng
JWJing Wu
Jing Wu
QPQiangyu Pei
Qiangyu Pei
CLChuangxun Lin
Chuangxun Lin
YCYu Chen
Yu Chen
HJHai Jin
Hai Jin
The serverless computing paradigm has emerged as a promising solution to address the resource underutilization and inflexible service scaling in edge environments by decomposing the monolithic application into a serverless workflow. However, existing serverless platforms are primarily designed for cloud data centers, relying on heavyweight isolation mechanisms that are ill-suited for resource-constrained edge computing. These limitations lead to high latency, low deployment density, and restricted parallelism. In this paper, we propose Sonnet, a serverless platform tailored for edge computing, capable of rapidly responding to user requests and supporting efficient and elastic service scaling. Sonnet offers these features by (i) employing lightweight WebAssembly as the execution environment for functions, (ii) leveraging serverless workflow information to optimize function deployment on resource-constrained edge environments, and (iii) providing a function deployment algorithm that achieves dynamic load balancing within the cluster. An extensive evaluation of Sonnet with real-world serverless workflows demonstrates its effectiveness and practical applicability. Compared with SOTA and commonly used edge computing serverless solutions, Sonnet can reduce end-to-end latency by 27% and improve throughput by 2.83$\boldsymbol{\times}$.