Zheqi Zhu

Dr. Zheqi Zhu


Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
10 May 2021 in IEEE Internet of Things Journal
Verified
Journal Article
Closed access
ZZZheqi Zhu
Zheqi Zhu
SWShuo Wan
Shuo Wan
Pingyi FanPingyi Fan
Pingyi Fan
KLKhaled B. Letaief
Khaled B. Letaief
As an emerging technique, mobile-edge computing (MEC) introduces a new scheme for various distributed communication-computing systems, such as industrial Internet of Things (IoT), vehicular communication, smart city, etc. In this work, we mainly focus on the timeliness of the MEC systems where the freshness of the data and computation tasks is significant. First, we formulate a kind of age-sensitive MEC models and define the average Age-of-Information (AoI) minimization problems of interests. Then, a novel mixed-policy-based multimodal deep reinforcement learning (RL) framework, called heterogeneous multiagent actor–critic (H-MAAC), is proposed as a paradigm for joint collaboration in the investigated MEC systems, where edge devices and center controller learn the interactive strategies through their own observations. To improve the system performance, we develop the corresponding online algorithm by introducing the edge federated learning mode into the multiagent cooperation whose advantages on learning convergence can be guaranteed theoretically. To the best of our knowledge, it is the first joint MEC collaboration algorithm that combines the edge federated mode with the multiagent actor–critic RL. Furthermore, we evaluate the proposed approach and compare it with popular RL-based methods. As a result, the proposed algorithm not only outperforms the baselines on average system age, but also promotes the stability of training process. Besides, the simulation outcomes provide several insights for collaboration designs over MEC systems.

8 May 2024 in IEEE Internet of Things Journal
Verified
Journal Article
Closed access
ZZZheqi Zhu
Zheqi Zhu
YSYuchen Shi
Yuchen Shi
Pingyi FanPingyi Fan
Pingyi Fan
CPChenghui Peng
Chenghui Peng
KLKhaled B. Letaief
Khaled B. Letaief
As a promising learning paradigm integrating computation and communication, federated learning (FL) proceeds the local training and the periodic sharing from distributed clients. Due to the non-i.i.d. data distribution on clients, FL model suffers from the gradient diversity, poor performance, bad convergence, etc. In this work, we aim to tackle this key issue by adopting importance sampling (IS) for local training. We propose importance sampling FL(ISFL), an explicit framework with theoretical guarantees. First, we derive the convergence theorem of ISFL to involve the effects of local IS. Then, we formulate the problem of selecting optimal IS weights and obtain the theoretical solutions. We also employ a water-filling method to calculate the IS weights and develop the ISFL algorithms. The experimental results on CIFAR-10 fit the proposed theorems well and verify that ISFL reaps better performance, convergence, sampling efficiency, as well as explainability on the non-i.i.d. data. To the best of our knowledge, ISFL is the first non-i.i.d. FL solution from the local sampling aspect which exhibits theoretical compatibility with neural network models. Furthermore, as a local sampling approach, ISFL can be easily migrated into the other emerging FL frameworks.

6 March 2024 in IEEE Internet of Things Journal
Verified
Journal Article
Closed access
YSYuchen Shi
Yuchen Shi
Pingyi FanPingyi Fan
Pingyi Fan
ZZZheqi Zhu
Zheqi Zhu
CPChenghui Peng
Chenghui Peng
FWFei Wang
Fei Wang
KLKhaled B. Letaief
Khaled B. Letaief
Federated learning (FL) is a promising distributed learning mechanism that revolutionizes our interaction with data in the IoT ecosystem. Due to the rapidly growing scale of smart devices and the limited transmission resources of networks, a simple, consistent, and scalable FL framework aiming to address the communication bottleneck is urgently needed. In this work, we propose an efficient approach with selective aggregation of models (SAMs) to mitigate the communication overload in FL systems. The introduction of SAM enables each local client to upload its model with a certain probability, resulting in a significant reduction in costly communication expenses. We design the algorithm for SAM, analyze the convergence bound on nonconvex objectives for heterogeneous data, which illustrates the impact of the selection probability as well as the set size of participating clients on the system performance, and assess the conservation for the network resource utilization by modeling queuing systems. We conduct various experiments to evaluate the performance of SAM, whose outcomes suggest that significant alleviation of the communication bottleneck can be accomplished with marginal cost of performance loss. It will also be shown that SAM is a communication-efficient method that can be freely applied to other frameworks.

14 August 2023 in Entropy
Verified
Journal Article
Open access
PDF file
ZZZheqi Zhu
Zheqi Zhu
YSYuchen Shi
Yuchen Shi
Gangtao XinGangtao Xin
Gangtao Xin
CPChenghui Peng
Chenghui Peng
Pingyi FanPingyi Fan
Pingyi Fan
KLKhaled B. Letaief
Khaled B. Letaief
As a promising distributed learning paradigm, federated learning (FL) faces the challenge of communication–computation bottlenecks in practical deployments. In this work, we mainly focus on the pruning, quantization, and coding of FL. By adopting a layer-wise operation, we propose an explicit and universal scheme: FedLP-Q (federated learning with layer-wise pruning-quantization). Pruning strategies for homogeneity/heterogeneity scenarios, the stochastic quantization rule, and the corresponding coding scheme were developed. Both theoretical and experimental evaluations suggest that FedLP-Q improves the system efficiency of communication and computation with controllable performance degradation. The key novelty of FedLP-Q is that it serves as a joint pruning-quantization FL framework with layer-wise processing and can easily be applied in practical FL systems.

4 November 2020 in IEEE Communications Letters
Verified
Journal Article
Closed access
Gangtao XinGangtao Xin
Gangtao Xin
ZLZhefan Li
Zhefan Li
ZZZheqi Zhu
Zheqi Zhu
SWShuo Wan
Shuo Wan
Pingyi FanPingyi Fan
Pingyi Fan
KLKhaled Ben Letaief
Khaled Ben Letaief
In this paper, we propose soft compression, an lossless compression approach to shape coding for images using location index and codebook of designed shapes with various sizes. This method is different from traditional image compression methods, as it aims at finding the basic shape blocks of pictures to improve the compression ratio from the perspective of information theory and frequency. In particular, the triplets including location and codeword are stored when encoding an image instead of the entire array. It is shown that soft compression can greatly reduce the bandwidth and storage space needed in the process of transmitting and storing the same kind of images.

4 May 2020 in IEEE Communications Letters
Verified
Journal Article
Closed access
ZZZheqi Zhu
Zheqi Zhu
SLShanyun Liu
Shanyun Liu
RSRui She
Rui She
SWShuo Wan
Shuo Wan
Pingyi FanPingyi Fan
Pingyi Fan
KLKhaled B. Letaief
Khaled B. Letaief
There are numerous scenarios in source coding where not only the code length but the importance of each value should also be taken into account. Different from the traditional coding theorems, by adding the importance weights for the length of the codes, we define the average cost of the weighted codeword length as an importance-aware measure of the codes. This novel information theoretical measure generalizes the average codeword length by assigning importance weights for each symbol according to users’ concerns through focusing on user’s selections. With such definitions, coding theorems of the bounds are derived and the outcomes are shown to be extensions of traditional coding theorems.