Zheyi Chen

Zheyi Chen


Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
16 June 2020 in IEEE Transactions on Network Science and Engineering
Verified
Journal Article
Closed access
ZCZheyi Chen
Zheyi Chen
PTPu Tian
Pu Tian
Weixian LiaoWeixian Liao
Weixian Liao
Wei YuWei Yu
Wei Yu
The simultaneous development of deep learning techniques and Internet of Things (IoT)/Cyber-physical Systems (CPS) technologies has afforded untold possibilities for improving distributed computing, sensing, and data analysis. Among these technologies, federated learning has received increased attention as a privacy-preserving collaborative learning paradigm, and has shown significant potential in IoT/CPS-driven large-scale smart-world systems. At the same time, the vulnerabilities of deep neural networks, especially to adversarial attacks, cannot be overstated and should not be minimized. Moreover, distributed nature of federated learning makes defense against such adversarial attacks a more challenging problem due to unavailability of local data and resource heterogeneity. To tackle these challenges, in this paper, we propose ZeKoC, a Zero Knowledge Clustering approach to mitigate adversarial attacks. Particularly, we first formulate the problem of resource-constrained adversarial mitigation. Specifically, noting that global server has no access to training samples, we reformulate the unsupervised weight clustering problem. Our proposed ZeKoC approach allows the server to automatically split and merge weight clusters for weight selection and aggregation. Theoretical analysis of our approach demonstrates that convergence is guaranteed. Our experimental results illustrate that, in a non-i.i.d. (i.e., independent-and-identically distributed) data setting, our ZeKoC approach can successfully mitigate general attacks while outperforming state-of-art schemes.

31 March 2023 in IEEE Transactions on Emerging Topics in Computing
Verified
Journal Article
Closed access
ZCZheyi Chen
Zheyi Chen
PTPu Tian
Pu Tian
Weixian LiaoWeixian Liao
Weixian Liao
XCXuhui Chen
Xuhui Chen
GXGuobin Xu
Guobin Xu
Wei YuWei Yu
Wei Yu
The rise of deep learning and the Internet of Things (IoT) has driven a number of smart-world applications, which are mostly deployed in distributed environments. Federated learning, a privacy-preserving collaborative learning paradigm, has shown considerable potential to leverage the rich distributed data at network edges. Nonetheless, the heterogeneity of IoT devices and their connected network environment impedes federated learning applications in IoT systems. Particularly, the stale gradients updated by slower local learners impact the effectiveness of federated learning. Transmitting weight updates with a large number of users leads to network congestion at the edge of the network and incurs unaffordable communication costs. To overcome these challenges, we propose a transfer knowledge based federated learning framework under a resource-limited distributed system. We formulate a knowledge distillation based federated learning optimization problem with the consideration of dynamic local resource. The proposed approach carries out federated learning with the help of knowledge distillation to avoid occupying the expensive network bandwidth or bringing a heavy burden to the network. Theoretical analysis demonstrates convergence of the learning process. The experimental results on three public datasets illustrate that the proposed framework is capable of substantially improving the efficiency of federated learning and outperforming state-of-the-art schemes.

1 June 2021 in High-Confidence Computing
Verified
Journal Article
Open access
ZCZheyi Chen
Zheyi Chen
PTPu Tian
Pu Tian
Weixian LiaoWeixian Liao
Weixian Liao
Wei YuWei Yu
Wei Yu

30 April 2022 in Future Internet
Verified
Journal Article
Open access
PDF file
ZCZheyi Chen
Zheyi Chen
Weixian LiaoWeixian Liao
Weixian Liao
PTPu Tian
Pu Tian
Qianlong WangQianlong Wang
Qianlong Wang
Wei YuWei Yu
Wei Yu
Distributed machine learning paradigms have benefited from the concurrent advancement of deep learning and the Internet of Things (IoT), among which federated learning is one of the most promising frameworks, where a central server collaborates with local learners to train a global model. The inherent heterogeneity of IoT devices, i.e., non-independent and identically distributed (non-i.i.d.) data, and the inconsistent communication network environment results in the bottleneck of a degraded learning performance and slow convergence. Moreover, most weight averaging-based model aggregation schemes raise learning fairness concerns. In this paper, we propose a peer-to-peer decentralized learning framework to tackle the above issues. Particularly, each local client iteratively finds a learning pair to exchange the local learning model. By doing this, multiple learning objectives are optimized to advocate for learning fairness while avoiding small-group domination. The proposed fairness-aware approach allows local clients to adaptively aggregate the received model based on the local learning performance. The experimental results demonstrate that the proposed approach is capable of significantly improving the efficacy of federated learning and outperforms the state-of-the-art schemes under real-world scenarios, including balanced-i.i.d., unbalanced-i.i.d., balanced-non.i.i.d., and unbalanced-non.i.i.d. environments.

4 October 2024 in IEEE Transactions on Consumer Electronics
Verified
Journal Article
Closed access
ZCZheyi Chen
Zheyi Chen
YRYunjing Ren
Yunjing Ren
YXYujie Xue
Yujie Xue
AJAlireza Jolfaei
Alireza Jolfaei
Amr TolbaAmr Tolba
Amr Tolba
HFHailin Feng
Hailin Feng
IoT-enabled consumer electronics can collect and analyze data to improve functionality and user experiences, increasingly becoming part of edge computing networks. Decentralized federated learning is envisioned as a promising AIoT framework to leverage the data generated by these interconnected consumer electronics without compromising user privacy, where computations are performed closer to the data source rather than in a centralized cloud-based data center. However, a number of obstacles bottleneck the deployment of decentralized learning frameworks under a large-scale AIoT scenario, such as heterogeneity issues, communication efficiency, large-scale issues and others. Specifically, heterogeneity issues include diverse learning models, non-i.i.d. data distribution and unbalanced datasets. In this paper, we propose a trustworthy and adaptive knowledge distillation based decentralized federated learning framework to overcome a number of heterogeneity and large-scale issues. To achieve this goal, we formulate a decentralized optimization problem which formally presents various heterogeneity issues. The proposed framework is composed of two components, including a knowledge distillation based algorithm to transfer knowledge over diverse learning models as well as a real-time evaluation module to adapt client drift issues. Convergence analysis demonstrates that the convergence of the proposed framework is guaranteed. Finally, we conduct extensive experiments over three public datasets to validate the effectiveness and efficiency of proposed framework in the large-scale IoT scenario, illustrating that the proposed framework could significantly improve the learning performance over various metrics and outperforming state-of-the-art baseline approaches.

25 June 2026 in SSRN Electronic Journal
Verified
Preprint
Open access
JWJiahui Wang
Jiahui Wang
ZCZheyi Chen
Zheyi Chen
HFHailin Feng
Hailin Feng
XLXing Liu
Xing Liu
KHKun Hua
Kun Hua
JLJia Lu
Jia Lu
Federated learning (FL) has emerged as a promising paradigm for privacy-preserving collaborative training. However, under the intertwined challenges of severe data scarcity (e.g., 1\% sampling rate) and non-IID domain skew, existing FL approaches often experience substantial performance degradation. To address this issue, we introduce FedSHAPE (Federated Sharpness-aware Harmonized Aggregation and Parameter Equalization), a principled framework combining SPO and HAE. By systematically investigating the performance bottlenecks in such restrictive settings, we identify two coupled factors: standard local optimizers rapidly converge into domain-specific sharp minima (severe overfitting), rendering subsequent global feature alignment biased and suboptimal. Accordingly, FedSHAPE integrates a Stable Parameter Optimization (SPO) module for local flatness seeking with a Harmonized Aggregation and Equalization (HAE) module for robust consistency filtering and fair feature alignment. Extensive experiments demonstrate that FedSHAPE consistently improves both generalization robustness and cross-domain fairness under highly restricted data conditions.