Zhao Hongwei

Dr. Zhao Hongwei

orcid

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
15 November 2022 in IEEE Transactions on Industrial Informatics
Verified
Journal Article
Closed access
Weishan ZhangWeishan Zhang
Weishan Zhang
FYFa Yu
Fa Yu
XWXiao Wang
Xiao Wang
XZXingjie Zeng
Xingjie Zeng
ZHZhao Hongwei
Zhao Hongwei
ZLZengxiang Li
Zengxiang Li
Federated learning has become an emerging hot research field in industry because of its ability to perform large-scale distributed learning while preserving data privacy. However, recent studies have shown that in the actual use of federated learning, there are device heterogeneity and data not identically and independently distributed (Non-IID) characteristics between client nodes, which will affect the effect of federated learning. In this work, we propose resilient reinforcement federated learning (R $^{2}$ Fed), a R $^{2}$ Fed method, which applies reinforcement learning to federated learning and uses reinforcement learning for weighted fusion of client models instead of average fusion. We conduct experiments on object detection, object classification, and sentiment classification tasks in the context of Non-IID and heterogeneity, and the experimental results show that the R $^{2}$ Fed method outperforms traditional federated learning, increasing the average accuracy by 4.7%. Experiments also demonstrate that R $^{2}$ Fed is resilient to federation attacks.

17 June 2024 in IEEE Transactions on Computational Social Systems
Verified
Journal Article
Closed access
ZHZhao Hongwei
Zhao Hongwei
QLQiyuan Liu
Qiyuan Liu
SHSun Haoyun
Sun Haoyun
LXLiang Xu
Liang Xu
Weishan ZhangWeishan Zhang
Weishan Zhang
FWFei-Yue Wang
Fei-Yue Wang
Multiple organizations in social manufacturing can collaborate on high-quality product defect detection with social networks. Federated learning (FL) is an emerging paradigm where multiple clients can collaboratively train a defect detection model in a privacy-preserving manner. A prevalent issue in FL, concept drift, is discussed in this article. Feature representations of the same label may vary at different clients which affects the performance of FL. To address this issue, a novel community aware personalized federated learning (CA-PFL) is proposed in this article. A graph structured federation social network is constructed with local model updates. Communities in federation network are discovered with community detection to ensure that the same label at different clients have similar representations in each community. Shared layers of local models are aggregated in each community and each local client keeps their personalized layers. Furthermore, a federation community contrastive loss (FedCCL) is proposed to accelerate training convergence by constraining the direction of local model updating. Experimental results on nine datasets demonstrate that CA-PFL achieves higher accuracy and faster convergence than state-of- the-art personalized federated learning methods in concept drifts scenarios.

29 December 2022 in IEEE Transactions on Computational Social Systems
Verified
Journal Article
Closed access
XZXingjie Zeng
Xingjie Zeng
TZTao Zhou
Tao Zhou
ZBZhicheng Bao
Zhicheng Bao
ZHZhao Hongwei
Zhao Hongwei
CLChen Leiming
Chen Leiming
FWFei-Yue Wang
Fei-Yue Wang
Federated learning enables multiple clients to learn a general model without sharing local data, and the federated learning system also improves information security and advances responsible artificial intelligence (AI). However, the data of different clients in the system are non-independently and identically distributed (IID), which results in weight divergence, especially for complex graph data extraction. This article proposes a novel feature-contrastive graph federated (FcgFed) learning approach to improve the robustness of the federated learning system in graph data. First, we design an architecture for FcgFed learning systems to analyze graph information. Furthermore, we present a graph federated learning method based on contrastive learning to alleviate the weight divergence in federated learning. The experiments in node classification and graph classification demonstrate that our method achieves better performance than model-contrastive federated learning (MOON) and federated average (FedAvg). We also test the adaptability of our method in image classification, and the results demonstrate that weight similarity evaluation works for other frameworks and tasks.

13 March 2023 in IEEE Internet of Things Journal
Verified
Journal Article
Closed access
LXLiang Xu
Liang Xu
SHSun Haoyun
Sun Haoyun
ZHZhao Hongwei
Zhao Hongwei
Weishan ZhangWeishan Zhang
Weishan Zhang
HNHuansheng Ning
Huansheng Ning
HGHongqing Guan
Hongqing Guan
Video data is the biggest IoT data which is challenging for effective analysis with good performance. Object misdetection is usually inevitable in edge-based distributed cross-scene video analysis. Traditional centralized model training can potentially result in edge data leakage. Even though joint model can be trained with federated learning while maintaining data privacy, the size of gradient data transmitted is large for computer vision models used. To address these problems, this article proposed an accurate and efficient federated learning-based edge intelligence for effective video analysis method called EIEVA-AEFL. In EIEVA-AEFL, a federation misdetection reinforcement network (FMRN) is designed to alleviate the misdetection problem. FMRN contains a vanilla object detection network and a misdetection reinforcement branch, which finetunes object detection via feature re-extraction to reduce object misdetection. To reduce the communication cost in training, an efficient federated learning strategy is designed. In this strategy, an oscillation suppression loss function is proposed to suppress the loss fluctuation resulting from data on edge clients. Average accuracy and recall increase 0.5 and 0.7 with FMRN on the Microsoft common objects in context (MS COCO) data set, respectively, and with improvements of 4.5 and 5.5 with FMRN on our self-made mis-detection data set, respectively. EIEVA-AEFL can reduce the training speed on the premise of ensuring the accuracy of the model. The model parameters, data amount, transmission delay, and convergence epochs on EIEVA-AEFL model training are reduced by 78%, 89%, 84%, and 36%, respectively.

8 January 2024 in IEEE Transactions on Artificial Intelligence
Verified
Journal Article
Closed access
SHSun Haoyun
Sun Haoyun
ZHZhao Hongwei
Zhao Hongwei
LXLiang Xu
Liang Xu
Weishan ZhangWeishan Zhang
Weishan Zhang
HGHongqing Guan
Hongqing Guan
SYSu Yang
Su Yang
The proliferation of privacy-sensitive data has spurred the development of federated learning (FL), which is an important technology for state-of-the-art machine learning and responsible AI. However, most existing FL methods are constrained in their applicability and generalizability due to their narrow focus on specific tasks. This paper presents a novel federated multi-task learning (FMTL) framework that is capable of acquiring knowledge across multiple tasks. To address the challenges posed by Non-IID data and task imbalance in FMTL, this study proposes a federated fusion strategy based on dynamic guided attention (FedDGA), which adaptively fine-tunes local models for multiple tasks with personalized attention. In addition, this paper designed dynamic batch weight (DBW) to balance the task losses and improve the convergence speed. Extensive experiments were conducted on various datasets, tasks and settings, and the proposed method was compared with state-of-the-art methods such as FedAvg, FedProx and SCAFFOLD. The results show that our method achieves significant performance gains, with up to 11.1% increase in accuracy over the baselines.

28 January 2025 in IEEE Internet of Things Journal
Verified
Journal Article
Closed access
SHSun Haoyun
Sun Haoyun
Weishan ZhangWeishan Zhang
Weishan Zhang
RZRui Zhang
Rui Zhang
LXLiang Xu
Liang Xu
HGHongqing Guan
Hongqing Guan
XYXin Yu
Xin Yu
IoT devices have been widely deployed in medical industry, in the objective of improving diagnostic accuracy and increasing the efficiency of healthcare systems. However, traditional centralized learning approaches often fall short in meeting strict privacy requirements and adapting to emerging diseases in clinical environment. To address this, we propose a novel federated continual learning (CL) framework for disease diagnosis (FCL4DD), designed to enable distributed and incremental learning of new disease classes while safeguarding data privacy. To combat catastrophic forgetting in CL, FCL4DD integrates a replay strategy powered by a weakly supervised diffusion model (WSDM) to generate historical data for diagnosis model training. The WSDM leverages weak supervision into diffusion model to capture the diverse characteristics of the real data, enabling the generation of high-quality synthetic samples that maintain the data’s inherent variability. To overcome the challenges of nonindependent and identically distributed (non-IID) data in federated learning, WSDM is deployed at the central server to generate synthetic disease data that conforms to the global distribution. This synthetic data is then used to retrain client models, reducing discrepancies and enhancing performance consistency across clients. Evaluations on various datasets demonstrates that our method outperforms other state-of-the-art approaches, such as FedEWC, FedLwF, FedWeIT, TARGET, and DDDR, achieving up to a 4.85% accuracy improvement over the second-best method. Code are available at https://github.com/hysshy/FCL4DD.