2 March 2022 in IEEE Transactions on Wireless Communications
The conventional federated learning (FL) framework usually assumes synchronous reception and fusion of all the local models at the central aggregator and synchronous updating and training of the global model at all the agents as well. However, in a wireless network, due to limited radio resource, inevitable transmission failures and heterogeneous computing capacity, it is very hard to realize strict synchronization among all the involved user equipments (UEs). In this paper, we propose a novel asynchronous FL framework, which well adapts to the heterogeneity of users, communication environments and learning tasks, by considering both the possible delays in training and uploading the local models and the resultant staleness among the received models that has heavy impact on the global model fusion. A novel centralized fusion algorithm is designed to determine the fusion weight during the global update, which aims to make full use of the fresh information contained in the uploaded local models while avoiding the biased convergence by enforcing the impact of each UE’s local dataset to be proportional to its sample share. Numerical experiments validate that the proposed asynchronous FL framework can achieve fast and smooth convergence and enhance the training efficiency significantly.
1 September 2016 in Virus Research
12 August 2024 in IEEE Internet of Things Journal
The expansion of the Internet of Things (IoT) has led to a significant surge in data flow over edge networks, posing substantial challenges to data mining and management. While federated edge learning (FEEL) effectively accomplishes global integration and local training based on the decentralized data sets, its deployment across expansive IoT networks introduces additional challenges. The primary issues stem from managing the interaction between the communication load and learning effectiveness. The communication loads driven by recurrent data exchanges between the user equipment (UE) and central servers exacerbate network congestion and latency issues. Moreover, the learning efficacy is undermined due to the typically nonindependent and identically distributed (non-IID) characteristics of real-world IoT data. In this article, a novel communication-efficient hierarchical FEEL framework is proposed to tackle these challenges. Specifically, UEs are adaptively clustered according to their link conditions, geographic locations, and data distributions. Small base stations (SBSs) collect local model updates from the UEs in their clusters and communicate with a macro base station (MBS) for the global model aggregation. To jointly maximize the communication gain (in terms of reducing latency) and the learning gain (in terms of improving accuracy), a clustering and resource allocation optimization problem is formulated, and a cross entropy-based method with low computational complexity is proposed. Numerical experiments validate that the proposed hierarchical FEEL system achieves fast convergence and significantly improves the system efficiency for various learning tasks and the system settings.