The advances of both computation and communication technologies facilitate the exploitation of massive data generated by mobile devices. It is attractive to leverage these data and computation resources to train high-performance machine learning (ML) models. In traditional ML methods, all data are uploaded to servers for model training, which incur issues of large overhead and privacy concerns. Federated learning (FL) was proposed to address these issues. In this paper, we propose FedPCC, an efficient approach based on the parallelism of communication and computation among devices for FL in wireless networks. FedPCC considers the difference in communication and computation capabilities between different devices and optimizes the training schedule for devices selected in each round. Instead of dividing an FL training round into separate communication and computation steps, FedPCC protocol arranges devices to download the global model sequentially and then start local model training immediately once finishing downloading, which allows better utilization of communication and computation resources. Specifically, we formulate an optimization problem to minimize the time for each training round and propose an algorithm to solve the problem based on the trade-off of devices’ communication and computation capabilities. FedPCC uses a heuristic algorithm to make slow devices start relatively earlier, which can shorten the time in one training round, thus reducing the entire training time. We conduct extensive experiments to demonstrate that the proposed protocol outperforms the existing protocols under different system settings.
20 November 2024 in ACM Transactions on Intelligent Systems and Technology
Despite achieving remarkable performance, Federated Learning (FL) encounters two important problems, i.e., low training efficiency and limited computational resources. In this article, we propose a new FL framework, i.e., FedDUMAP, with three original contributions, to leverage the shared insensitive data on the server in addition to the distributed data in edge devices so as to efficiently train a global model. First, we propose a simple dynamic server update algorithm, which takes advantage of the shared insensitive data on the server while dynamically adjusting the update steps on the server in order to speed up the convergence and improve the accuracy. Second, we propose an adaptive optimization method with the dynamic server update algorithm to exploit the global momentum on the server and each local device for superior accuracy. Third, we develop a layer-adaptive model pruning method to carry out specific pruning operations, which is adapted to the diverse features of each layer so as to attain an excellent tradeoff between effectiveness and efficiency. Our proposed FL model, FedDUMAP, combines the three original techniques and has a significantly better performance compared with baseline approaches in terms of efficiency (up to 16.9 times faster), accuracy (up to 20.4% higher), and computational cost (up to 62.6% smaller).
Non-intrusive load monitoring (NILM) is an approach that helps residents obtain detailed information about household electricity consumption and has gradually become a research focus in recent years. Most of the existing algorithms on NILM build energy disaggregation models independently for an individual appliance while neglecting the relation among them. For this situation, this article proposes a multi-chain disaggregation method for NILM (MC-NILM). MC-NILM integrates the models generated by existing algorithms and considers the relation among these models to improve the performance of energy disaggregation. Given the high time complexity of searching for the optimal MC-NILM structure, this article proposes two methods to reduce the time complexity, the k-length chain method and the graph-based chain generation method. Finally, we use the Dataport and UK-DALE datasets to evaluate the feasibility, effectiveness, and generality of the MC-NILM.
1 November 2022 in IEEE Internet of Things Journal
With the fast development of modern networking technologies, the transmission rate and reliability of wireless networks have been greatly improved. Meanwhile, the fast-developing Internet of Things (IoT) devices provide continually increasing computation capability. Federated learning (FL) was proposed to leverage communication and computation resources to perform machine learning (ML) tasks on IoT devices. In wireless FL systems, devices train ML models with local data sets, and a base station (BS) aggregates these trained models so that data privacy is guaranteed by the isolation of data sets. However, in the existing works, the same global model is transmitted to devices individually over the wireless channel multiple times, while the updated local models are received only by the BS, which ignores the wireless broadcast channel, incurs large communication overhead, and slows down the overall training process. In this article, we propose the FedBroadcast protocol to efficiently exploit the shared wireless broadcast channel for the two-way model transmission in FL. In the downloading step, we let BS broadcast the global model once for all scheduled devices, and design a dynamic programming-based algorithm to schedule devices optimally. In the uploading step, we also leverage the wireless broadcast channel and select some devices to receive all the updated local models without waiting for model downloading in the next round. Finally, to solve the potential block-cyclic sampling problem brought by device scheduling, we adopt pluralistic averaging modification, which improves the convergence performance under extreme data distributions. Extensive experiments demonstrate that FedBroadcast outperforms the existing wireless FL under different system settings.