Over-the-air computation (AirComp) based federated learning (FL) is capable of achieving fast model aggregation by exploiting the waveform superposition property of multiple-access channels. However, the model aggregation performance is severely limited by the unfavorable wireless propagation channels. In this paper, we propose to leverage intelligent reflecting surface (IRS) to achieve fast yet reliable model aggregation for AirComp-based FL. To optimize the learning performance, we present the convergence analysis of our proposed IRS-assisted AirComp-based FL system, based on which we propose to maximize the number of scheduled devices of each communication round under certain mean-squared error (MSE) requirements. To tackle the formulated highly-intractable problem, we propose a two-step optimization framework. Specifically, we induce the sparsity of device selection in the first step, followed by solving a series of MSE minimization problems to find the maximum feasible device set in the second step. We then propose an alternating optimization framework, supported by the difference-of-convex programming for low-rank optimization, to efficiently design the aggregation beamformers at the BS and phase shifts at the IRS. Simulation results demonstrate that our proposed algorithm and the deployment of an IRS can achieve a higher FL prediction accuracy than the baseline schemes.
The rapid advancement of artificial intelligence technologies has given rise to diversified intelligent services, which place unprecedented demands on massive connectivity and gigantic data aggregation. However, the scarce radio resources and stringent latency requirement make it challenging to meet these demands. To tackle these challenges, over-the-air computation (AirComp) emerges as a potential technology. Specifically, AirComp seamlessly integrates the communication and computation procedures through the superposition property of multiple-access channels, which yields a revolutionary multiple-access paradigm shift from “compute-after-communicate” to “compute-when-communicate”. By this means, AirComp enables spectral-efficient and low-latency wireless data aggregation by allowing multiple devices to occupy the same channel for transmission. In this paper, we aim to present the recent advancement of AirComp in terms of foundations, technologies, and applications. The mathematical form and communication design are introduced as the foundations of AirComp, and the critical issues of AirComp over different network architectures are then discussed along with the review of existing literature. The technologies employed for the analysis and optimization on AirComp are reviewed from the information theory and signal processing perspectives. Moreover, we present the existing studies that tackle the practical implementation issues in AirComp systems, and elaborate the applications of AirComp in Internet of Things and edge intelligent networks. Finally, potential research directions are highlighted to motivate the future development of AirComp.
8 June 2022 in IEEE Journal on Selected Areas in Communications
Federated learning (FL) over resource-constrained wireless networks has recently attracted much attention. However, most existing studies consider one FL task in single-cell wireless networks and ignore the impact of downlink/uplink inter-cell interference on the learning performance. In this paper, we investigate FL over a multi-cell wireless network, where each cell performs a different FL task and over-the-air computation (AirComp) is adopted to enable fast uplink gradient aggregation. We conduct convergence analysis of AirComp-assisted FL systems, taking into account the inter-cell interference in both the downlink and uplink model/gradient transmissions, which reveals that the distorted model/gradient exchanges induce a gap to hinder the convergence of FL. We characterize the Pareto boundary of the error-induced gap region to quantify the learning performance trade-off among different FL tasks, based on which we formulate an optimization problem to minimize the sum of error-induced gaps in all cells. To tackle the coupling between the downlink and uplink transmissions as well as the coupling among multiple cells, we propose a cooperative multi-cell FL optimization framework to achieve efficient interference management for downlink and uplink transmission design. Results demonstrate that our proposed algorithm achieves much better average learning performance over multiple cells than non-cooperative baseline schemes.
Fast wireless data aggregation and efficient battery recharging become two critical design challenges of Internet-of-Things (IoT) networks. Over-the-air computation (AirComp) and energy beamforming (EB) turn out to be two promising techniques that can address these two challenges, necessitating the design of wireless-powered AirComp. However, due to severe channel propagation, the energy harvested by IoT devices may not be sufficient to support AirComp. In this paper, we propose to leverage the intelligent reflecting surface (IRS) that is capable of dynamically reconfiguring the propagation environment to drastically enhance the efficiency of both downlink EB and uplink AirComp in IoT networks. Due to the coupled problems of downlink EB and uplink AirComp, we further propose the joint design of energy and aggregation beamformers at the access point, downlink/uplink phase-shift matrices at the IRS, and transmit power at the IoT devices, to minimize the mean-squared-error (MSE), which quantifies the AirComp distortion. However, the formulated problem is a highly intractable non-convex quadratic programming problem. To solve this problem, we first obtain the closed-form expressions of the energy beamformer and the device transmit power, and then develop an alternating optimization framework based on difference-of-convex programming to design the aggregation beamformers and IRS phase-shift matrices. Simulation results demonstrate the performance gains of the proposed algorithm over the baseline methods and show that deploying an IRS can significantly reduce the MSE of AirComp.
12 December 2023 in IEEE Transactions on Wireless Communications
Federated learning (FL) is recognized as a promising privacy-preserving distributed machine learning paradigm, given its potential to enable collaborative model training among distributed devices without sharing their raw data. However, supporting FL over wireless networks confronts the critical challenges of periodically executing power-hungry training tasks on energy-constrained devices and transmitting high-dimensional model updates over spectrum-limited channels. In this paper, we reap the benefits of both energy harvesting (EH) and over-the-air computation (AirComp) to alleviate the battery limitation by harvesting ambient energy to support both the training and transmission of local models, and to achieve low-latency model aggregation by concurrently transmitting local gradients via AirComp. We characterize the convergence of the proposed FL by deriving an upper bound of the expected optimality gap, revealing that the convergence depends on the accumulated errors due to partial device participation and model distortion, both of which further depend on dynamic energy levels. To accelerate the convergence, we formulate a joint AirComp transceiver design and device scheduling problem, which is then tackled by developing an efficient Lyapunov-based online optimization algorithm. Simulations demonstrate that, by appropriately scheduling devices and allocating energy across multiple communication rounds, our proposed algorithm achieves a much better learning performance than benchmarks.
15 November 2024 in IEEE Transactions on Vehicular Technology
Data heterogeneity and communication bottleneck are two critical factors that limit the performance of federated learning (FL) over wireless networks. To address these challenges, this paper introduces a hierarchical personalized federated learning (HPFL) framework, which employs a three-tier network architecture to enable the simultaneous learning of a global model and multiple personalized local models. Meanwhile, over-the-air computation (AirComp) is leveraged to support communication-efficient device-to-edge and edge-to-cloud model aggregations. To provide useful guidance for enhancing learning performance, we derive the convergence bound of the proposed AirComp-assisted HPFL, taking into account the interference among different clusters as well as data heterogeneity across different devices. To minimize the impact of accumulated transmission distortion on learning performance, we formulate an optimization problem involving the beamforming design at both cloud and edge servers, followed by developing a successive convex approximation-based algorithm at the cloud server and an interference-aware algorithm at each edge server to perform the receive beamforming design. Simulation results demonstrate that our proposed framework outperforms other FL frameworks and transceiver design algorithms in terms of test accuracy.