This paper proposes a multi-agent double deep Q network (DDQN)-based approach to jointly optimize the beamforming vectors and power splitting (PS) ratio in multi-user multiple-input single-output (MU-MISO) simultaneous wireless information and power transfer (SWIPT)-enabled heterogeneous networks (HetNets), where a macro base station (MBS) and several femto base stations (FBSs) serve multiple macro user equipments (MUEs) and femto user equipments (FUEs). The PS receiver architecture is deployed at FUEs. An optimization problem is formulated to maximize the achievable sum information rate of FUEs under the constraints of the achievable information rate requirements of MUEs and FUEs and the energy harvesting (EH) requirements of FUEs. Since the optimization problem is challenging to handle due to the high dimension and time-varying environment, an efficient multi-agent DDQN-based algorithm is presented, which is trained in a centralized manner and runs in a distributed manner, where two sets of deep neural network parameters are jointly updated and trained to tackle the problem and avoid overestimation. To facilitate the presented multi-agent DDQN-based algorithm, the action space, the state space and the reward function are designed, where the codebook matrix is employed to deal with the complex transmit beamforming vectors. Simulation results validate the proposed algorithm. Notable performance gains are achieved by the proposed algorithm due to considering the beam directions in the action space and the adaptability to the Doppler frequency shifts. Besides, the proposed algorithm is shown to be superior to other benchmark ones numerically.

This article investigates simultaneous transmitting and reflecting reconfigurable intelligent surface (STAR-RIS)-assisted downlink multiuser multiple-input–single-output (MU-MISO) networks with the rate splitting multiple access (RSMA) scheme. A base station (BS) desires to simultaneously transmit messages to multiple users with the assistance of an STAR-RIS to enhance communication quality as well as extend the coverage of users. An optimization problem is formulated to maximize the achievable sum rate of the networks on the premise of satisfying the constraints on power budget at the BS, total common-stream rate of users, and individual users’ minimum rate requirements, via jointly optimizing the beamforming vectors, the common-stream rate allocation vector, and the transmission and reflection coefficients (TARCs) matrix. Due to the dynamic changes of communication links and the coupling of multiple variables, it is challenging to solve such a nonconvex optimization problem by utilizing traditional methods. Therefore, a proximal policy optimization (PPO)-based deep reinforcement learning (DRL) algorithm is proposed, where the reward function, the action space and the state space are designed properly. A constraint-satisfaction-processing (CSP) method is employed to further adjust the optimized transmit power to make sure that the obtained optimized results satisfy the power budget constraint. Simulation results show that the proposed PPO-based DRL algorithm converges well and achieves much better performance than several baselines, such as the soft actor–critic (SAC), the deep deterministic policy gradient (DDPG), the genetic algorithm (GA), the maximum ratio transmission (MRT), the zero-forcing (ZF), and the random methods. Moreover, it demonstrates that deploying STAR-RIS greatly enhances the system sum rate and user fairness compared to deploying traditional reflecting-only RIS (RO-RIS) and without RIS. Besides, it also shows that adopting the RSMA scheme achieves more notable performance gains than the nonorthogonal multiple access (NOMA) scheme in such a network.

The growing interest in intelligent services and privacy protection for mobile devices has given rise to the widespread application of federated learning in Multi-access Edge Computing (MEC). Diverse user behaviors call for personalized services with heterogeneous Machine Learning (ML) models on different devices. Federated Multi-task Learning (FMTL) is proposed to train related but personalized ML models for different devices, whereas previous works suffer from excessive communication overhead during training and neglect the model heterogeneity among devices in MEC. Introducing knowledge distillation into FMTL can simultaneously enable efficient communication and model heterogeneity among clients, whereas existing methods rely on a public dataset, which is impractical in reality. To tackle this dilemma, Fed erated Mult I -task Distillation for Multi-access Edge C ompu T ing (FedICT) is proposed. FedICT direct local-global knowledge aloof during bi-directional distillation processes between clients and the server, aiming to enable multi-task clients while alleviating client drift derived from divergent optimization directions of client-side local models. Specifically, FedICT includes Federated Prior Knowledge Distillation (FPKD) and Local Knowledge Adjustment (LKA). FPKD is proposed to reinforce the clients' fitting of local data by introducing prior knowledge of local data distributions. Moreover, LKA is proposed to correct the distillation loss of the server, making the transferred local knowledge better match the generalized representation. Extensive experiments on three datasets demonstrate that FedICT significantly outperforms all compared benchmarks in various data heterogeneous and model architecture settings, achieving improved accuracy with less than 1.2% training communication overhead compared with FedAvg and no more than 75% training communication round compared with FedGKT in all considered scenarios.

Edge Intelligence (EI) allows Artificial Intelligence (AI) applications to run at the edge, where data analysis and decision-making can be performed in real-time and close to data sources. To protect data privacy and unify data silos distributed among end devices in EI, Federated Learning (FL) is proposed for collaborative training of shared AI models across multiple devices without compromising data privacy. However, the prevailing FL approaches cannot guarantee model generalization and adaptation on heterogeneous clients. Recently, Personalized Federated Learning (PFL) has drawn growing awareness in EI, as it enables a productive balance between local-specific training requirements inherent in devices and global-generalized optimization objectives for satisfactory performance. However, most existing PFL methods are based on the Parameters Interaction-based Architecture (PIA) represented by FedAvg, which suffers from unaffordable communication burdens due to large-scale parameters transmission between devices and the edge server. In contrast, Logits Interaction-based Architecture (LIA) allows to update model parameters with logits transfer and gains the advantages of communication lightweight and heterogeneous on-device model allowance compared to PIA. Nevertheless, previous LIA methods attempt to achieve satisfactory performance either relying on unrealistic public datasets or increasing communication overhead for additional information transmission other than logits. To tackle this dilemma, we propose a knowledge cache-driven PFL architecture, named FedCache, which reserves a knowledge cache on the server for fetching personalized knowledge from the samples with similar hashes to each given on-device sample. During the training phase, ensemble distillation is applied to on-device models for constructive optimization with personalized knowledge transferred from the server-side knowledge cache. Empirical experiments on four datasets demonstrate that FedCache achieves comparable performance with state-of-art PFL approaches, with more than two orders of magnitude improvements in communication efficiency. Our code and DEMO are available at https://github.com/wuzhiyuan2000/FedCache .

The participatory nature of federated learning (FL) makes it attractive for fingerprinting-based indoor localization in multibuilding and multifloor environments. A group of sensing clients can collaboratively leverage their private, local fingerprint data to help their edge server update a location prediction model. However, it is challenging to jointly handle the two involved issues, i.e., building-floor classification (BFC) and latitude–longitude regression (LLR), in a wide 3-D space through enabling FL on decentralized yet heterogeneous data and over an imperfect wireless network. In this article, we confront these challenges and propose an FL framework, FedLoc3D, for both BFC and LLR. Specifically, the former issue is addressed by an FedDSC-BFC approach, which generates a multilabel classification model based on a convolutional neural network with depthwise separable convolutions. The latter issue is addressed by an FedADA-LLR approach, which develops a multitarget regression model based on a deep neural network with autoencoder and data augmentation. Extensive experiments on a real-world data set of WiFi fingerprints are carried out, and our approaches with enhanced capabilities of feature extraction, generalization, and convergence are validated to improve both localization accuracy and learning efficiency under data heterogeneity and network instability.

Traffic flow forecasting (TFF) is of great importance to the construction of Intelligent Transportation Systems. To mitigate communication burden and tackle with the problem of privacy leakage aroused by centralized forecasting methods, Federated Learning (FL) has been applied to TFF. However, existing FL-based approaches employ batch learning manner, which makes the pre-trained models inapplicable to subsequent traffic data, thus exhibiting subpar prediction performance. In this paper, we perform the first study of forecasting traffic flow adopting online learning manner in FL framework and then propose a novel prediction method named Online Spatio-Temporal Correlation-based Federated Learning (FedOSTC), aiming to guarantee performance gains regardless of traffic fluctuation. Specifically, clients employ Gated Recurrent Unit (GRU)-based encoders to obtain the internal temporal patterns inside traffic data sequences. Then, the central server evaluates spatial correlation among clients via Graph Attention Network (GAT), catering to the dynamic changes of spatial closeness caused by traffic fluctuation. Furthermore, to improve the generalization of the global model for upcoming traffic data, a period-aware aggregation mechanism is proposed to aggregate the local models which are optimized using Online Gradient Descent (OGD) algorithm at clients. We perform comprehensive experiments on two real-world datasets to validate the efficiency and effectiveness of our proposed method and the numerical results demonstrate the superiority of FedOSTC.