This paper investigates reconfigurable intelligent surface (RIS)-assisted simultaneous wireless information and power transfer (SWIPT) networks with rate splitting multiple access (RSMA). An energy efficiency (EE) maximization problem is formulated subject to the power budget at the transmitter and the quality of service (QoS) requirements of both information communication and energy harvesting, where the beamforming vectors, the power splitting (PS) ratios, the common message rates, and the discrete phase shifts are jointly optimized. To tackle the non-convex problem with both discrete and continuous variables, a deep reinforcement learning-based approach is proposed with the proximal policy optimization (PPO) framework. Different from traditional optimization approaches which optimizes the beamforming vectors and phase shifts separately and alternatively, our proposed PPO-based approach optimizes all the variables in unison. Besides, to perform beamforming design in action space, the beamforming vectors for the common stream and the private stream are respectively designed based on the maximum-ratio transmission and the zero forcing to enhance both energy and information transmission. To evaluate the performance of the PPO-based approach, a successive convex approximation (SCA) and Dinkelbach’s method based solution scheme (named SCA-D scheme) is also presented. Simulation results show that the system EE obtained by the proposed PPO-based approach is close to that obtained by the SCA-D scheme while outperforming various benchmarks. The RSMA contributes to the EE of the system greatly compared with traditional scheme. As for the case of time-varying channels, the proposed PPO-based approach is with much smaller running time by only sacrificing a slight EE performance compared with the SCA-D scheme.
30 April 2024 in IEEE Transactions on Wireless Communications
This paper investigates the system model and the transmit beamforming design for the Cell-Free massive multi-input multi-output (MIMO) integrated sensing and communication (ISAC) system. The impact of the uncertainty of the target locations on the propagation of wireless signals is considered during both uplink and downlink phases, and especially, the main statistics of the MIMO channel estimation error are theoretically derived in the closed-form fashion. A fundamental performance metric, termed communication-sensing (C-S) region, is defined for the considered system via three cases, i.e., the sensing-only case, the communication-only case and the ISAC case. The transmit beamforming design problems for the three cases are respectively carried out through different reformulations, e.g., the Lagrangian dual transform and the quadratic fractional transform, and some combinations of the block coordinate descent method and the successive convex approximation method. Numerical results present a 3-dimensional C-S region with a dynamic number of access points to illustrate the trade-off between communication and radar sensing. The advantage for radar sensing of the Cell-Free massive MIMO system is also studied via a comparison with the traditional cellular system. Finally, the efficacy of the proposed beamforming schemes is validated in comparison with zero-forcing and maximum ratio transmission schemes.
3 September 2021 in IEEE Internet of Things Journal
This article studies the unmanned aerial vehicle (UAV)-assisted wireless powered network, where a UAV is dispatched to wirelessly charge multiple ground nodes (GNs) by using radio frequency (RF) energy transfer and then the GNs use their harvested energy to upload the sensed information to the UAV. At each moment, the UAV is scheduled to charge the GNs or only one GN is scheduled to upload its data. An optimization problem is formulated to minimize the average Age of Information (AoI) of the GNs by jointly optimizing the trajectory of the UAV and the scheduling of information transmission and energy harvesting of GNs. As the problem is a combinational optimization problem with a set of binary variables, it is difficult to be solved. Thus, it is modeled as a Markov problem with large state spaces and a deep ${Q}$ network (DQN)-based scheme is proposed to find its near-optimal solution on the basis of the deep reinforcement learning (DRL) framework. Two nets are structured with artificial neural network (ANN), where one is for evaluating the reward of the action performed in current state, and the other is for predicting realistic action. The corresponding state spaces, the efficient action spaces, and reward function are designed. Simulation results demonstrate the convergence of the proposed DQN scheme, which also show that the proposed DQN scheme gets much smaller average AoI than the three other known schemes. Moreover, by involving the energy punishment in the reward, the UAV may save its energy but yield higher AoI. Additionally, the effects of the packet size, the transmit power, and the distribution area of GNs on the GNs’ average AoI are also discussed, which are expected to provide some useful insights.
1 October 2018 in IEEE Journal on Selected Areas in Communications
This paper considers a MISO simultaneous wireless information and power transfer (SWIPT) system where one transmitter serves multiple authorized receivers in presence of several potential eavesdroppers (idle receivers). To prevent the information interception by eavesdroppers, artificial noise (AN) is embedded into the transmit signals. The non-linear energy harvesting (EH) model is adopted and a novel power-splitting (PS) EH receiver architecture is proposed. Stochastic uncertainty channel model (SUM) is considered for the idle receivers due to outdated channel feedback. A global energy efficiency (GEE) maximization problem is formulated by jointly optimizing the transmit beamforming vectors, the AN covariance matrix and the PS ratios, under the minimal rate and secure transmission constraints of authorized receivers, the EH requirement constraints of idle receivers and the total available power constraint at the transmitter. Since the problem is non-convex with no known solution, it is solved based on the following solution framework. Firstly, the PS ratios are optimized by using bisection method and successive convex approximation (SCA) and then, the transmit beamforming vectors and the AN covariance matrix are jointly optimized by using a Dinkelbach’s Algorithm based method where SCA is applied to solve its inner subproblem. It is theoretically proved that by involving AN, the system GEE can be improved. Numerous results show that system GEE first increases and then keeps unchanged with the increment of the total available power, but it first keeps unchanged and then decreases with the increment of the minimal rate requirement. It is also observed that compared with traditional EH receiver architecture and linear EH model, our proposed PS EH receiver architecture is able to achieve higher GEE and avoid false output power at idle receivers.
3 July 2020 in IEEE Wireless Communications Letters
This letter studies rgb0.00,0.00,0.00the energy efficiency (EE) in a secure intelligent reflecting surface (IRS)-aided simultaneous wireless information and power transfer (SWIPT) network, where an access point (AP) serves information decoding receivers (IDRs) and energy harvesting receivers (EHRs) assisted by an IRS. rgb0.00,0.00,0.00An optimization problem is formulated to maximize the system EE by jointly optimizing the transmit beamforming vectors rgb0.00,0.00,0.00at the AP, the artificial noise (AN) covariance matrix at the AP, and the phase shifts at the IRS. To handle the non-convex problem, rgb0.00,0.00,0.00semi-definite relaxation (SDR) is adopted and then an efficient algorithm based on alternating optimization (AO) is proposed to obtain the suboptimal solution. Simulation results show that the system rgb0.00,0.00,0.00EE is significantly enhanced by employing IRS rgb0.00,0.00,0.00and optimizing AN. Moreover, EE firstly increases and then decreases with the increment of the number of reflecting elements. rgb0.00,0.00,0.00Additionally, the system EE decreases with the increment of the circuit power consumed by both the AP and the IRS.
15 October 2021 in IEEE Journal on Selected Areas in Communications
This paper proposes a multi-agent double deep Q network (DDQN)-based approach to jointly optimize the beamforming vectors and power splitting (PS) ratio in multi-user multiple-input single-output (MU-MISO) simultaneous wireless information and power transfer (SWIPT)-enabled heterogeneous networks (HetNets), where a macro base station (MBS) and several femto base stations (FBSs) serve multiple macro user equipments (MUEs) and femto user equipments (FUEs). The PS receiver architecture is deployed at FUEs. An optimization problem is formulated to maximize the achievable sum information rate of FUEs under the constraints of the achievable information rate requirements of MUEs and FUEs and the energy harvesting (EH) requirements of FUEs. Since the optimization problem is challenging to handle due to the high dimension and time-varying environment, an efficient multi-agent DDQN-based algorithm is presented, which is trained in a centralized manner and runs in a distributed manner, where two sets of deep neural network parameters are jointly updated and trained to tackle the problem and avoid overestimation. To facilitate the presented multi-agent DDQN-based algorithm, the action space, the state space and the reward function are designed, where the codebook matrix is employed to deal with the complex transmit beamforming vectors. Simulation results validate the proposed algorithm. Notable performance gains are achieved by the proposed algorithm due to considering the beam directions in the action space and the adaptability to the Doppler frequency shifts. Besides, the proposed algorithm is shown to be superior to other benchmark ones numerically.