Immersive virtual reality (VR) video is becoming increasingly popular owing to its enhanced immersive experience. To enjoy ultra-high resolution immersive VR video with wireless user equipments such as head-mounted displays (HMDs), ultra-low-latency viewport rendering and data transmission are the core prerequisites, which could not be achieved without a huge bandwidth and superior processing capabilities. Besides, potentially very high energy consumption at the HMD may impede the rapid development of wireless panoramic VR video. Multi-access edge computing (MEC) has emerged as a promising technology to reduce both the task processing latency and the energy consumption for HMD, while bandwidth-rich THz communication is expected to enable ultra-high-speed wireless data transmission. In this paper, we propose to minimize the long-term energy consumption of a THz wireless access based MEC system for high quality immersive VR video services support by jointly optimizing the viewport rendering offloading and downlink transmit power control. Considering the time-varying nature of wireless channel conditions, we propose a deep reinforcement learning based approach to learn the optimal viewport rendering offloading and transmit power control policies and an asynchronous advantage actor-critic (A3C) based joint optomization algorithm is proposed. Simulation results demonstrate that the proposed algorithm converges fast under different learning rates, and outperforms existing algorithms in terms of minimized energy consumption and maximized reward.
24 March 2021 in IEEE Transactions on Network Science and Engineering
When using blockchain in mobile systems, computation intensive mining tasks pose great challenges to the processing capabilities of mobile miner equipment. Mobile edge computing (MEC) is an effective solution to alleviating the problem via task offloading. In the mining process, miners compete for rewards through puzzle solving, where only the miner that first completes the process will be rewarded. Thus, miners may wish to pay higher price and use more communication resources in task offloading and more computation resources in task processing for latency reduction. However, there are risks for the miners not profiting from consuming more resources or paying a higher price, so miners are rational in blockchain systems. In order to maximize the rational total profit of all miners, we use an asynchronous advantage actor-critic (A3C) deep reinforcement learning algorithm to obtain the resource pricing and allocation, considering the stochastic properties of wireless channels, and the prospect theory is employed to strike a good balance between risks and rewards. Numerical results show that our proposed A3C based joint optimization algorithm converges fast and outperforms the baseline algorithms in terms of the total reward.
In order to improve the edge caching efficiency of the fog radio access network (F-RAN), this paper put forward a distributed deep Q-learning-based content caching scheme based on user preference prediction and content popularity prediction. Given that the constraint that the storage capacity of each device is limited, and the optimization problem is formulated so as to maximize the caching hit rate. Specifically, by taking users' selfishness into consideration, user preference is predicted in an offline manner by applying popular topic models. Then, the online predicted content popularity is achieved by combining the network topology relationship together with the obtained user preference. Finally, with the predicted user preference and content popularity, the deep Q-learning network (DQN)-based content caching algorithm is proposed to achieve the optimal content caching strategy. Moreover, we further present a content update policy with user preference and content popularity prediction, so that the proposed algorithm can handle the variations of contents popularity in a timely manner. Simulation results demonstrate that the proposed scheme achieves better caching hit rate compared with existing algorithms.
2 September 2024 in IEEE Transactions on Vehicular Technology
In this paper, a novel reconfigurable intelligent surface (RIS) aided communication system with multiple unmanned aerial vehicles (UAVs) is investigated. To achieve better system performance, we employ the non-orthogonal multiple access (NOMA) technique, and consider imperfect successive interference cancellation (SIC) at each user equipment (UE). To maximize the system throughput, we jointly optimize the three-dimensional (3D) trajectories of UAVs, the power allocation strategy, and the phase shift of the RIS. Due to the movement of UEs and UAVs, the formulated problem is difficult to solve. To address the formulated problem, we propose a two-step approach, named throughput maximization by trajectories design, power allocation and phase shift optimization (TMTDPAPO).Specifically, a K-means based UE clustering algorithm is adopted to group UEs. Then, a double deep Q-network (DDQN) approach is utilized to deal with the formulated problem. Extensive simulations are conducted, and results demonstrate that: (1) the TM-TDPAPO algorithm is effective in improving the system throughput, especially, the proposed approach achieves approximately 57% higher throughput gain compared to the conventional DQN algorithm; (2) by applying the imperfect SIC at each UE, the proposed scheme yields 23% performance gain than orthogonal multiple access (OMA) case; (3) the considered system with the deployment of RIS benefits from 29% throughput gain over the system without RIS.
Deep learning (DL) can effectively handle explosive data and solve the complicated non-convex problems. Recently, it is used to reduce the overhead of channel state information (CSI) feedback and improve the performance of the limited feedback massive MIMO systems. However, the complex wireless environment and the high-dimensional data of massive MIMO channel degrades the performance of the DL based codebook design. To address this issue, we propose a deep clustering (DC) based codebook design for massive MIMO systems. At first, deep neural network (DNN) learns the key propagation characteristics of the wireless channel according to the training model. And then, the clustering algorithm outputs the centroids of each key propagation characteristic, which can be used to reconstruct the valid space of massive MIMO channel. Finally, massive MIMO codebook is constructed by the valid space. Since the amount of the key propagation characteristics are far less than the dimension of massive MIMO channel, the proposed design can significantly simplify the parameters and the structures of DNN. Moreover, the clustering algorithm output the information with minimum sum-distance with the real channel sequences which can acquire the maximum sum-rate of massive MIMO codebook design. The robustness of the proposed codebook design is validated by carrying out extensive simulation in various scenarios and antenna array structures. Simulation results consist with theoretical analysis in terms of the achievable rate, and demonstrate that the proposed codebook design outperforms the traditional schemes.
In this paper, the joint design of energy-efficient multicast beamforming and in-network caching in Internet of Things is investigated. We propose the fractional in-network caching scheme. Specifically, parts of the sensed data resources are cached in the helpers, such as small-cell base stations and device-to-device equipments, and the caching fraction for a certain resource is the same among the helpers. The remaining data resources are kept in the sensor nodes. Employing multicast transmission at the helpers, the cached data can be cooperatively transmitted to the clients belonging to multiple multicast groups, where the data requests are identical among the clients in the same multicast group. Based on the proposed fractional caching and multicast transmission protocols, the power consumption model is established, and then we formulate the energy efficiency (EE) optimization problem, which is challenging to solve due to its non-convexity. Thereafter, by exploiting the Dinkelbach ’ s method, semi-definite relaxation, successive convex approximation and other approximation techniques, the original problem is converted into a second-order cone programming problem, which is convex and can be efficiently solved by off-the-shelf CVX solvers. Numerical results exhibit the fast convergence of the proposed algorithm, and demonstrate the superior EE performance of the proposed fractional caching scheme, compared to the benchmark strategies.