25 September 2020 in IEEE Transactions on Wireless Communications
Mobile edge computing (MEC) has emerged as a new paradigm to assist low latency services by enabling computation offloading at the network edge. Nevertheless, human mobility can significantly impact the offloading decision and performance in MEC networks. In this context, we propose device-to-device (D2D) cooperation based MEC to expedite the task execution of mobile user by leveraging proximity-aware task offloading. However, user mobility in such distributed architecture results in dynamic offloading decision that instigates mobility-aware task scheduling in our proposed framework. We jointly formulate task assignment and power allocation to minimize the total task execution latency by taking account of user mobility, distributed resources, tasks properties, and energy constraint of the user device. We first propose Genetic Algorithm (GA)-based evolutionary scheme to solve our formulated mixed-integer non-linear programming (MINLP) problem. Then we propose a heuristic named mobility-aware task scheduling (MATS) to obtain effective task assignment with low complexity. The extensive evaluation under realistic human mobility trajectories provides useful insights into the performance of our schemes and demonstrates that, both GA and MATS achieve better latency than other baseline schemes while satisfying the energy constraint of mobile device.
17 January 2018 in IEEE Transactions on Industrial Informatics
Device-to-device (D2D)-enabled Internet of Things (IoT) promises higher spectral efficiency and system capacity by sharing the cellular spectrum and offloading the cellular traffic. However, it poses new challenges in terms of resource allocation due to interference from D2D to base station (BS) and vice versa in the downlink (DL). Moreover, energy efficient operation of the network becomes a major challenge because of unattended operation of devices. In this study, we investigate resource allocation for energy harvesting-aided D2D communication underlaying cellular network. We formulate a joint subcarrier assignment and power allocation problem for multiple cellular and energy harvesting direct D2D links to maximize the overall sum rate subject to quality of service (QoS), subcarrier reuse, power and energy harvesting constraints. The problem is formulated as a mixed integer non linear programming (MINLP) and is difficult to be solved in polynomial time. Therefore, a low complexity algorithm named Energy Harvesting and Gain based Resource Allocation (EHGRA) is proposed, which determines reuse partners considering interference among D2D and cellular links and then allocates power optimally to them such that the sum rate is maximized. Our performance evaluation demonstrates that energy harvesting can boost up the system performance and at the same time can achieve higher sum rate over short frame duration. Comparison shows that EHGRA performs better than existing algorithms in terms of overall sum rate.
21 September 2020 in IEEE Internet of Things Journal
Driven by the soaring traffic demand and the growing diversity of mobile services, wireless networks are evolving to be increasingly dense and heterogeneous. Accordingly, in such large-scale and complicated wireless networks, the optimal controlling is reaching unprecedented levels of complexity, while its traditional solutions of handcrafted offline algorithms become inefficient due to high complexity, low robustness, and high overhead. Therefore, reinforcement learning, which enables network entities to learn from their actions and consequences in the interactive network environment, attracts significant attentions. In this paper, we comprehensively review the applications of reinforcement learning in wireless networks from a layering perspective. First, we present an overview of the principle, fundamentals and several advanced models of reinforcement learning. Then we review the up-to-date applications of reinforcement learning in various functionality blocks of different network layers, ranging from the low-level physical layer, to the high-level application layer. Finally, we outline a broad spectrum of challenges, open issues, and future research directions of reinforcement learning empowered wireless networks.