Cellular broadband Internet of Things (IoT) applications are expected to keep growing year-by-year, generating demands from high throughput services. Since some of these applications are deployed over licensed mobile networks, as long term evolution (LTE), one already common problem is faced: the scarcity of licensed spectrum to cope with the increasing demand for data rate. The LTE-Unlicensed (LTE-U) forum, aiming to tackle this problem, proposed LTE-U to operate in the 5 GHz unlicensed spectrum. However, Wi-Fi is already the consolidated technology operating in this portion of the spectrum, besides the fact that new technologies for unlicensed band need mechanisms to promote fair coexistence with the legacy ones. In this work, we extend the literature by analyzing a multi-cell LTE-U/Wi-Fi coexistence scenario, with a high interference profile and data rates targeting a cellular broadband IoT deployment. Then, we propose a centralized, coordinated reinforcement learning framework to improve LTE-U/Wi-Fi aggregate data rates. The added value of the proposed solution is assessed by a ns-3 simulator, showing improvements not only in the overall system data rate but also in average user data rate, even with the high interference of a multi-cell environment.
1 January 2019 in Journal of Communication and Information Systems
There is substantial literature covering both problems and solutions related to the operation of Long Term Evolution (LTE) networks in unlicensed spectrum (LTE-U) while in coexistence with other technologies, such as Wi-Fi. However, a seldom explored scenario is the coexistence between multiple LTE-U networks. Within this scenario, a big issue is establishing optimal configurations that take into account fairness among different operators coexisting in the same unlicensed spectrum coverage area. Solutions to this problem could, for instance, react to changes in the environment by "tuning" different system configurations. We propose a game theoretical reinforcement learning algorithm, called GTDM-CSAT, aiming to maximize the LTE-U aggregated throughput while keeping channel access fairness among different access points. GTDM-CSAT uses the relative data rate offered by the system to adapt the LTE-U ON-OFF time . For this, we formulate the problem as a Markovian game, where the LTE-U operators coexist on a two-zero-sum game. The solution for the best ON-OFF time ratio is defined by applying a modified Minimax Q-learning algorithm for finding the game equilibrium. We perform simulations following 3GPP specifications using the ns-3 simulator for evaluating GTDM-CSAT under different traffic load scenarios. Results indicate gains in the system aggregated throughput, and improved performance regarding individual data rate by each operator.
Recent studies and literature reviews have shown promising results for 3GPP system solutions in unlicensed bands when coexisting with Wi-Fi, either by using the duty cycle (DC) approach or licensed-assisted access (LAA). However, it is widely known that general performance in these coexistence scenarios is dependent on traffic and how the duty cycle is adjusted. Most DC solutions configure their parameters statically, which can result in performance losses when the scenario experiences changes on the offered data. In our previous works, we demonstrated that reinforcement learning (RL) techniques can be used to adjust DC parameters. We showed that a Q-learning (QL) solution that adapts the LTE DC ratio to the transmitted data rate can maximize the Wi-Fi/LTE-Unlicensed (LTE-U) aggregated throughput. In this paper, we extend our previous solution by implementing a simpler and more efficient algorithm based on multiarmed bandit (MAB) theory. We evaluate its performance and compare it with the previous one in different traffic scenarios. The results demonstrate that our new solution offers improved balance in throughput, providing similar results for LTE and Wi-Fi, while still showing a substantial system gain. Moreover, in one of the scenarios, our solution outperforms the previous approach by 6% in system throughput. In terms of user throughput, it achieves more than 100% gain for the users at the 10th percentile of performance, while the old solution only achieves a 10% gain.
As the frequency spectrum becomes more and more occupied, discussions about technologies sharing the same band grow stronger. However, there are frequency bands reserved for the use of industrial, scientific, and medical applications, the so called ISM bands. For using this frequency range, it is required to adopt some coexistence technique.With the intention of providing higher speeds to users while keeping them connected to the same network, LTE in unlicensed spectrum (LTE-U) is devised. This work analyses two coexistence techniques proposed as LTE-U: LTE-LBT (Listen-Before-Talk), and LTE-DC (Duty Cycle). Our performance analysis focuses on 3GPP indoor scenario, providing results for FTP and UDP traffic patterns.