8 May 2023 in IEEE Journal on Selected Areas in Communications
Mobility management in 5G is challenging, and at higher frequencies, a larger number of cells is needed to provide similar coverage to that in 4G. Consequently, Base Stations (BSs) are placed much more densely and users experience frequent handovers, reducing network capacity. Advanced handover techniques are needed in 5G to perform smooth network operation. In this paper, we formulate an optimization problem, whose goal is to strive for fairness in data rates among users and to reduce handovers. To accomplish that, we consider jointly the decisions when to handover and to which BS a user is to be assigned. This is an integer nonlinear program, and by relaxing it, we obtain an upper bound. Further, due to its NP-hardness, we propose a centralized and a multi-agent Deep Q Network (DQN)-based algorithm, which both find near-optimal user-to-BS assignments. We evaluate our Reinforcement Learning-based solutions for networks of different sizes and users with different velocities. We compare our approaches with baselines and show that they outperform them considerably in terms of fairness and radio link failures while being within 95% of the optimum. Our DQN algorithms also reduce the handover rate by up to 93% and avoid ping-pong handovers almost completely.
25 May 2022 in IEEE Transactions on Network and Service Management
Realizing Service Function Chaining with a micro-service-based architecture results in an increased number of computationally cheap Virtual Network Functions (VNFs). Pinning cheap VNFs to dedicated CPU cores can waste resources since not every VNF fully utilizes its core. Thus, cheap VNFs should share CPU cores to improve resource utilization. However, sharing cores can result in degraded performance due to interference between VNFs, even in mildly loaded scenarios. We propose D2A , a system that combines Neural Combinatorial Optimization, Machine Learning (ML)-based Digital Twins (DTs), and Game Theory to optimize VNF assignments. Measurements in a testbed show that D2A increases throughput by up to 46% and reduces latency by up to 93%, compared to three baseline algorithms. Using an ML-based DT to model VNF interference increases throughput by up to 11%, and reduces latency by up to 90% compared to an analytical model of the system.