Hudson Henrique de Souza Lopes

Mr. Hudson Henrique de Souza Lopes

orcid

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 January 2023 in Journal of Communication and Information Systems
Verified
Journal Article
Open access
PDF file
HLHudson Henrique de Souza Lopes
Hudson Henrique de Souza Lopes
FRFLAVIO G C ROCHA
FLAVIO G C ROCHA
FVFlávio Vieira
Flávio Vieira
In this paper, we present an approach for resource scheduling in wireless networks based on the Network Slicing (NS) paradigm using Double Deep Q-Network (DDQN) Reinforcement Learning (RL) algorithm. More specifically, we propose a joint power and Scheduling Block (SB) allocation algorithm for networks with NS. The reinforcement learning algorithm applied to the resource allocation problem is formulated using state transitions regarding the system dynamics. We also present an algorithm, namely Network Slicing based on Reinforcement Learning (NSRL) that combines the proposed reinforcement learning based resource allocation with an approach based on reservation and sharing of resources among the slices where each RL agent acts in one slice. Simulations are carried out considering User Equipments (UEs) within a small cell coverage area - (Small Cells) with different Modulation and Coding Schemes (MCS) standardized by the 3rd Generation Partnership Project (3GPP) based on a simplified NS scenario with fifth generation wireless network (5G) characteristics. In the simulations, two slices are considered for the UEs: one considering Ultra-reliable and Low Latency Communications (URLLC) and other related to enhanced Mobile Broadband (eMBB) services. Simulation results show that the NSRL algorithm efficiently allocates power and SBs, outperforming other algorithms in the literature.

20 September 2024 in Sensors
Verified
Journal Article
Open access
PDF file
HLHudson Henrique de Souza Lopes
Hudson Henrique de Souza Lopes
LLLucas Jose Ferreira Lima
Lucas Jose Ferreira Lima
TSTelma Woerle de Lima Soares
Telma Woerle de Lima Soares
FVFlávio Vieira
Flávio Vieira
Next-generation mobile networks, such as those beyond the 5th generation (B5G) and 6th generation (6G), have diverse network resource demands. Network slicing (NS) and device-to-device (D2D) communication have emerged as promising solutions for network operators. NS is a candidate technology for this scenario, where a single network infrastructure is divided into multiple (virtual) slices to meet different service requirements. Combining D2D and NS can improve spectrum utilization, providing better performance and scalability. This paper addresses the challenging problem of dynamic resource allocation with wireless network slices and D2D communications using deep reinforcement learning (DRL) techniques. More specifically, we propose an approach named DDPG-KRP based on deep deterministic policy gradient (DDPG) with K-nearest neighbors (KNNs) and reward penalization (RP) for undesirable action elimination to determine the resource allocation policy maximizing long-term rewards. The simulation results show that the DDPG-KRP is an efficient solution for resource allocation in wireless networks with slicing, outperforming other considered DRL algorithms.