Network Slicing and Deep Reinforcement Learning (DRL) are vital enablers for achieving 5G and 6G networks. A 5G/6G network can comprise various network slices from unique or multiple tenants. Network providers need to perform intelligent and efficient resource management to offer slices that meet the quality of service and quality of experience requirements of 5G/6G use cases. Resource management is far from being a straightforward task. This task demands complex and dynamic mechanisms to control admission and allocate, schedule, and orchestrate resources. Intelligent and effective resource management needs to predict the services’ demand coming from tenants (each tenant with multiple network slice requests) and achieve autonomous behavior of slices. This paper identifies the relevant phases for resource management in network slicing and analyzes approaches using reinforcement learning (RL) and DRL algorithms for realizing each phase autonomously. We analyze the approaches according to the optimization objective, the network focus (core, radio access, edge, and end-to-end network), the space of states, the space of actions, the algorithms, the structure of deep neural networks, the exploration–exploitation method, and the use cases (or vertical applications). We also provide research directions related to RL/DRL-based network slice resource management.

Existing models to estimate profitability in small-scale coffee production are based on limited information leading to precision problems in the estimations and, therefore, fail to represent the real economic return. This leads smallholders to make decisions based on inaccurate information with negative consequences on their financial status. This paper introduces a novel hierarchical approach called HMP-Coffee (Hierarchical Model Profitability Coffee) to estimate the profitability level in small-scale coffee productions, supporting smallholders, in decision-making, to improve their income and, consequently, their economic sustainability. HMP-Coffee considers a Contextual Knowledge Phase, based on expert knowledge, to create a conceptual model about the profitability in small-scale coffee productions and a Hierarchical-Multicriteria Phase responsible for translating such a conceptual model into an understandable hierarchical qualitative model able to estimate the level of profitability in small coffee productions precisely. HMP-Coffee was developed by considering the La Sultana farm’s operation in Cauca, Colombia and evaluated with independent data from the Costa Rican Coffee Institute. In the evaluation results, HMP-Coffee achieved 81.72% accuracy, 81.33% precision, 92.30% recall, and 83.46% F-Score. From the results obtained, we conclude that HMP-Coffee is a reliable model to estimate the profitability of small-scale coffee production. Its reliability improves the decision-making for obtaining crops with better economic sustainability.