Alberto del Rio

Alberto del Rio


Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
2 October 2024 in IEEE Access
Verified
Journal Article
Open access
ARAlberto Del Rio
Alberto Del Rio
DJDavid Jiménez
David Jiménez
JSJavier Serrano
Javier Serrano
This research article presents a comparison between two mainstream Deep Reinforcement Learning (DRL) algorithms, Asynchronous Advantage Actor-Critic (A3C) and Proximal Policy Optimization (PPO), in the context of two diverse environments: CartPole and Lunar Lander. DRL algorithms are widely known for their effectiveness in training agents to navigate complex environments and achieve optimal policies. Nevertheless, a methodical assessment of their effectiveness in various settings is crucial for comprehending their advantages and disadvantages. In this study, we conduct experiments on the CartPole and Lunar Lander environments using both A3C and PPO algorithms. We compare their performance in terms of convergence speed and stability. Our results indicate that A3C typically achieves quicker training times, but exhibits greater instability in reward values. Conversely, PPO demonstrates a more stable training process at the expense of longer execution times. An evaluation of the environment is needed in terms of algorithm selection, based on specific application needs, balancing between training time and stability. A3C is ideal for applications requiring rapid training, while PPO is better suited for those prioritizing training stability.

17 December 2024 in AI
Verified
Journal Article
Open access
PDF file
PBPilar Schümmer Bengoa
Pilar Schümmer Bengoa
ARAlberto Del Rio
Alberto Del Rio
JSJavier Serrano
Javier Serrano
DJDavid Jiménez
David Jiménez
GIGuillermo Sánchez Illán
Guillermo Sánchez Illán
ÁGÁlvaro Llorente Gómez
Álvaro Llorente Gómez
Background: In the last decade, numerous methods have been proposed to define and detect outliers, particularly in complex environments like networks, where anomalies significantly deviate from normal patterns. Although defining a clear standard is challenging, anomaly detection systems have become essential for network administrators to efficiently identify and resolve irregularities. Methods: This study develops and evaluates a machine learning-based system for network anomaly detection, focusing on point anomalies within network traffic. It employs both unsupervised and supervised learning techniques, including change point detection, clustering, and classification models, to identify anomalies. SHAP values are utilized to enhance model interpretability. Results: Unsupervised models effectively captured temporal patterns, while supervised models, particularly Random Forest (94.3%), demonstrated high accuracy in classifying anomalies, closely approximating the actual anomaly rate. Conclusions: Experimental results indicate that the system can accurately predict network anomalies in advance. Congestion and packet loss were identified as key factors in anomaly detection. This study demonstrates the potential for real-world deployment of the anomaly detection system to validate its scalability.

26 July 2023 in Healthcare
Verified
Journal Article
Open access
PDF file
JJJennifer Jiménez
Jennifer Jiménez
ARAlberto Del Rio
Alberto Del Rio
ABArianna Berman
Arianna Berman
MGMiriam Grande Gordon
Miriam Grande Gordon
The ageing of the population is growing significantly and will challenge healthcare systems. Chronic diseases in the older population require a change in service delivery, and new technologies can be a key element in ensuring the viability and sustainability of these systems. However, the generation gap and the physical and cognitive decline commonly associated with the older generation are barriers to the transition to these models of care. Despite this, there has been a trend towards digital healthcare, which has many potential benefits for the older population. Numerous studies have assessed the acceptability of new technologies for older people in healthcare. These studies highlight the importance of perceived usefulness, compatibility, ease of use and personalisation of the technology. Personalisation is necessary to ensure that the system is useful for users, and different characteristics such as country of origin, gender, age, or comfort with the technology should be taken into account. A person-centred approach in the development of new health technology systems is essential to ensure that applications can be better tailored to the needs of different ageing populations. Many organisations have dedicated time and resources to ensure a person-centred approach in the development of new health technology systems, and putting the individual first is the best way forward in digital health. This article presents the work carried out in this regard in the framework of the European TeNDER project together with an analysis of the results obtained in terms of satisfaction, usefulness, and usability from end-users. The dynamic and continuous process carried out throughout the TeNDER project translates the needs reported by users, as far as personalisation of interactions is concerned. All end-users held a positive opinion about the usability and usefulness of the system.

29 May 2024 in IEEE Access
Verified
Journal Article
Open access
Rute C. SofiaRute C. Sofia
Rute C. Sofia
JSJosh Salomon
Josh Salomon
SFSimone Ferlin-Reiter
Simone Ferlin-Reiter
LGLuis Garcés-Erice
Luis Garcés-Erice
PUPeter Urbanetz
Peter Urbanetz
MJMarco Jahn
Marco Jahn
This perspective paper introduces a novel framework for container orchestration called CODECO. The CODECO orchestration framework relies on a data-network-computing approach to define the best infrastructure that can support the operation of next-generation Internet applications across a mobile, heterogeneous Edge-Cloud continuum. The selection of such an infrastructure is aligned with target performance profiles defined by the user, such as resilience or greenness. CODECO proposes to rely on decentralized Artificial Intelligence approaches in an attempt to provide the most suitable infrastructure to an application deployment, considering infrastructural challenges, such as intermittent connectivity and node failure. This paper explains the current CODECO framework and provides insight into operational use-cases where CODECO is being deployed, as relevant examples of application for such a framework. Recent developments in the creation of the open-source CODECO framework are described and explained, allowing the use of the framework by the research community. The paper then provides a thorough analysis of CODECO’s features in comparison with existing orchestration frameworks, explaining the benefits introduced with this dynamic orchestration approach.

14 October 2022 in Applied Sciences
Verified
Journal Article
Open access
PDF file
ARAlberto Del Rio
Alberto Del Rio
JSJavier Serrano
Javier Serrano
DJDavid Jiménez
David Jiménez
LCLuis Miguel Contreras-Murillo
Luis Miguel Contreras-Murillo
FAFederico Alvarez
Federico Alvarez
Media applications are amongst the most demanding services. They require high amounts of network capacity as well as computational resources for synchronous high-quality audio–visual streaming. Recent technological advances in the domain of new generation networks, specifically network virtualization and Multiaccess Edge Computing (MEC) have unlocked the potential of the media industry. They enable high-quality media services through dynamic and efficient resource allocation taking advantage of the flexibility of the layered architecture offered by 5G. The presented work demonstrates the potential application of Artificial Intelligence (AI) capabilities for multimedia services deployment. The goal was targeted to optimize the Quality of Experience (QoE) of real-time video using dynamic predictions by means of Deep Reinforcement Learning (DRL) algorithms. Specifically, it contains the initial design and test of a self-optimized cloud streaming proof-of-concept. The environment is implemented through a virtualized end-to-end architecture for multimedia transmission, capable of adapting streaming bitrate based on a set of actions. A prediction algorithm is trained through different state conditions (QoE, bitrate, encoding quality, and RAM usage) that serves the optimizer as the encoding values of the environment for action prediction. Optimization is applied by selecting the most suitable option from a set of actions. These consist of a collection of predefined network profiles with associated bitrates, which are validated by a list of reward functions. The optimizer is built employing the most prominent algorithms in the DRL family, with the use of two Neural Networks (NN), named Advantage Actor–Critic (A2C). As a result of its application, the ratio of good quality video segments increased from 65% to 90%. Furthermore, the number of image artifacts is reduced compared to standard sessions without applying intelligent optimization. From these achievements, the global QoE obtained is clearly better. These results, based on a simulated scenario, increase the interest in further research on the potential of applying intelligence to enhance the provisioning of media services under real conditions.

26 March 2024 in Computer Networks
Verified
Journal Article
Open access
ARAlberto Del Rio
Alberto Del Rio
JSJavier Serrano
Javier Serrano
DJDavid Jiménez
David Jiménez
LCLuis Miguel Contreras-Murillo
Luis Miguel Contreras-Murillo
FAFederico Alvarez
Federico Alvarez