This paper addresses the problem of achieving lifelong open-ended learning autonomy in robotics, and how different cognitive architectures provide functionalities that support it. To this end, we analyze a set of well-known cognitive architectures in the literature considering the different components they address and how they implement them. Among the main functionalities that are taken as relevant for lifelong open-ended learning autonomy are the fact that architectures must contemplate learning, and the availability of contextual memory systems, motivations or attention. Additionally, we try to establish which of them were actually applied to real robot scenarios. It transpires that in their current form, none of them are completely ready to address this challenge, but some of them do provide some indications on the paths to follow in some of the aspects they contemplate. It can be gleaned that for lifelong open-ended learning autonomy, motivational systems that allow finding domain-dependent goals from general internal drives, contextual long-term memory systems that all allow for associative learning and retrieval of knowledge, and robust learning systems would be the main components required. Nevertheless, other components, such as attention mechanisms or representation management systems, would greatly facilitate operation in complex domains.
3 December 2018 in Integrated Computer-Aided Engineering
Cognitive Developmental Robotics relies on lifelong open-ended learning processes, where mechanisms are needed to allow the robot to self-discover and self-select goals as well as to self-define its state space evaluation with regards to them. Thus,
Hydrodynamic coefficients determine the behavior of all simulated underwater vehicles. Therefore, it is essential to precisely define their values when aiming to replicate a real vehicle. Generally established procedures for obtaining them tend to have limitations, especially in transient responses. To address these issues, this paper proposes a comprehensive methodology for obtaining the hydrodynamic coefficients of an underwater vehicle. The main novelty is the combination of empirical measurements as a first step and evolutionary algorithms as a final step for optimizing the coefficients. The proposed methodology is described and applied to a commercially available remotely operated vehicle (ROV) BlueROV2, followed by analyzing the results in detail and including several tests that compare it to the real vehicle to validate its adequacy.
12 May 2025 in IEEE Transactions on Cognitive and Developmental Systems
This paper addresses the challenge of developing artificial agents capable of autonomously discovering interesting environmental states, setting them as goals, and learning the necessary skills and curricula to achieve these goals—an essential requirement for deploying robotic systems in real-world scenarios. In such environments, robots must adapt to unforeseen situations, learn new skills, and manage unexpected changes autonomously, which is central to open-ended learning (OEL). We present H-GRAIL - Hierarchical Goal-discovery Robotic Architecture for Intrinsically-motivated Learning - an architecture designed to foster autonomous OEL in robotic agents. The novelty of H-GRAIL compared to existing approaches, which often address isolated challenges in OEL, is that it integrates multiple mechanisms that enable robots to autonomously discover new goals, acquire skills, and manage learning processes in dynamic, non-stationary environments. We present tests that demonstrate the advantages of this approach in enabling robots to achieve different goals in non-stationary environments and simultaneously address many of the challenges inherent to OEL.
This paper describes a re-descriptive approach to the efficient acquisition of ever higher level and more precise utility models within the motivational system (MotivEn) of a cognitive architecture. The approach is based on a two-step process whereby, as a first step, simple imprecise sensor correlation related utility models are obtained from the interaction traces of the robot. These utility models allow the robot to increase the frequency of achieving goals, and thus, provide lots of traces that can be used to try to train precise value functions implemented as artificial neural networks. The approach is tested experimentally on a real robotic setup that involves the coordination of two robots.