Oriol Corcoll Andreu

Mr. Oriol Corcoll Andreu

orcid

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
27 January 2023 in Artificial Intelligence Review
Verified
Journal Article
Closed access
PDF file
JAJaan Aru
Jaan Aru
ALAqeel Labash
Aqeel Labash
OAOriol Corcoll Andreu
Oriol Corcoll Andreu
RVRaul Vicente
Raul Vicente

13 March 2022 in Entropy
Verified
Journal Article
Open access
PDF file
AIAnti Ingel
Anti Ingel
AMAbdullah Makkeh
Abdullah Makkeh
OAOriol Corcoll Andreu
Oriol Corcoll Andreu
RVRaul Vicente
Raul Vicente
Intuitively, the level of autonomy of an agent is related to the degree to which the agent’s goals and behaviour are decoupled from the immediate control by the environment. Here, we capitalise on a recent information-theoretic formulation of autonomy and introduce an algorithm for calculating autonomy in a limiting process of time step approaching infinity. We tackle the question of how the autonomy level of an agent changes during training. In particular, in this work, we use the partial information decomposition (PID) framework to monitor the levels of autonomy and environment internalisation of reinforcement-learning (RL) agents. We performed experiments on two environments: a grid world, in which the agent has to collect food, and a repeating-pattern environment, in which the agent has to learn to imitate a sequence of actions by memorising the sequence. PID also allows us to answer how much the agent relies on its internal memory (versus how much it relies on the observations) when transitioning to its next internal state. The experiments show that specific terms of PID strongly correlate with the obtained reward and with the agent’s behaviour against perturbations in the observations.

21 February 2022 in arXiv
Verified
Preprint
Open access
PDF file
OAOriol Corcoll Andreu
Oriol Corcoll Andreu
RVRaul Vicente
Raul Vicente
Exploration and credit assignment under sparse rewards are still challenging problems. We argue that these challenges arise in part due to the intrinsic rigidity of operating at the level of actions. Actions can precisely define how to perform an activity but are ill-suited to describe what activity to perform. Instead, causal effects are inherently composable and temporally abstract, making them ideal for descriptive tasks. By leveraging a hierarchy of causal effects, this study aims to expedite the learning of task-specific behavior and aid exploration. Borrowing counterfactual and normality measures from causal literature, we disentangle controllable effects from effects caused by other dynamics of the environment. We propose CEHRL, a hierarchical method that models the distribution of controllable effects using a Variational Autoencoder. This distribution is used by a high-level policy to 1) explore the environment via random effect exploration so that novel effects are continuously discovered and learned, and to 2) learn task-specific behavior by prioritizing the effects that maximize a given reward function. In comparison to exploring with random actions, experimental results show that random effect exploration is a more efficient mechanism and that by assigning credit to few effects rather than many actions, CEHRL learns tasks more rapidly.

12 December 2022 in arXiv
Verified
Preprint
Open access
PDF file
JAJaan Aru
Jaan Aru
ALAqeel Labash
Aqeel Labash
OAOriol Corcoll Andreu
Oriol Corcoll Andreu
RVRaul Vicente
Raul Vicente
Theory of Mind is an essential ability of humans to infer the mental states of others. Here we provide a coherent summary of the potential, current progress, and problems of deep learning approaches to Theory of Mind. We highlight that many current findings can be explained through shortcuts. These shortcuts arise because the tasks used to investigate Theory of Mind in deep learning systems have been too narrow. Thus, we encourage researchers to investigate Theory of Mind in complex open-ended environments. Furthermore, to inspire future deep learning systems we provide a concise overview of prior work done in humans. We further argue that when studying Theory of Mind with deep learning, the research's main focus and contribution ought to be opening up the network's representations. We recommend researchers use tools from the field of interpretability of AI to study the relationship between different network components and aspects of Theory of Mind.

17 February 2022 in arXiv
Verified
Preprint
Open access
PDF file
OAOriol Corcoll Andreu
Oriol Corcoll Andreu
YMYoussef Mohamed
Youssef Mohamed
RVRaul Vicente
Raul Vicente
Identifying controllable aspects of the environment has proven to be an extraordinary intrinsic motivator to reinforcement learning agents. Despite repeatedly achieving State-of-the-Art results, this approach has only been studied as a proxy to a reward-based task and has not yet been evaluated on its own. Current methods are based on action-prediction. Humans, on the other hand, assign blame to their actions to decide what they controlled. This work proposes Controlled Effect Network (CEN), an unsupervised method based on counterfactual measures of blame to identify effects on the environment controlled by the agent. CEN is evaluated in a wide range of environments showing that it can accurately identify controlled effects. Moreover, we demonstrate CEN's capabilities as intrinsic motivator by integrating it in the state-of-the-art exploration method, achieving substantially better performance than action-prediction models.

23 April 2026 in npj Artificial Intelligence
Verified
Journal Article
Open access
PDF file
OAOriol Corcoll Andreu
Oriol Corcoll Andreu
AVAthanasios Vlontzos
Athanasios Vlontzos
MOMichael O’RIordan
Michael O’RIordan
CGCiarán M. Gilligan-Lee
Ciarán M. Gilligan-Lee
Estimating causal effects is vital for decision making. In standard causal effect estimation, treatments are usually binary- or continuous-valued. However, in many important real-world settings, treatments can be structured, high-dimensional objects, such as text, video, or audio. This provides a challenge to traditional causal effect estimation. While leveraging the shared structure across different treatments can help generalize to unseen treatments at test time, we show in this paper that using such structure blindly can lead to biased causal effect estimation. We address this challenge by devising a novel contrastive approach to learn a representation of the high-dimensional treatments, and prove that it identifies underlying causal factors and discards non-causally relevant factors. We prove that this treatment representation leads to unbiased estimates of the causal effect, and empirically validate our results on synthetic and real-world datasets.