Raphael Fonteneau

Raphael Fonteneau

orcid

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
5 May 2019 in Journal of Artificial Intelligence Research
Verified
Journal Article
Open access
PDF file
VFVincent Francois-Lavet
Vincent Francois-Lavet
GRGuillaume Rabusseau
Guillaume Rabusseau
JPJoelle Pineau
Joelle Pineau
DEDamien Ernst
Damien Ernst
RFRaphael Fonteneau
Raphael Fonteneau
This paper provides an analysis of the tradeoff between asymptotic bias (suboptimality with unlimited data) and overfitting (additional suboptimality due to limited data) in the context of reinforcement learning with partial observability. Our theoretical analysis formally characterizes that while potentially increasing the asymptotic bias, a smaller state representation decreases the risk of overfitting. This analysis relies on expressing the quality of a state representation by bounding $L_1$ error terms of the associated belief states. Theoretical results are empirically illustrated when the state representation is a truncated history of observations, both on synthetic POMDPs and on a large-scale POMDP in the context of smartgrids, with real-world data. Finally, similarly to known results in the fully observable setting, we also briefly discuss and empirically illustrate how using function approximators and adapting the discount factor may enhance the tradeoff between asymptotic bias and overfitting in the partially observable context.

1 January 2022 in Applied Energy
Verified
Journal Article
Closed access
DRDavid Radu
David Radu
MBMathias Berger
Mathias Berger
ADAntoine Dubois
Antoine Dubois
RFRaphael Fonteneau
Raphael Fonteneau
Hrvoje PandzicHrvoje Pandzic
Hrvoje Pandzic
DEDamien Ernst
Damien Ernst

12 March 2015 in International Journal of Computer Games Technology
Verified
Journal Article
Open access
PDF file
FSFiras Safadi
Firas Safadi
RFRaphael Fonteneau
Raphael Fonteneau
DEDamien Ernst
Damien Ernst
With modern video games frequently featuring sophisticated and realistic environments, the need for smart and comprehensive agents that understand the various aspects of complex environments is pressing. Since video game AI is often specifically designed for each game, video game AI tools currently focus on allowing video game developers to quickly and efficiently create specific AI. One issue with this approach is that it does not efficiently exploit the numerous similarities that exist between video games not only of the same genre, but of different genres too, resulting in a difficulty to handle the many aspects of a complex environment independently for each video game. Inspired by the human ability to detect analogies between games and apply similar behavior on a conceptual level, this paper suggests an approach based on the use of a unified conceptual framework to enable the development of conceptual AI which relies on conceptual views and actions to define basic yet reasonable and robust behavior. The approach is illustrated using two video games,RavenandStarCraft: Brood War.

28 March 2019 in Energies
Verified
Journal Article
Open access
PDF file
MVMiguel Manuel de Villena
Miguel Manuel de Villena
RFRaphael Fonteneau
Raphael Fonteneau
AGAxel Gautier
Axel Gautier
DEDamien Ernst
Damien Ernst
In the context of increasing decentralised electricity generation, this paper evaluates the effect of different regulatory frameworks on the evolution of distribution networks. This problem is addressed by means of agent based modelling in which the interactions between the agents of a distribution network and an environment are described. The consumers and the distribution system operator are the agents, which act in an environment that is composed by a set of rules. For a given environment, we can simulate the evolution of the distribution network by computing the actions of the agents at every time step of a discrete time dynamical system. We assume the electricity consumers are rational agents that may deploy distributed energy installations. The deployment of such installations may alter the remuneration mechanism of the distribution system operator. By modelling this mechanism, we may compute the evolution of the electricity distribution tariff in response to the deployment of distributed generation.

17 July 2023 in arXiv
Verified
Preprint
Open access
PDF file
VDVictor Dachet
Victor Dachet
ABAmina Benzerga
Amina Benzerga
RFRaphael Fonteneau
Raphael Fonteneau
DEDamien Ernst
Damien Ernst
In this paper, we propose a multi-RREH (Remote Renewable Energy Hub) based optimization framework. This framework allows a valorization of CO2 using carbon capture technologies. This valorization is grounded on the idea that CO2 gathered from the atmosphere or post combustion can be combined with hydrogen to produce synthetic methane. The hydrogen is obtained from water electrolysis using renewable energy (RE). Such renewable energy is generated in RREHs, which are locations where RE is cheap and abundant (e.g., solar PV in the Sahara Desert, or wind in Greenland). We instantiate our framework on a case study focusing on Belgium and 2 RREHs, and we conduct a techno-economic analysis. This analysis highlights the key role played by the cost of the two main carbon capture technologies: Post Combustion Carbon Capture (PCCC) and Direct Air Capture (DAC). In addition, we use our framework to derive a carbon price threshold above which carbon capture technologies may start playing a pivotal role in the decarbonation process of our industries. For example, this price threshold may give relevant information for calibrating the EU Emission Trading System so as to trigger the emergence of the multi-RREH.