There is an increased interest in the district-scale energy transition within interdisciplinary research community. Agent-based modelling presents a suitable approach to address variety of questions related to policies, technologies, processes, and the different stakeholder roles that can foster such transition. However, it is a largely complex and versatile methodology which hinders its broader uptake by researchers as well as improved results. This state-of-the-art review focuses on the application of agent-based modelling for exploring policy interventions that facilitate the decarbonisation (i.e., energy transition) of districts and neighbourhoods while considering stakeholders’ social characteristics and interactions. We systematically select and analyse peer-reviewed literature and discuss the key modelling aspects, such as model purpose, agents and decision-making logic, spatial and temporal aspects, and empirical grounding. The analysis reveals that the most established agent-based models’ focus on innovation diffusion (e.g., adoption of solar panels) and dissemination of energy-saving behaviour among a group of buildings in urban areas. We see a considerable gap in exploring the decisions and interactions of agents other than residential households, such as commercial and even industrial energy consumers (and prosumers). Moreover, measures such as building retrofits and conversion to district energy systems involve many stakeholders and complex interactions between them that up to now have hardly been represented in the agent-based modelling environment. Hence, this work contributes to better understanding and further improving the research on transition towards decarbonised society.
Electrification of the transportation sector provides several advantages in favor of climate protection and a shared economy. At the same time, the rapid growth of electric vehicles also demands innovative solutions to mitigate risks to the low-voltage network due to unpredictable charging patterns of electric vehicles. This article conceptualizes a stochastic reinforcement learning agent that learns the optimal policy for regulating the charging power. The optimization objective intends to reduce charging time, thus charging faster while minimizing the expected voltage violations in the distribution network. The problem is formulated as a two-stage optimization routine where the stochastic policy gradient agent predicts the boundary condition of the inner non-linear optimization problem. The results confirm the performance of the proposed architecture to control the charging power as intended. The article also provides extensive theoretical background and directions for future research in this discipline.
In an energy community, the prosumers’ interactions are critical to ensure efficient use of renewable resources. Local energy sharing concepts where a coordinating agent typically regulates the energy transactions between prosumers intend to achieve such a sharing economy. The coordinating agent, known as the market agent or energy sharing agent, acts according to a set of rules to match the prosumers’ renewable energy surpluses and deficits. This paper describes an agent-based modeling strategy and a case study to demonstrate the interactions in an energy sharing community where each agent individually and collectively attempts to maximize renewable energy self-consumption. The prosumers attempt to achieve their individual and collective objectives by following a two-step rule-based strategy. In the first step, a building-integrated battery storage operation strategy based on a schedule improves the prosumer-level self-consumption while providing grid-friendly behavior. The next step involves an energy sharing strategy and an operating strategy for community-scale battery storage that maximizes the collective selfconsumption. Throughout the transactions, prosumers have no visibility of other prosumers; therefore, the energy sharing coordinator has the sole responsibility of orchestrating the energy exchanges between prosumers. Finally, we discuss the significance and future research outlook for energy interaction modeling at a community scale.
In this article, we address the question of electric bus planning and operation under stochastic travel time and energy consumption. Uncertainties in the environment may cause disruptions to the planning and operation of electric buses, and a transportation planner must anticipate such conditions and be able to respond appropriately. One of the preconditions for planning robust strategies is understanding the existence and impact of multiple trade-off scenarios, which is the basis for this study. We model the travel time delays and trip energy consumption using estimated probability density functions and use a stochastic, mixed-integer formulation with chance constraints to evaluate several trade-off scenarios for electric bus fleets under uncertainty. The results show the existence of trade-off scenarios that lead to varying degrees of impacts related to network and environment. Careful fleet planning, dispatch, and charge control enable us to make the balance between these trade-offs and achieve better operational performances under uncertainty.
The expansion of charging infrastructure and the optimal utilization of existing infrastructure are key influencing factors for the future growth of electric mobility. The main objective of this paper is to present a novel methodology which identifies the necessary stakeholders, processes their contextual information and meets their optimality criteria using a constraint satisfaction strategy. A deep reinforcement learning algorithm is used for optimally distributing the electric vehicle charging resources in a smart-mobility ecosystem. The algorithm performs context-aware, constrained-optimization such that the on-demand requests of each stakeholder, e.g., vehicle owner as end-user, grid-operator, fleet-operator, charging-station service operator, is fulfilled. In the proposed methodology, the system learns from the surrounding environment until the optimal charging resource allocation strategy within the limitations of the system constraints is reached. We look at the concept of optimality from the perspective of multiple stakeholders who participate in the smart-mobility ecosystem. A simple use case is presented in detail. Finally, we discuss the potential to develop this concept further to enable more complex digital interactions between the actors of a smart-mobility eco-system.