Managing grid-connected charging stations for fleets of electric vehicles leads to an optimal control problem where user preferences must be met with minimum energy costs (e.g., by exploiting lower electricity prices through the day, renewable energy production, and stored energy of parked vehicles). Instead of state-of-the-art charging scheduling based on open-loop strategies that explicitly depend on initial operating conditions, this paper proposes an approximate dynamic programming feedback-based optimization method with continuous state space and action space, where the feedback action guarantees uniformity with respect to initial operating conditions, while price variations in the electricity and available solar energy are handled automatically in the optimization. The resulting control action is a multi-modal feedback, which is shown to handle a wide range of operating regimes, via a set of controllers whose action that can be activated or deactivated depending on availability of solar energy and pricing model. Extensive simulations via a charging test case demonstrate the effectiveness of the approach.

With the rise in electricity, gas and oil prices and the persistently high levels of carbon emissions, there is an increasing demand for effective energy management in energy systems, including electrical grids. Recent literature exhibits large potential for optimizing the behavior of such systems towards energy performance, reducing peak loads and exploiting environmentally friendly ways for energy production. However, the primary challenge relies on the optimization of such systems, which introduces significant complexities since they present quite dynamic behavior. Such cyberphysical frameworks usually integrate multiple interconnected components such as power plants, transmission lines, distribution networks and various types of energy-storage systems, while the behavior of these components is affected by various external factors such as user individual requirements, weather conditions, energy demand and market prices. Consequently, traditional optimal control approaches—such as Rule-Based Control (RBC)—prove inadequate to deal with the diverse dynamics which define the behavior of such complicated frameworks. Moreover, even sophisticated techniques—such as Model Predictive Control (MPC)—showcase model-related limitations that hinder the applicability of an optimal control scheme. To this end, AI model-free techniques such as Reinforcement Learning (RL) offer a fruitful potential for embedding efficient optimal control in cases of energy systems. Recent studies present promising results in various fields of engineering, indicating that RL frameworks may prove the key element for delivering efficient optimal control in smart buildings, electric vehicle charging and smart grid applications. The current paper provides a comprehensive review of RL implementations in energy systems frameworks—such as Renewable Energy Sources (RESs), Building Energy-Management Systems (BEMSs) and Electric Vehicle Charging Stations (EVCSs)—illustrating the benefits and the opportunities of such approaches. The work examines more than 80 highly cited papers focusing on recent RL research applications—between 2015 and 2023—and analyzes the model-free RL potential as regards the energy systems’ control optimization in the future.

The rapid evolution of Generative Artificial Intelligence (GenAI) is reshaping the energy sector, enabling new levels of adaptability, efficiency, and user-centric interaction. This review systematically maps and critically evaluates the chosen literature across buildings, grids, and urban systems. Through major scientific databases and for the span of five years, from 2021 to 2025, the review aims to identify key application domains, synergies, and research gaps. The analysis on recent advancements illustrates how GenAI enhances energy forecasting, demand–response strategies, anomaly detection, and cyber-resilience in power networks, while also supporting predictive modeling and optimal control in distributed renewable integration. Within smart buildings, GenAI empowers autonomous agents and AI copilots to balance comfort with energy efficiency through adaptive environmental control and user preference modeling. At the grid level, generative models improve renewable generation forecasting, grid stability, and decision support for operators. A further emerging application lies in the generation of synthetic energy data, which supports model training, scenario simulation, and robust decision-making in data-scarce environments. In the broader context of smart cities, GenAI-driven digital twins, multi-agent systems, and conversational interfaces facilitate sustainable planning and energy-aware citizen engagement. A central theme across these applications is the alignment of technological solutions with human needs and sustainability objectives. Key challenges remain in uncertainty quantification, trustworthy deployment, and data governance, underscoring the need for secure, adaptive, and human-centered GenAI systems to drive the next generation of intelligent energy management. This review provides a comprehensive analysis to promote a better understanding of generative models as they are being applied in a variety of scenarios in the energy domain.

The increasing number of electric vehicles (EVs) necessitates the installation of more charging stations. The challenge of managing these grid-connected charging stations leads to a multi-objective optimal control problem where station profitability, user preferences, grid requirements and stability should be optimized. However, it is challenging to determine the optimal charging/discharging EV schedule, since the controller should exploit fluctuations in the electricity prices, available renewable resources and available stored energy of other vehicles and cope with the uncertainty of EV arrival/departure scheduling. In addition, the growing number of connected vehicles results in a complex state and action vectors, making it difficult for centralized and single-agent controllers to handle the problem. In this paper, we propose a novel Multi-Agent and distributed Reinforcement Learning (MARL) framework that tackles the challenges mentioned above, producing controllers that achieve high performance levels under diverse conditions. In the proposed distributed framework, each charging spot makes its own charging/discharging decisions toward a cumulative cost reduction without sharing any type of private information, such as the arrival/departure time of a vehicle and its state of charge, addressing the problem of cost minimization and user satisfaction. The framework significantly improves the scalability and sample efficiency of the underlying Deep Deterministic Policy Gradient (DDPG) algorithm. Extensive numerical studies and simulations demonstrate the efficacy of the proposed approach compared with Rule-Based Controllers (RBCs) and well-established, state-of-the-art centralized RL (Reinforcement Learning) algorithms, offering performance improvements of up to 25% and 20% in reducing the energy cost and increasing user satisfaction, respectively.

THe energy-efficient operation of microgrids—a localized grouping of consuming loads (domestic appliances, EVs, etc.) with distributed energy sources such as solar photovoltaic panels—suggests the deployment of Energy Management Systems (EMSs) that enable the actuation of controllable microgrid loads coupled with Artificial Intelligence (AI) tools. Such tools are capable of optimizing the aggregated performance of the microgrid in an automated manner, based on an extensive network of Advanced Metering Infrastructure (AMI). Modular adaptable/dynamic building envelope (ADBE) solutions have been proven an effective solution—exploiting free façade areas instead of roof areas—for extending the thermal inertia and energy harvesting capacity in existing buildings of different nature (residential, commercial, industrial, etc.). This study presents the PLUG-N-HARVEST holistic workflow towards the delivery of an automatically controllable microgrid integrating active ADBE technologies (e.g., PVs, HVACs). The digital platform comprises cloud AI services and functionalities for energy-efficient management, data healing/cleansing, flexibility forecasting, and the security-by-design IoT to efficiently optimize the overall performance in near-zero energy buildings and microgrids. The current study presents the effective design and necessary digital integration steps towards the PLUG-N-HARVEST ICT platform alongside real-life verification test results, validating the performance of the platform.

This paper proposes a Cognitive Stochastic Approximation (CSA)-based optimization method for charging an EV (electric vehicle) fleet, using a single, aggregate battery model. The charging station can either utilize the batteries of the parked vehicles to charge the vehicles before they leave, or can use power from the grid. The objective is to optimize the charging task with minimum energy costs, possibly taking into account price variations in the electricity price. The main advantage of the proposed approach is that it provides a nearly to optimal solution in the presence of uncertain charging/discharging dynamics. The method is evaluated through a numerical model of a grid-connected charging station. Four scenarios with different electricity price models are studied. The CSA optimization results are compared with the results obtained by a rule-based charging algorithm and by an open-loop optimal control algorithm: the results illustrate the advantages of the proposed CSA algorithm in minimizing the charging cost, satisfying the aggregate battery charge sustaining conditions and providing robust solutions in the presence of time-varying vehicle schedules.