For the energy transition in the residential sector, heat pumps are a core technology for decarbonizing thermal energy production for space heating and domestic hot water. Electricity generation from on-site photovoltaic (PV) systems can also contribute to a carbon-neutral building stock. However, both will increase the stress on the electricity grid. This can be reduced by using appropriate control strategies to match electricity consumption and production. In recent years, artificial intelligence-based approaches such as reinforcement learning (RL) have become increasingly popular for energy-system management. However, the literature shows a lack of investigation of RL-based controllers for multi-family building energy systems, including an air source heat pump, thermal storage, and a PV system, although this is a common system configuration. Therefore, in this study, a model of such an energy system and RL-based controllers were developed and simulated with physical models and compared with conventional rule-based approaches. Four RL algorithms were investigated for two objectives, and finally, the soft actor–critic algorithm was selected for the annual simulations. The first objective, to maintain only the required temperatures in the thermal storage, could be achieved by the developed RL agent. However, the second objective, to additionally improve the PV self-consumption, was better achieved by the rule-based controller. Therefore, further research on the reward function, hyperparameters, and advanced methods, including long short-term memory layers, as well as a training for longer time periods than six days are suggested.
The application of voltage reduction in medium and low voltage grids to reduce peak power demand or energy consumption has been implemented since the 1980s using several approaches. Conservation Voltage Reduction (CVR), as one such approach, uses a voltage control device to reduce or increase the voltage setpoint on a busbar, thereby reducing or increasing the amount of active and reactive power supply in the network. Voltage regulation for CVR is always implemented according to established network planning standards in each country. Research in this field has proven that a CVR factor () of 0.7–1.5 for peak demand reduction can be achieved. This is an evaluation metric of CVR. The aim of this research is to determine and validate for peak demand reduction by comparing actual results obtained during regular tap changes with other randomly distributed periods outside tap change operations, using a set of measurement data. It is important to understand CVR deployment capability by evaluating CVR potentials from historical random tap operations before a robust network-wide deployment is introduced. This research provides such guidance. It also provides a novel approach to determining tap changes from voltage measurements using a time-based algorithm. A ranging from 0.95 to 1.61 was estimated using a measurement dataset from a test field. The result of the entire evaluation shows that the are smaller during peak PV production and greater during peak demand periods. Further evaluation using statistical hypotheses testing and a control chart was used to validate the evaluation.
18 December 2024 in International Journal of Refrigeration