1 March 2019 in European Journal of Operational Research
1 January 2023 in Operations Research
Grid energy storage plays a key role in making carbon-free, renewable energy production a reality. Yet, when it comes to maximizing profit, owners of storage assets still struggle with coordinating their trading activities across time because of the complex nature of multisettlement electricity markets. In “Coordination of Multimarket Bidding of Grid-Energy Storage,” Nils Löhndorf and David Wozabal propose a multistage stochastic programming model for market-oriented optimization of energy storage. To calculate lower and upper bounds on optimal values, they develop novel methods for scenario-tree generation and information relaxation. They show that a coordinated policy that reserves capacity for the short-term markets is optimal and that the gap to a sequential policy increases with short-term price volatility and market liquidity. The authors find that coordination is beneficial for all considered asset types and that flexible storages with high price impact benefit most. Their findings inform storage owners which markets contribute most value, how to organize trading across time, and how to calculate optimal bidding strategies.
20 February 2023 in IEEE Transactions on Power Systems
We consider the stochastic dual dynamic programming (SDDP) algorithm - a widely employed algorithm applied to multistage stochastic programming - and propose a variant using experience replay - a batch learning technique from reinforcement learning. To connect SDDP with reinforcement learning, we cast SDDP as a Q-learning algorithm and describe its application in both risk-neutral and risk-averse settings. We demonstrate the superiority of the algorithm over conventional SDDP by benchmarking it against PSR's SDDP software using a large-scale instance of the long-term planning problem of inter-connected hydropower plants in Colombia. We find that SDDP with batch learning is able to produce tighter optimality gaps in a shorter amount of time than conventional SDDP. We also find that batch learning improves the parallel efficiency of SDDP backward passes.
17 August 2023 in Naval Research Logistics (NRL)
24 February 2023 in OR Spectrum
31 July 2026 in Applied Energy