Sarah Keren

Dr. Sarah Keren

Faculty of Computer Science, Technion – Israel Institute of Technology, Haifa, Israel
orcid

Research Focus & Metrics

Academic Career Length

28Years (1999-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
25 October 2024 in Energies
Verified
Journal Article
Open access
PDF file
EGElinor Ginzburg-Ganz
Elinor Ginzburg-Ganz
ISItay Segev
Itay Segev
ABAlexander Balabanov
Alexander Balabanov
ESElior Segev
Elior Segev
SNSivan Kaully Naveh
Sivan Kaully Naveh
YLYoash Levron
Yoash Levron
This paper reviews recent works related to applications of reinforcement learning in power system optimal control problems. Based on an extensive analysis of works in the recent literature, we attempt to better understand the gap between reinforcement learning methods that rely on complete or incomplete information about the model dynamics and data-driven reinforcement learning approaches. More specifically we ask how such models change based on the application or the algorithm, what the currently open theoretical and numerical challenges are in each of the leading applications, and which reinforcement-based control strategies will rise in the following years. The reviewed research works are divided into “model-based” methods and “model-free” methods in order to highlight the current developments and trends within each of these two groups. The optimal control problems reviewed are energy markets, grid stability and control, energy management in buildings, electrical vehicles, and energy storage.

1 January 2021
Verified
Book
Closed access
RMReuth Mirsky
Reuth Mirsky
Sarah KerenSarah Keren
Sarah Keren
CGChristopher Geib
Christopher Geib

1 April 1999 in Optics Letters
Verified
Journal Article
Closed access
PDF file
EHErez Hasman
Erez Hasman
Sarah KerenSarah Keren
Sarah Keren
NDN. Davidson
N. Davidson
AFA. A. Friesem
A. A. Friesem
Optics InfoBase is the Optical Society's online library for flagship journals, partnered and copublished journals, and recent proceedings from OSA conferences.

4 October 2024 in Preprints.org
Verified
Preprint
Open access
PDF file
EGElinor Ginzburg-Ganz
Elinor Ginzburg-Ganz
ISItay Segev
Itay Segev
ABAlexander Balabanov
Alexander Balabanov
ESElior Segev
Elior Segev
SKSivan Kaully-Naveh
Sivan Kaully-Naveh
YLYoash Levron
Yoash Levron
This paper reviews recent works related to applications of reinforcement learning in power system optimal control problems. Based on an extensive analysis of works in the recent literature, we attempt to better understand what is the gap between reinforcement learning methods that rely on complete or incomplete information about the model dynamics, and data-driven reinforcement learning approaches. More specifically we ask how such models change based on the application or the algorithm, what are the currently open theoretical and numerical challenges in each of the leading applications, and which reinforcement-based control strategies will rise in the following years. The reviewed research works are divided to ``model-based'' methods and ``model-free'' methods, in order to highlight the current developments and trends within each of these two groups. The optimal control problems reviewed are energy markets, grid stability and control, energy management in buildings, electrical vehicles and energy storage.

3 April 2020 in Proceedings of the AAAI Conference on Artificial Intelligence
Verified
Journal Article
Open access
PDF file
Sarah KerenSarah Keren
Sarah Keren
HXHaifeng Xu
Haifeng Xu
KKKofi Kwapong
Kofi Kwapong
DPDavid Parkes
David Parkes
BGBarbara Grosz
Barbara Grosz
We extend goal recognition design to account for partially informed agents. In particular, we consider a two-agent setting in which one agent, the actor, seeks to achieve a goal but has only incomplete information about the environment. The second agent, the recognizer, has perfect information and aims to recognize the actor's goal from its behavior as quickly as possible. As a one-time offline intervention and with the objective of facilitating the recognition task, the recognizer can selectively reveal information to the actor. The problem of selecting which information to reveal, which we call information shaping, is challenging not only because the space of information shaping options may be large, but also because more information revelation need not make it easier to recognize an agent's goal. We formally define this problem, and suggest a pruning approach for efficiently searching the search space. We demonstrate the effectiveness and efficiency of the suggested method on standard benchmarks.

17 October 2025 in Energy Storage and Applications
Verified
Journal Article
Open access
PDF file
EGElinor Ginzburg-Ganz
Elinor Ginzburg-Ganz
ISItay Segev
Itay Segev
YLYoash Levron
Yoash Levron
Juri BelikovJuri Belikov
Juri Belikov
Dmitry BaimelDmitry Baimel
Dmitry Baimel
Sarah KerenSarah Keren
Sarah Keren
The challenge of optimally controlling energy storage systems under uncertainty conditions, whether due to uncertain storage device dynamics or load signal variability, is well established. Recent research works tackle this problem using two primary approaches: optimal control methods, such as stochastic dynamic programming, and data-driven techniques. This work’s objective is to quantify the inherent trade-offs between these methodologies and identify their respective strengths and weaknesses across different scenarios. We evaluate the degradation of performance, measured by increased operational costs, when a reinforcement learning policy is adopted instead of an optimal control policy, such as dynamic programming, Pontryagin’s minimum principle, or the Shortest-Path method. Our study examines three increasingly intricate use cases: ideal storage units, storage units with losses, and lossy storage units integrated with transmission line losses. For each scenario, we compare the performance of a representative optimal control technique against a reinforcement learning approach, seeking to establish broader comparative insights.