Sinan Ibrahim

Sinan Ibrahim

Auto-generated profile, based on publicly available information

Sinan Ibrahim

Skolkovo Institute of Science and Technology, Moscow, Russia

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
22 November 2024 in IEEE Access
Verified
Journal Article
Open access
SISinan Ibrahim
Sinan Ibrahim
MMMostafa Mostafa
Mostafa Mostafa
AJAli Jnadi
Ali Jnadi
HSHadi Salloum
Hadi Salloum
POPavel Osinenko
Pavel Osinenko
Reinforcement Learning (RL) seeks to develop systems capable of autonomous decision-making by learning through interaction with their environment. Central to this process are reward engineering and reward shaping, which are essential for enhancing the efficiency and effectiveness of RL algorithms. These techniques guide agents toward desired behaviors, improve learning stability, and accelerate convergence by addressing challenges such as sparse and delayed rewards. However, the complexity of real-world environments and the computational demands of RL algorithms remain significant obstacles to broader adoption. Recent advancements in deep learning have enabled RL to handle high-dimensional state and action spaces, facilitating applications in robotics, autonomous driving, and complex decision-making tasks. In response to these developments, this paper provides one of the first comprehensive reviews of reward design in RL, with a focus on the methodologies and techniques underpinning reward engineering and shaping. By introducing a detailed taxonomy, critically analyzing current approaches, and highlighting their limitations, this work fills an important gap in the literature, offering insights into how reward structures can be optimized to meet the growing demands of modern AI systems.

26 May 2025 in IEEE Control Systems Letters
Verified
Journal Article
Closed access
GYGrigory Yamerenko
Grigory Yamerenko
SISinan Ibrahim
Sinan Ibrahim
FMFrancisco Moreno-Mora
Francisco Moreno-Mora
POPavel Osinenko
Pavel Osinenko
SSStefan Streif
Stefan Streif
Reinforcement learning (RL) benchmarking has long relied on learning curves and cumulative reward tables, yet these metrics fail to capture critical design challenges, such as environment sensitivity, robustness, and reproducibility. This paper introduces a novel benchmarking paradigm that rigorously evaluates these understudied properties through a generative framework grounded in converse optimality. By constructing families of control problems with provably optimal solutions, our method enables statistical hypothesis testing of an algorithms response to environment perturbations both during training and post-deployment. Central to this approach is a problem generator that synthesizes parametric variations of dynamics and costs, paired with a sensitivity evaluation pipeline. To illustrate the frameworks usefulness, we apply it to compare environment sensitivity between Adam and RAdam optimizers – a case study designed to clarify how exactly the methodology provides the means to evaluate reinforcement learning algorithms in an informative way. This work contributes to RL evaluation by shifting focus from sample efficiency alone to methodologies that assess algorithms under conditions reflective of practical engineering challenges.

1 January 2026 in IEEE Control Systems Letters
Verified
Journal Article
Open access
SISinan Ibrahim
Sinan Ibrahim
GOGrégoire Ouerdane
Grégoire Ouerdane
HSHadi Salloum
Hadi Salloum
HOHenni Ouerdane
Henni Ouerdane
SSStefan Streif
Stefan Streif
POPavel Osinenko
Pavel Osinenko