Filippo Airaldi

Filippo Airaldi

Auto-generated profile, based on publicly available information

Filippo Airaldi

Delft Center for Systems and Control Delft University of Technology Mekelweg 2 2628 CD Delft The Netherlands

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
31 December 2024 in Smart Agricultural Technology
Verified
Journal Article
Open access
SMSamuel Mallick
Samuel Mallick
FAFilippo Airaldi
Filippo Airaldi
ADAzita Dabiri
Azita Dabiri
Congcong SunCongcong Sun
Congcong Sun
BSBart De Schutter
Bart De Schutter

17 March 2025 in IEEE Transactions on Intelligent Transportation Systems
Verified
Journal Article
Open access
FAFilippo Airaldi
Filippo Airaldi
BSBart De Schutter
Bart De Schutter
ADAzita Dabiri
Azita Dabiri
In the backdrop of an increasingly pressing need for effective urban and highway transportation systems, this work explores the synergy between model-based and learning-based strategies to enhance traffic flow management by use of an innovative approach to the problem of ramp metering control that embeds Reinforcement Learning (RL) techniques within the Model Predictive Control (MPC) framework. The control problem is formulated as an RL task by crafting a suitable stage cost function that is representative of the traffic conditions, variability in the control action, and violations of the constraint on the maximum number of vehicles in queue. An MPC-based RL approach, which leverages the MPC optimal problem as a function approximation for the RL algorithm, is proposed to learn to efficiently control an on-ramp and satisfy its constraints despite uncertainties in the system model and variable demands. Simulations are performed on a benchmark small-scale highway network to compare the proposed methodology against other state-of-the-art control approaches. Results show that, starting from an MPC controller that has an imprecise model and is poorly tuned, the proposed methodology is able to effectively learn to improve the control policy such that congestion in the network is reduced and constraints are satisfied, yielding an improved performance that is superior to the other controllers.

17 March 2023 in arXiv
Verified
Preprint
Open access
PDF file
FAFilippo Airaldi
Filippo Airaldi
BSBart De Schutter
Bart De Schutter
ADAzita Dabiri
Azita Dabiri
We propose a method to encourage safety in Model Predictive Control (MPC)-based Reinforcement Learning (RL) via Gaussian Process (GP) regression. This framework consists of 1) a parametric MPC scheme that is employed as model-based controller with approximate knowledge on the real system's dynamics, 2) an episodic RL algorithm tasked with adjusting the MPC parametrization in order to increase its performance, and lastly, 3) GP regressors used to estimate, directly from data, constraints on the MPC parameters capable of predicting, up to some probability, whether the parametrization is likely to yield a safe or unsafe policy. These constraints are then enforced onto the RL updates in an effort to enhance the learning method with a probabilistic safety mechanism. Compared to other recent publications combining safe RL with MPC, our method does not require further assumptions on, e.g., the prediction model in order to retain computational tractability. We illustrate the results of our method in a numerical example on the control of a quadrotor drone in a safety-critical environment.

4 December 2025 in arXiv
Verified
Preprint
Open access
PDF file
KDKerim Dzhumageldyev
Kerim Dzhumageldyev
FAFilippo Airaldi
Filippo Airaldi
ADAzita Dabiri
Azita Dabiri
Optimal control strategies are often combined with safety certificates to ensure both performance and safety in safety-critical systems. A prominent example is combining Model Predictive Control (MPC) with Control Barrier Functions (CBF). Yet, efficient tuning of MPC parameters and choosing an appropriate class $\mathcal{K}$ function in the CBF is challenging and problem dependent. This paper introduces a safe model-based Reinforcement Learning (RL) framework where a parametric MPC controller incorporates a CBF constraint with a parameterized class $\mathcal{K}$ function and serves as a function approximator to learn improved safe control policies from data. Three variations of the framework are introduced, distinguished by the way the optimization problem is formulated and the class $\mathcal{K}$ function is parameterized, including neural architectures. Numerical experiments on a discrete double-integrator with static and dynamic obstacles demonstrate that the proposed methods improve performance while ensuring safety.