Cyprien Hoelzl

Mr. Cyprien Hoelzl


Research Focus & Metrics

Academic Career Length

15Years (2012-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
31 May 2024 in Machine Learning
Verified
Journal Article
Open access
PDF file
GAGiacomo Arcieri
Giacomo Arcieri
CHCyprien Hoelzl
Cyprien Hoelzl
OSOliver Schwery
Oliver Schwery
DSDaniel Straub
Daniel Straub
KPKonstantinos G. Papakonstantinou
Konstantinos G. Papakonstantinou
Eleni ChatziEleni Chatzi
Eleni Chatzi
Partially Observable Markov Decision Processes (POMDPs) can model complex sequential decision-making problems under stochastic and uncertain environments. A main reason hindering their broad adoption in real-world applications is the unavailability of a suitable POMDP model or a simulator thereof. Available solution algorithms, such as Reinforcement Learning (RL), typically benefit from the knowledge of the transition dynamics and the observation generating process, which are often unknown and non-trivial to infer. In this work, we propose a combined framework for inference and robust solution of POMDPs via deep RL. First, all transition and observation model parameters are jointly inferred via Markov Chain Monte Carlo sampling of a hidden Markov model, which is conditioned on actions, in order to recover full posterior distributions from the available data. The POMDP with uncertain parameters is then solved via deep RL techniques with the parameter distributions incorporated into the solution via domain randomization, in order to develop solutions that are robust to model uncertainty. As a further contribution, we compare the use of Transformers and long short-term memory networks, which constitute model-free RL solutions and work directly on the observation space, with an approach termed the belief-input method, which works on the belief space by exploiting the learned POMDP model for belief inference. We apply these methods to the real-world problem of optimal maintenance planning for railway assets and compare the results with the current real-life policy. We show that the RL policy learned by the belief-input method is able to outperform the real-life policy by yielding significantly reduced life-cycle costs.

3 October 2023 in Mechanical Systems and Signal Processing
Verified
Journal Article
Open access
CHCyprien Hoelzl
Cyprien Hoelzl
Vasilis DertimanisVasilis Dertimanis
Vasilis Dertimanis
LALucian Ancu
Lucian Ancu
AKAurelia Kollros
Aurelia Kollros
ECEleni Chatzi
Eleni Chatzi

29 December 2023 in Structural Control and Health Monitoring
Verified
Journal Article
Open access
PDF file
CSCharikleia D. Stoura
Charikleia D. Stoura
Vasilis DertimanisVasilis Dertimanis
Vasilis Dertimanis
CHCyprien Hoelzl
Cyprien Hoelzl
CKClaudia Kossmann
Claudia Kossmann
Alfredo CigadaAlfredo Cigada
Alfredo Cigada
Eleni ChatziEleni Chatzi
Eleni Chatzi
According to the International Union of Railways, railway networks count more than one million kilometers of tracks worldwide, a number that is to rise further as the goal is to promote rail transportation as a sustainable means to face the challenge of increased mobility. However, such a vast expansion further necessitates efficient and reliable infrastructure monitoring schemes able to guarantee the quality and safety of rail transportation. Traditional monitoring approaches, relying on visual inspection and portable measuring devices, cannot rise to the task as they do not allow for continuous inspection of extended portions of rail infrastructure. Therefore, mobile monitoring methodologies based on dedicated diagnostic vehicles have emerged as an alternative. Despite revolutionizing traditional monitoring methods, such vehicles are usually expensive and can only operate under the suspension of regular rail service. In this work, we propose an alternative approach for mobile sensing of railway infrastructure based on on-board monitoring data collected from low-cost vibration sensors, e.g., accelerometers, which can be mounted on in-service trains. Specifically, we focus on identifying the roughness profile of the tracks and propose a fusion of reduced-order vehicle models with a Bayesian inference approach for joint input-state estimation. To enhance the inference, we opt for a prior updating of the vehicle model parameters on the basis of an unscented Kalman filter and available measurements from a diagnostic vehicle. The key contributions of this work are (i) the consideration of the dynamic interaction between trains and tracks, which is usually ignored in rail roughness estimation, (ii) the adoption of reduced train vehicle models that decrease the computational effort of the identification task, (iii) the updating of the vehicle parameters to account for inconsistencies in the model used, and (iv) the application of the proposed methodology to actual acceleration measurements collected from a diagnostic vehicle of the Swiss Federal Railways network.

28 February 2023 in Sensors
Verified
Journal Article
Open access
PDF file
CHCyprien Hoelzl
Cyprien Hoelzl
GAGiacomo Arcieri
Giacomo Arcieri
LALucian Ancu
Lucian Ancu
SBStanislaw Banaszak
Stanislaw Banaszak
AKAurelia Kollros
Aurelia Kollros
Eleni ChatziEleni Chatzi
Eleni Chatzi
Monitoring information can facilitate the condition assessment of railway infrastructure, via delivery of data that is informative on condition. A primary instance of such data is found in Axle Box Accelerations (ABAs), which track the dynamic vehicle/track interaction. Such sensors have been installed on specialized monitoring trains, as well as on in-service On-Board Monitoring (OBM) vehicles across Europe, enabling a continuous assessment of railway track condition. However, ABA measurements come with uncertainties that stem from noise corrupt data and the non-linear rail–wheel contact dynamics, as well as variations in environmental and operational conditions. These uncertainties pose a challenge for the condition assessment of rail welds through existing assessment tools. In this work, we use expert feedback as a complementary information source, which allows the narrowing down of these uncertainties, and, ultimately, refines assessment. Over the past year, with the support of the Swiss Federal Railways (SBB), we have assembled a database of expert evaluations on the condition of rail weld samples that have been diagnosed as critical via ABA monitoring. In this work, we fuse features derived from the ABA data with expert feedback, in order to refine defection of faulty (defect) welds. Three models are employed to this end; Binary Classification and Random Forest (RF) models, as well as a Bayesian Logistic Regression (BLR) scheme. The RF and BLR models proved superior to the Binary Classification model, while the BLR model further delivered a probability of prediction, quantifying the confidence we might attribute to the assigned labels. We explain that the classification task necessarily suffers high uncertainty, which is a result of faulty ground truth labels, and explain the value of continuously tracking the weld condition.

19 June 2022
Verified
Book Chapter
Closed access
PDF file
CHCyprien Hoelzl
Cyprien Hoelzl
VDVasilis Dertimanis
Vasilis Dertimanis
AKAurelia Kollros
Aurelia Kollros
LALucian Ancu
Lucian Ancu
ECEleni Chatzi
Eleni Chatzi