Fabian Ritz

Fabian Ritz

Auto-generated profile, based on publicly available information

Fabian Ritz

LMU Munich

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
6 March 2020 in International Journal on Software Tools for Technology Transfer
Verified
Journal Article
Open access
PDF file
TGThomas Gabor
Thomas Gabor
ASAndreas Sedlmeier
Andreas Sedlmeier
TPThomy Phan
Thomy Phan
FRFabian Ritz
Fabian Ritz
MKMarie Kiermeier
Marie Kiermeier
CLClaudia Linnhoff-Popien
Claudia Linnhoff-Popien
Systems are becoming increasingly more adaptive, using techniques like machine learning to enhance their behavior on their own rather than only through human developers programming them. We analyze the impact the advent of these new techniques has on the discipline of rigorous software engineering, especially on the issue of quality assurance. To this end, we provide a general description of the processes related to machine learning and embed them into a formal framework for the analysis of adaptivity, recognizing that to test an adaptive system a new approach to adaptive testing is necessary. We introduce scenario coevolution as a design pattern describing how system and test can work as antagonists in the process of software evolution. While the general pattern applies to large-scale processes (including human developers further augmenting the system), we show all techniques on a smaller-scale example of an agent navigating a simple smart factory. We point out new aspects in software engineering for adaptive systems that may be tackled naturally using scenario coevolution. This work is a substantially extended take on Gabor et al. (International symposium on leveraging applications of formal methods, Springer, pp 137–154, 2018).

17 October 2022
Verified
Book Chapter
Closed access
PDF file
FRFabian Ritz
Fabian Ritz
TPThomy Phan
Thomy Phan
ASAndreas Sedlmeier
Andreas Sedlmeier
PAPhilipp Altmann
Philipp Altmann
JWJan Wieghardt
Jan Wieghardt
TGThomas Gabor
Thomas Gabor

19 July 2022
Verified
Book Chapter
Closed access
PDF file
FRFabian Ritz
Fabian Ritz
TPThomy Phan
Thomy Phan
RMRobert Müller
Robert Müller
TGThomas Gabor
Thomas Gabor
ASAndreas Sedlmeier
Andreas Sedlmeier
CLClaudia Linnhoff-Popien
Claudia Linnhoff-Popien

5 January 2021 in arXiv
Verified
Preprint
Open access
PDF file
RMRobert Müller
Robert Müller
SISteffen Illium
Steffen Illium
FRFabian Ritz
Fabian Ritz
TSTobias Schröder
Tobias Schröder
CPChristian Platschek
Christian Platschek
CLClaudia Linnhoff-Popien
Claudia Linnhoff-Popien
In this work, we present a general procedure for acoustic leak detection in water networks that satisfies multiple real-world constraints such as energy efficiency and ease of deployment. Based on recordings from seven contact microphones attached to the water supply network of a municipal suburb, we trained several shallow and deep anomaly detection models. Inspired by how human experts detect leaks using electronic sounding-sticks, we use these models to repeatedly listen for leaks over a predefined decision horizon. This way we avoid constant monitoring of the system. While we found the detection of leaks in close proximity to be a trivial task for almost all models, neural network based approaches achieve better results at the detection of distant leaks.

1 January 2021
Verified
Conference Paper
Open access
PDF file
FRFabian Ritz
Fabian Ritz
DRDaniel Ratke
Daniel Ratke
TPThomy Phan
Thomy Phan
LBLenz Belzner
Lenz Belzner
CLClaudia Linnhoff-Popien
Claudia Linnhoff-Popien
This paper considers sustainable and cooperative behavior in multi-agent systems. In the proposed predator-prey simulation, multiple selfish predators can learn to act sustainably by maintaining a herd of reproducing prey and further hunt cooperatively for long term benefit. Since the predators face starvation pressure, the scenario can also turn in a tragedy of the commons if selfish individuals decide to greedily hunt down the prey population before their conspecifics do, ultimately leading to extinction of prey and predators. This paper uses Multi-Agent Reinforcement Learning to overcome a collapse of the simulated ecosystem, analyzes the impact factors over multiple dimensions and proposes suitable metrics. We show that up to three predators are able to learn sustainable behavior in form of collective herding under starvation pressure. Complex cooperation in form of group hunting emerges between the predators as their speed is handicapped and the prey is given more degrees of freedom to escape. The implementation of environment and reinforcement learning pipeline is available online.

11 December 2023 in Research Square
Verified
Preprint
Open access
PDF file
PAPhilipp Altmann
Philipp Altmann
FRFabian Ritz
Fabian Ritz
MZMaximilian Zorn
Maximilian Zorn
MKMichael Kölle
Michael Kölle
TPThomy Phan
Thomy Phan
CLClaudia Linnhoff-Popien
Claudia Linnhoff-Popien
We propose discriminative reward co-training (DIRECT) as an extension to deep reinforcement learning algorithms. Building upon the concept of self-imitation learning (SIL), we introduce an imitation buffer to store beneficial trajectories generated by the policy, determined by their return. A discriminator network is trained concurrently to the policy to distinguish between trajectories generated by the current policy and beneficial trajectories generated by previous policies. The discriminator’s verdict is used to construct a reward signal for optimizing the policy. By interpolating prior experience, DIRECT is able to act as a reward surrogate, steering policy optimization towards more valuable regions of the reward landscape, thus, towards learning an optimal policy. In this article we formally introduce the additional components, their intended purpose and parameterization, and define a unified training procedure. To reveal insights into the mechanics of the proposed architecture, we provide evaluations of the introduced hyperparameters. Further benchmark evaluations in various discrete and continuous control environments provide evidence that DIRECT is especially beneficial in environments possessing sparse rewards, hard exploration tasks, and shifting circumstances. Our results show that DIRECT outperforms state-of-the-art algorithms in those challenging scenarios by providing a surrogate reward to the policy and directing the optimization towards valuable areas.