4 April 2025 in ACM Transactions on Embedded Computing Systems
Cyber-physical systems (CPSs) are often complex and safety-critical, making it both challenging and crucial to ensure that the system’s specifications are met. Simulation-based falsification is a practical testing technique for increasing confidence in a CPS’s correctness, as it only requires that the system be simulated. Reducing the number of computationally intensive simulations needed for falsification is a key concern. In this study, we investigate Bayesian optimization (BO), a sample-efficient approach that learns a surrogate model to capture the relationship between input signal parameterization and specification evaluation. We propose two enhancements to the basic BO for improving falsification: (1) leveraging local surrogate models, and (2) utilizing the user’s prior knowledge. Additionally, we address the formulation of acquisition functions for falsification by proposing and evaluating various alternatives. Our benchmark evaluation demonstrates significant improvements when using local surrogate models in BO for falsifying challenging benchmark examples. Incorporating prior knowledge is found to be especially beneficial when the simulation budget is constrained. For some benchmark problems, the choice of acquisition function noticeably impacts the number of simulations required for successful falsification.
13 January 2021 in Journal of Engineering Mathematics
15 February 2021 in Journal of Engineering Mathematics
30 December 2019 in arXiv
We model shallow-water waves using a one-dimensional Korteweg-de Vries equation with the wave generation parameterized by random wave amplitudes for a predefined sea state. These wave amplitudes define the high-dimensional stochastic input vector for which we estimate the short-term wave crest exceedance probability at a reference point. For this high-dimensional and complex problem, most reliability methods fail, while Monte Carlo methods become impractical due to the slow convergence rate. Therefore, first within offshore applications, we employ the dimensionality reduction method called \textit{Active-Subspace Analysis}. This method identifies a low-dimensional subspace of the input space that is most significant to the input-output variability. We exploit this to efficiently train a Gaussian process that models the maximum 10-minute crest elevation at the reference point, and to thereby efficiently estimate the short-term wave crest exceedance probability. The active low-dimensional subspace for the Korteweg-de Vries model also exposes the expected incident wave groups associated with extreme waves and loads. Our results show the advantages and the effectiveness of the active-subspace analysis against the Monte Carlo implementation for offshore applications.