In this paper, we address the problem of efficient estimation of Sobol sensitivity indices. First, we focus on general functional integrals of conditional moments of the form 𝔼(ψ(𝔼(ϕ(Y)|X))) where (X, Y) is a random vector with joint density f and ψ and ϕ are functions that are differentiable enough. In particular, we show that asymptotical efficient estimation of this functional boils down to the estimation of crossed quadratic functionals. An efficient estimate of first-order sensitivity indices is then derived as a special case. We investigate its properties on several analytical functions and illustrate its interest on a reservoir engineering case.
23 July 2009 in Journal of Theoretical Probability
Understanding the behavior of a black-box model with probabilistic inputs can be based on the decomposition of a parameter of interest (e.g., its variance) into contributions attributed to each coalition of inputs (i.e., subsets of inputs). In this paper, we produce conditions for obtaining unambiguous and interpretable decompositions of very general parameters of interest. This allows recovering known decompositions, holding under weaker assumptions than the literature states.
Given recent scientific advances, coastal flooding events can be properly modelled. Nevertheless, such models are computationally expensive (requiring many hours), which prevents their use for forecasting and warning. In addition, there is a gap between the model outputs and information actually needed by decision makers. The present work aims to develop and test a method capable of forecasting coastal flood information adapted to users’ needs. The method must be robust and fast and must integrate the complexity of coastal flood processes. The explored solution relies on metamodels, i.e., mathematical functions that precisely and efficiently (within minutes) estimate the results that would provide the numerical model. While the principle of relying on metamodel solutions is not new, the originality of the present work is to tackle and validate the entire process from the identification of user needs to the establishment and validation of the rapid forecast and early warning system (FEWS) while relying on numerical modelling, metamodelling, the development of indicators, and information technologies. The development and validation are performed at the study site of Gâvres (France). This site is subject to wave overtopping, so the numerical phase-resolving SWASH model is used to build the learning dataset required for the metamodel setup. Gaussian process- and random forest classifier-based metamodels are used and post-processed to estimate 14 indicators of interest for FEWS users. These metamodelling and post-processing schemes are implemented in an FEWS prototype, which is employed by local users and exhibits good warning skills during the validation period. Based on this experience, we provide recommendations for the improvement and/or application of this methodology and individual steps to other sites.
1 January 2024 in Electronic Journal of Statistics
Robustness studies of black-box models is recognized as a necessary task for numerical models based on structural equations and predictive models learned from data. These studies must assess the model’s robustness to possible misspecification of regarding its inputs (e.g., covariate shift). The study of black-box models, through the prism of uncertainty quantification (UQ), is often based on sensitivity analysis involving a probabilistic structure imposed on the inputs, while ML models are solely constructed from observed data. Our work aim at unifying the UQ and ML interpretability approaches, by providing relevant and easy-to-use tools for both paradigms. To provide a generic and understandable framework for robustness studies, we define perturbations of input information relying on quantile constraints and projections with respect to the Wasserstein distance between probability measures, while preserving their dependence structure. We show that this perturbation problem can be analytically solved. Ensuring regularity constraints by means of isotonic polynomial approximations leads to smoother perturbations, which can be more suitable in practice. Numerical experiments on real case studies, from the UQ and ML fields, highlight the computational feasibility of such studies and provide local and global insights on the robustness of black-box models to input perturbations.