Statistical postprocessing of medium-range weather forecasts is an important component of modern forecasting systems. Since the beginning of modern data science, numerous new postprocessing methods have been proposed, complementing an already very diverse field. However, one of the questions that frequently arises when considering different methods in the framework of implementing operational postprocessing is the relative performance of the methods for a given specific task. It is particularly challenging to find or construct a common comprehensive dataset that can be used to perform such comparisons. Here, we introduce the first version of EUPPBench (EUMETNET postprocessing benchmark), a dataset of time-aligned forecasts and observations, with the aim to facilitate and standardize this process. This dataset is publicly available at https://github.com/EUPP-benchmark/climetlab-eumetnet-postprocessing-benchmark (31 December 2022) and on Zenodo (https://doi.org/10.5281/zenodo.7429236, Demaeyer, 2022b and https://doi.org/10.5281/zenodo.7708362, Bhend et al., 2023). We provide examples showing how to download and use the data, we propose a set of evaluation methods, and we perform a first benchmark of several methods for the correction of 2 m temperature forecasts.
Many practical applications of statistical post-processing methods for ensemble weather forecasts require accurate modeling of spatial, temporal, and inter-variable dependencies. Over the past years, a variety of approaches has been proposed to address this need. We provide a comprehensive review and comparison of state-of-the-art methods for multivariate ensemble post-processing. We focus on generally applicable two-step approaches where ensemble predictions are first post-processed separately in each margin and multivariate dependencies are restored via copula functions in a second step. The comparisons are based on simulation studies tailored to mimic challenges occurring in practical applications and allow ready interpretation of the effects of different types of misspecifications in the mean, variance, and covariance structure of the ensemble forecasts on the performance of the post-processing methods. Overall, we find that the Schaake shuffle provides a compelling benchmark that is difficult to outperform, whereas the forecast quality of parametric copula approaches and variants of ensemble copula coupling strongly depend on the misspecifications at hand.
In this note, we introduce a generalized formula for Cohen’s d under the presence of additional independent variables, providing a measure for the size of a possible effect concerning the size of a difference location effect of a variable in two groups. This is done by employing the so-called Frisch–Waugh–Lovell theorem in a partitioned linear regression model. The generalization is motivated by demonstrating the relationship to appropriate t and F statistics. Our discussion is further illustrated by inference about a publicly available data set.
1 July 2023 in Quarterly Journal of the Royal Meteorological Society
Current practice in predicting future weather is the use of numerical weather prediction (NWP) models to produce ensemble forecasts. Despite of enormous improvements over the last few decades, they still tend to exhibit bias and dispersion errors and, consequently, lack calibration. Therefore, these forecasts may be improved by statistical postprocessing. In this work, we propose a D‐vine‐copula‐based postprocessing for 10 m surface wind speed ensemble forecasts. This approach makes use of quantile regression related to D‐vine copulas, which is highly data driven and allows one to adopt more general dependence structures as the state‐of‐the‐art zero‐truncated ensemble model output statistic (tEMOS) model. We compare local and global D‐vine copula quantile regression (DVQR) models to the corresponding tEMOS models and their gradient‐boosting extensions (tEMOS‐GB) for different sets of predictor variables using one lead time and 60 surface weather stations in Germany. Furthermore, we investigate which types of training periods can improve the performance of tEMOS and the D‐vine‐copula‐based method for wind speed postprocessing. We observe that the D‐vine‐based postprocessing yields a comparable performance with respect to tEMOS if only wind speed ensemble variables are included and to substantial refinements if additional meteorological and station‐specific weather variables are integrated. As our main result, we note that, in the global setting, DVQR is able to provide better scores than tEMOS‐GB in general, whereas the local DVQR is able to substantially outperform the local tEMOS‐GB at particular stations admitting nonlinear relationships among the variables. In addition, we remark that training periods capturing seasonal patterns perform the best. Last but not least, we adapt a criterion for calculating the variable importance in D‐vine copulas and we outline which predictor variables are due to this approach the most important for the correction of wind speed ensemble forecasts.
30 September 2019 in Quarterly Journal of the Royal Meteorological Society
Weather prediction today is performed with numerical weather prediction (NWP) models. These are deterministic simulation models describing the dynamics of the atmosphere, and evolving the current conditions forward in time to obtain a prediction for future atmospheric states. To account for uncertainty in NWP models it has become common practice to employ ensembles of NWP forecasts. However, NWP ensembles often exhibit forecast biases and dispersion errors, thus require statistical postprocessing to improve reliability of the ensemble forecasts. This work proposes an extension of a recently developed postprocessing model utilizing autoregressive information present in the forecast error of the raw ensemble members. The original approach is modified to let the variance parameter depend on the ensemble spread, yielding a two‐fold heteroscedastic model. Furthermore, an additional high‐resolution forecast is included into the postprocessing model, yielding improved predictive performance. Finally, it is outlined how the autoregressive model can be utilized to postprocess ensemble forecasts with higher forecast horizons, without the necessity of making fundamental changes to the original model. We accompany the new methodology by an implementation within the R package ensAR to make our method available for other researchers working in this area. To illustrate the performance of the heteroscedastic extension of the autoregressive model, and its use for higher forecast horizons we present a case‐study for a dataset containing 12 years of temperature forecasts and observations over Germany. The case‐study indicates that the autoregressive model yields particularly strong improvements for forecast horizons beyond 24 h.