Frederik Kratzert
Auto-generated profile, based on publicly available information

Frederik Kratzert

Google research

Research Focus & Metrics

Academic Career Length

10Years (2017-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
22 November 2018 in Hydrology and Earth System Sciences
Verified
Journal Article
Open access
PDF file
FKFrederik Kratzert
Frederik Kratzert
DKDaniel Klotz
Daniel Klotz
CBClaire Brenner
Claire Brenner
KSKarsten Schulz
Karsten Schulz
MHMathew Herrnegger
Mathew Herrnegger
Rainfall–runoff modelling is one of the key challenges in the field of hydrology. Various approaches exist, ranging from physically based over conceptual to fully data-driven models. In this paper, we propose a novel data-driven approach, using the Long Short-Term Memory (LSTM) network, a special type of recurrent neural network. The advantage of the LSTM is its ability to learn long-term dependencies between the provided input and output of the network, which are essential for modelling storage effects in e.g. catchments with snow influence. We use 241 catchments of the freely available CAMELS data set to test our approach and also compare the results to the well-known Sacramento Soil Moisture Accounting Model (SAC-SMA) coupled with the Snow-17 snow routine. We also show the potential of the LSTM as a regional hydrological model in which one model predicts the discharge for a variety of catchments. In our last experiment, we show the possibility to transfer process understanding, learned at regional scale, to individual catchments and thereby increasing model performance when compared to a LSTM trained only on the data of single catchments. Using this approach, we were able to achieve better model performance as the SAC-SMA + Snow-17, which underlines the potential of the LSTM for hydrological modelling applications.

17 December 2019 in Hydrology and Earth System Sciences
Verified
Journal Article
Open access
FKFrederik Kratzert
Frederik Kratzert
DKDaniel Klotz
Daniel Klotz
GSGuy Shalev
Guy Shalev
GKGünter Klambauer
Günter Klambauer
SHSepp Hochreiter
Sepp Hochreiter
GNGrey Nearing
Grey Nearing
Regional rainfall–runoff modeling is an old but still mostly outstanding problem in the hydrological sciences. The problem currently is that traditional hydrological models degrade significantly in performance when calibrated for multiple basins together instead of for a single basin alone. In this paper, we propose a novel, data-driven approach using Long Short-Term Memory networks (LSTMs) and demonstrate that under a “big data” paradigm, this is not necessarily the case. By training a single LSTM model on 531 basins from the CAMELS dataset using meteorological time series data and static catchment attributes, we were able to significantly improve performance compared to a set of several different hydrological benchmark models. Our proposed approach not only significantly outperforms hydrological models that were calibrated regionally, but also achieves better performance than hydrological models that were calibrated for each basin individually. Furthermore, we propose an adaption to the standard LSTM architecture, which we call an Entity-Aware-LSTM (EA-LSTM), that allows for learning catchment similarities as a feature layer in a deep learning model. We show that these learned catchment similarities correspond well to what we would expect from prior hydrological understanding.

23 December 2019 in Water Resources Research
Verified
Journal Article
Open access
PDF file
FKFrederik Kratzert
Frederik Kratzert
DKDaniel Klotz
Daniel Klotz
MHMathew Herrnegger
Mathew Herrnegger
ASAlden K. Sampson
Alden K. Sampson
SHSepp Hochreiter
Sepp Hochreiter
GNGrey Nearing
Grey Nearing
Long short‐term memory (LSTM) networks offer unprecedented accuracy for prediction in ungauged basins. We trained and tested several LSTMs on 531 basins from the CAMELS data set using k‐fold validation, so that predictions were made in basins that supplied no training data. The training and test data set included ∼30 years of daily rainfall‐runoff data from catchments in the United States ranging in size from 4 to 2,000 km2 with aridity index from 0.22 to 5.20, and including 12 of the 13 IGPB vegetated land cover classifications. This effectively “ungauged” model was benchmarked over a 15‐year validation period against the Sacramento Soil Moisture Accounting (SAC‐SMA) model and also against the NOAA National Water Model reanalysis. SAC‐SMA was calibrated separately for each basin using 15 years of daily data. The out‐of‐sample LSTM had higher median Nash‐Sutcliffe Efficiencies across the 531 basins (0.69) than either the calibrated SAC‐SMA (0.64) or the National Water Model (0.58). This indicates that there is (typically) sufficient information in available catchment attributes data about similarities and differences between catchment‐level rainfall‐runoff behaviors to provide out‐of‐sample simulations that are generally more accurate than current models under ideal (i.e., calibrated) conditions. We found evidence that adding physical constraints to the LSTM models might improve simulations, which we suggest motivates future research related to physics‐guided machine learning.

24 March 2021 in Water Resources Research
Verified
Journal Article
Open access
PDF file
GNGrey Nearing
Grey Nearing
FKFrederik Kratzert
Frederik Kratzert
ASAlden Keefe Sampson
Alden Keefe Sampson
CPCraig S. Pelissier
Craig S. Pelissier
DKDaniel Klotz
Daniel Klotz
HGHoshin Gupta
Hoshin Gupta
This paper is derived from a keynote talk given at the Google's 2020 Flood Forecasting Meets Machine Learning Workshop. Recent experiments applying deep learning to rainfall‐runoff simulation indicate that there is significantly more information in large‐scale hydrological data sets than hydrologists have been able to translate into theory or models. While there is a growing interest in machine learning in the hydrological sciences community, in many ways, our community still holds deeply subjective and nonevidence‐based preferences for models based on a certain type of “process understanding” that has historically not translated into accurate theory, models, or predictions. This commentary is a call to action for the hydrology community to focus on developing a quantitative understanding of where and when hydrological process understanding is valuable in a modeling discipline increasingly dominated by machine learning. We offer some potential perspectives and preliminary examples about how this might be accomplished.

20 March 2024 in Nature
Verified
Journal Article
Open access
PDF file
GNGrey Nearing
Grey Nearing
DCDeborah Cohen
Deborah Cohen
VDVusumuzi Dube
Vusumuzi Dube
MGMartin Gauch
Martin Gauch
OGOren Gilon
Oren Gilon
YMYossi Matias
Yossi Matias
Floods are one of the most common natural disasters, with a disproportionate impact in developing countries that often lack dense streamflow gauge networks1. Accurate and timely warnings are critical for mitigating flood risks2, but hydrological simulation models typically must be calibrated to long data records in each watershed. Here we show that artificial intelligence-based forecasting achieves reliability in predicting extreme riverine events in ungauged watersheds at up to a five-day lead time that is similar to or better than the reliability of nowcasts (zero-day lead time) from a current state-of-the-art global modelling system (the Copernicus Emergency Management Service Global Flood Awareness System). In addition, we achieve accuracies over five-year return period events that are similar to or better than current accuracies over one-year return period events. This means that artificial intelligence can provide flood warnings earlier and over larger and more impactful events in ungauged basins. The model developed here was incorporated into an operational early warning system that produces publicly available (free and open) forecasts in real time in over 80 countries. This work highlights a need for increasing the availability of hydrological data to continue to improve global access to reliable flood warnings.

5 July 2022 in Hydrology and Earth System Sciences
Verified
Journal Article
Open access
PDF file
JFJonathan M. Frame
Jonathan M. Frame
FKFrederik Kratzert
Frederik Kratzert
DKDaniel Klotz
Daniel Klotz
MGMartin Gauch
Martin Gauch
GSGuy Shalev
Guy Shalev
GNGrey S. Nearing
Grey S. Nearing
The most accurate rainfall–runoff predictions are currently based on deep learning. There is a concern among hydrologists that the predictive accuracy of data-driven models based on deep learning may not be reliable in extrapolation or for predicting extreme events. This study tests that hypothesis using long short-term memory (LSTM) networks and an LSTM variant that is architecturally constrained to conserve mass. The LSTM network (and the mass-conserving LSTM variant) remained relatively accurate in predicting extreme (high-return-period) events compared with both a conceptual model (the Sacramento Model) and a process-based model (the US National Water Model), even when extreme events were not included in the training period. Adding mass balance constraints to the data-driven model (LSTM) reduced model skill during extreme events.