The Earth System Model Evaluation Tool (ESMValTool) is a community diagnostics and performance metrics tool designed to improve comprehensive and routine evaluation of Earth system models (ESMs) participating in the Coupled Model Intercomparison Project (CMIP). It has undergone rapid development since the first release in 2016 and is now a well-tested tool that provides end-to-end provenance tracking to ensure reproducibility. It consists of (1) an easy-to-install, well-documented Python package providing the core functionalities (ESMValCore) that performs common preprocessing operations and (2) a diagnostic part that includes tailored diagnostics and performance metrics for specific scientific applications. Here we describe large-scale diagnostics of the second major release of the tool that supports the evaluation of ESMs participating in CMIP Phase 6 (CMIP6). ESMValTool v2.0 includes a large collection of diagnostics and performance metrics for atmospheric, oceanic, and terrestrial variables for the mean state, trends, and variability. ESMValTool v2.0 also successfully reproduces figures from the evaluation and projections chapters of the Intergovernmental Panel on Climate Change (IPCC) Fifth Assessment Report (AR5) and incorporates updates from targeted analysis packages, such as the NCAR Climate Variability Diagnostics Package for the evaluation of modes of variability, the Thermodynamic Diagnostic Tool (TheDiaTo) to evaluate the energetics of the climate system, as well as parts of AutoAssess that contains a mix of top–down performance metrics. The tool has been fully integrated into the Earth System Grid Federation (ESGF) infrastructure at the Deutsches Klimarechenzentrum (DKRZ) to provide evaluation results from CMIP6 model simulations shortly after the output is published to the CMIP archive. A result browser has been implemented that enables advanced monitoring of the evaluation results by a broad user community at much faster timescales than what was possible in CMIP5.
Global Climate Models are key tools for predicting the future response of the climate system to a variety of natural and anthropogenic forcings. Here we show how to use statistical mechanics to construct operators able to flexibly predict climate change. We perform our study using a fully coupled model - MPI-ESM v.1.2 - and for the first time we prove the effectiveness of response theory in predicting future climate response to CO2 increase on a vast range of temporal scales, from inter-annual to centennial, and for very diverse climatic variables. We investigate within a unified perspective the transient climate response and the equilibrium climate sensitivity, and assess the role of fast and slow processes. The prediction of the ocean heat uptake highlights the very slow relaxation to a newly established steady state. The change in the Atlantic Meridional Overturning Circulation (AMOC) and of the Antarctic Circumpolar Current (ACC) is accurately predicted. The AMOC strength is initially reduced and then undergoes a slow and partial recovery. The ACC strength initially increases due to changes in the wind stress, then undergoes a slowdown, followed by a recovery leading to a overshoot with respect to the initial value. Finally, we are able to predict accurately the temperature change in the North Atlantic.
We propose a methodology for intercomparing climate models and evaluating their performance against benchmarks based on the use of the Wasserstein distance (WD). This distance provides a rigorous way to measure quantitatively the difference between two probability distributions. The proposed approach is flexible and can be applied in any number of dimensions; it allows one to rank climate models taking into account all the moments of the distributions. By selecting the combination of climatic variables and the regions of interest, it is possible to highlight specific model deficiencies. The WD enables a comprehensive evaluation of the skill of a climate model. We apply this approach to a selected number of physical fields, ranking the models in terms of their performance in simulating them and pinpointing their weaknesses in the simulation of some of the selected physical fields in specific areas of the Earth.
Statistical physics and dynamical systems theory are key tools to study high-impact geophysical events such as temperature extremes, cyclones, thunderstorms, geomagnetic storms, and many others. Despite the intrinsic differences between these events, they all originate as temporary deviations from the typical trajectories of a geophysical system, resulting in well-organized, coherent structures at characteristic spatial and temporal scales. While statistical extreme value analysis techniques are capable of providing return times and probabilities of occurrence of certain geophysical events, they are not apt to account for their underlying physics. Their focus is to compute the probability of occurrence of events that are large or small with respect to some specific observable (e.g., temperature, precipitation, solar wind), rather than to relate rare or extreme phenomena to the underlying anomalous geophysical regimes. This paper outlines this knowledge gap, presenting some related challenges, new formalisms and briefly commenting on how stochastic approaches tailored to the study of extreme geophysical events can help to advance their understanding.
This work presents the Thermodynamic Diagnostic Tool (TheDiaTo), a novel diagnostic tool for investigating the thermodynamics of climate systems with a wide range of applications, from sensitivity studies to model tuning. It includes a number of modules for assessing the internal energy budget, the hydrological cycle, the Lorenz energy cycle and the material entropy production. The routine takes as inputs energy fluxes at the surface and at the top of the atmosphere (TOA), which allows for the computation of energy budgets at the TOA, the surface and in the atmosphere as a residual. Meridional enthalpy transports are also computed from the divergence of the zonal mean energy budget from which the location and intensity of the maxima in each hemisphere are calculated. Rainfall, snowfall and latent heat fluxes are received as inputs for computation of the water mass and latent energy budgets. If a land–sea mask is provided, the required quantities are separately computed over continents and oceans. The diagnostic tool also computes the annual Lorenz energy cycle (LEC) and its storage and conversion terms by hemisphere and as a global mean. This is computed from three-dimensional daily fields of horizontal wind velocity and temperature in the troposphere. Two methods have been implemented for the computation of the material entropy production: one relying on the convergence of radiative heat fluxes in the atmosphere (indirect method) and the other combining the irreversible processes occurring in the climate system, particularly heat fluxes in the boundary layer, the hydrological cycle and the kinetic energy dissipation as retrieved from the residuals of the LEC (direct method). A version of these diagnostics has been developed as part of the Earth System Model eValuation Tool (ESMValTool) v2.0a1 in order to assess the performances of CMIP6 model simulations, and it will be available in the next release. The aim of this software is to provide a comprehensive picture of the thermodynamics of the climate system, as reproduced in the state-of-the-art coupled general circulation models. This can prove useful for better understanding anthropogenic and natural climate change, paleoclimatic climate variability, and climatic tipping points.
The extratropical meridional energy transport in the atmosphere is fundamentally intermittent in nature, having extremes large enough to affect the net seasonal transport. Here, we investigate how these extreme transports are associated with the dynamics of the atmosphere at multiple spatial scales, from planetary to synoptic. We use the ERA5 reanalysis data to perform a wavenumber decomposition of meridional energy transport in the Northern Hemisphere mid-latitudes during winter and summer. We then relate extreme transport events to atmospheric circulation anomalies and dominant weather regimes, identified by clustering 500 hPa geopotential height fields. In general, planetary-scale waves determine the strength and meridional position of the synoptic-scale baroclinic activity with their phase and amplitude, but important differences emerge between seasons. During winter, large wavenumbers (k = 2–3) are key drivers of the meridional-energy-transport extremes, and planetary- and synoptic-scale transport extremes virtually never co-occur. In summer, extremes are associated with higher wavenumbers (k = 4–6), identified as synoptic-scale motions. We link these waves and the transport extremes to recent results on exceptionally strong and persistent co-occurring summertime heat waves across the Northern Hemisphere mid-latitudes. We show that the weather regime structures associated with these heat wave events are typical for extremely large poleward-energy-transport events.