Sam Hatfield

Sam Hatfield

Auto-generated profile, based on publicly available information

Sam Hatfield

European Centre for Medium‐Range Weather Forecasts Reading UK

Research Focus & Metrics

Academic Career Length

10Years (2017-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
30 October 2020 in Journal of Advances in Modeling Earth Systems
Verified
Journal Article
Open access
PDF file
NWNils P. Wedi
Nils P. Wedi
IPInna Polichtchouk
Inna Polichtchouk
PDPeter Dueben
Peter Dueben
VAValentine G. Anantharaj
Valentine G. Anantharaj
PBPeter Bauer
Peter Bauer
Frederic VitartFrederic Vitart
Frederic Vitart
In an attempt to advance the understanding of the Earth's weather and climate by representing deep convection explicitly, we present a global, four‐month simulation (November 2018 to February 2019) with ECMWF's hydrostatic Integrated Forecasting System (IFS) at an average grid spacing of 1.4 km. The impact of explicitly simulating deep convection on the atmospheric circulation and its variability is assessed by comparing the 1.4 km simulation to the equivalent well‐tested and calibrated global simulations at 9 km grid spacing with and without parametrized deep convection. The explicit simulation of deep convection at 1.4 km results in a realistic large‐scale circulation, better representation of convective storm activity, and stronger convective gravity wave activity when compared to the 9 km simulation with parametrized deep convection. Comparison of the 1.4 km simulation to the 9 km simulation without parametrized deep convection shows that switching off deep convection parametrization at a too coarse resolution (i.e., 9 km) generates too strong convective gravity waves. Based on the limited statistics available, improvements to the Madden‐Julian Oscillation or tropical precipitation are not observed at 1.4 km, suggesting that other Earth system model components and/or their interaction are important for an accurate representation of these processes and may well need adjusting at deep convection resolving resolutions. Overall, the good agreement of the 1.4 km simulation with the 9 km simulation with parametrized deep convection is remarkable, despite one of the most fundamental parametrizations being turned off at 1.4 km resolution and despite no adjustments being made to the remaining parametrizations.

23 September 2021 in Journal of Advances in Modeling Earth Systems
Verified
Journal Article
Open access
PDF file
SHSam Hatfield
Sam Hatfield
MCMatthew Chantry
Matthew Chantry
PDPeter Dueben
Peter Dueben
PLPhilippe Lopez
Philippe Lopez
AGAlan Geer
Alan Geer
TPTim Palmer
Tim Palmer
We assess the ability of neural network emulators of physical parametrization schemes in numerical weather prediction models to aid in the construction of linearized models required by four‐dimensional variational (4D‐Var) data assimilation. Neural networks can be differentiated trivially, and so if a physical parametrization scheme can be accurately emulated by a neural network then its tangent‐linear and adjoint versions can be obtained with minimal effort, compared with the standard paradigms of manual or automatic differentiation of the model code. Here we apply this idea by emulating the non‐orographic gravity wave drag parametrization scheme in an atmospheric model with a neural network, and deriving its tangent‐linear and adjoint models. We demonstrate that these neural network‐derived tangent‐linear and adjoint models not only pass the standard consistency tests but also can be used successfully to do 4D‐Var data assimilation. This technique holds the promise of significantly easing maintenance of tangent‐linear and adjoint codes in weather forecasting centers, if accurate neural network emulators can be constructed.

4 October 2021 in Quarterly Journal of the Royal Meteorological Society
Verified
Journal Article
Open access
PDF file
SLSimon T. K. Lang
Simon T. K. Lang
ADAndrew Dawson
Andrew Dawson
MDMichail Diamantakis
Michail Diamantakis
PDPeter Dueben
Peter Dueben
SHSamuel Hatfield
Samuel Hatfield
NWNils Wedi
Nils Wedi
Reducing the numerical precision of the forecast model of the Integrated Forecasting System (IFS) of the European Centre for Medium‐Range Weather Forecasts (ECMWF) from double to single precision results in significant computational savings without negatively affecting forecast accuracy. The computational savings allow to increase the vertical resolution of the operational ensemble forecasts from 91 to 137 levels earlier than anticipated and before the next upgrade of ECMWF's high‐performance computing facility. This upgrade to 137 levels harmonises the vertical resolution of the medium‐range deterministic forecasts and the medium‐range and extended‐range ensemble forecasts. Increasing the vertical resolution of the ensemble forecasts substantially improves forecast skill for all lead times as well as the mean of the model climate. ECMWF's ensemble and deterministic forecasts will run operationally at single precision from IFS model cycle 47R2 onwards.

12 June 2019
Verified
Conference Paper
Open access
SHSam Hatfield
Sam Hatfield
MCMatthew Chantry
Matthew Chantry
PDPeter Düben
Peter Düben
TPTim Palmer
Tim Palmer

28 December 2017 in Monthly Weather Review
Verified
Journal Article
Open access
SHSam Hatfield
Sam Hatfield
ASAneesh Subramanian
Aneesh Subramanian
TPTim Palmer
Tim Palmer
PDPeter Düben
Peter Düben
A new approach for improving the accuracy of data assimilation, by trading numerical precision for ensemble size, is introduced. Data assimilation is inherently uncertain because of the use of noisy observations and imperfect models. Thus, the larger rounding errors incurred from reducing precision may be within the tolerance of the system. Lower-precision arithmetic is cheaper, and so by reducing precision in ensemble data assimilation, computational resources can be redistributed toward, for example, a larger ensemble size. Because larger ensembles provide a better estimate of the underlying distribution and are less reliant on covariance inflation and localization, lowering precision could actually permit an improvement in the accuracy of weather forecasts. Here, this idea is tested on an ensemble data assimilation system comprising the Lorenz ’96 toy atmospheric model and the ensemble square root filter. The system is run at double-, single-, and half-precision (the latter using an emulation tool), and the performance of each precision is measured through mean error statistics and rank histograms. The sensitivity of these results to the observation error and the length of the observation window are addressed. Then, by reinvesting the saved computational resources from reducing precision into the ensemble size, assimilation error can be reduced for (hypothetically) no extra cost. This results in increased forecasting skill, with respect to double-precision assimilation.

11 February 2022 in Journal of Advances in Modeling Earth Systems
Verified
Journal Article
Open access
PDF file
MKMilan Klöwer
Milan Klöwer
SHSam Hatfield
Sam Hatfield
MCMatteo Croci
Matteo Croci
PDPeter D. Düben
Peter D. Düben
TPTim Palmer
Tim Palmer
Most Earth‐system simulations run on conventional central processing units in 64‐bit double precision floating‐point numbers Float64, although the need for high‐precision calculations in the presence of large uncertainties has been questioned. Fugaku, currently the world's fastest supercomputer, is based on A64FX microprocessors, which also support the 16‐bit low‐precision format Float16. We investigate the Float16 performance on A64FX with ShallowWaters.jl, the first fluid circulation model that runs entirely with 16‐bit arithmetic. The model implements techniques that address precision and dynamic range issues in 16 bits. The precision‐critical time integration is augmented to include compensated summation to minimize rounding errors. Such a compensated time integration is as precise but faster than mixed precision with 16 and 32‐bit floats. As subnormals are inefficiently supported on A64FX the very limited range available in Float16 is 6 × 10−5 to 65,504. We develop the analysis‐number format Sherlogs.jl to log the arithmetic results during the simulation. The equations in ShallowWaters.jl are then systematically rescaled to fit into Float16, using 97% of the available representable numbers. Consequently, we benchmark speedups of up to 3.8x on A64FX with Float16. Adding a compensated time integration, speedups reach up to 3.6x. Although ShallowWaters.jl is simplified compared to large Earth‐system models, it shares essential algorithms and therefore shows that 16‐bit calculations are indeed a competitive way to accelerate Earth‐system simulations on available hardware.