This paper reviews the development of the ensemble Kalman filter (EnKF) for atmospheric data assimilation. Particular attention is devoted to recent advances and current challenges. The distinguishing properties of three well-established variations of the EnKF algorithm are first discussed. Given the limited size of the ensemble and the unavoidable existence of errors whose origin is unknown (i.e., system error), various approaches to localizing the impact of observations and to accounting for these errors have been proposed. However, challenges remain; for example, with regard to localization of multiscale phenomena (both in time and space). For the EnKF in general, but higher-resolution applications in particular, it is desirable to use a short assimilation window. This motivates a focus on approaches for maintaining balance during the EnKF update. Also discussed are limited-area EnKF systems, in particular with regard to the assimilation of radar data and applications to tracking severe storms and tropical cyclones. It seems that relatively less attention has been paid to optimizing EnKF assimilation of satellite radiance observations, the growing volume of which has been instrumental in improving global weather predictions. There is also a tendency at various centers to investigate and implement hybrid systems that take advantage of both the ensemble and the variational data assimilation approaches; this poses additional challenges and it is not clear how it will evolve. It is concluded that, despite more than 10 years of operational experience, there are still many unresolved issues that could benefit from further research.Contents Introduction...4490 Popular flavors of the EnKF algorithm...4491 General description...4491 Stochastic and deterministic filters...4492 The stochastic filter...4492 The deterministic filter...4492 Sequential or local filters...4493 Sequential ensemble Kalman filters...4493 The local ensemble transform Kalman filter...4494 Extended state vector...4494 Issues for the development of algorithms...4495 Use of small ensembles...4495 Monte Carlo methods...4495 Validation of reliability...4497 Use of group filters with no inbreeding...4498 Sampling error due to limited ensemble size: The rank problem...4498 Covariance localization...4499 Localization in the sequential filter...4499 Localization in the LETKF...4499 Issues with localization...4500 Summary...4501 Methods to increase ensemble spread...4501 Covariance inflation...4501 Additive inflation...4501 Multiplicative inflation...4502 Relaxation to prior ensemble information...4502 Issues with inflation...4503 Diffusion and truncation...4503 Error in physical parameterizations...4504 Physical tendency perturbations...4504 Multimodel, multiphysics, and multiparameter approaches...4505 Future directions...4505 Realism of error sources...4506 Balance and length of the assimilation window...4506 The need for balancing methods...4506 Time-filtering methods...4506 Toward shorter assimilation windows...4507 Reduction of sources of imbalance...4507 Regional data assimilation...4508 Boundary conditions and consistency across multiple domains...4509 Initialization of the starting ensemble...4510 Preprocessing steps for radar observations...4510 Use of radar observations for convective-scale analyses...4511 Use of radar observations for tropical cyclone analyses...4511 Other issues with respect to LAM data assimilation...4511 The assimilation of satellite observations...4512 Covariance localization...4512 Data density...4513 Bias-correction procedures...4513 Impact of covariance cycling...4514 Assumptions regarding observational error...4514 Recommendations regarding satellite observations...4515 Computational aspects...4515 Parameters with an impact on quality...4515 Overview of current parallel algorithms...4516 Evolution of computer architecture...4516 Practical issues...4517 Approaching the gray zone...4518 Summary...4518 Hybrids with variational and EnKF components...4519 Hybrid background error covariances...4519 E4DVar with the α control variable...4519 Not using linearized models with 4DEnVar...4520 The hybrid gain algorithm...4521 Open issues and recommendations...4521 Summary and discussion...4521 Stochastic or deterministic filters...4522 The nature of system error...4522 Going beyond the synoptic scales...4522 Satellite observations...4523 Hybrid systems...4523 Future of the EnKF...4523 APPENDIX A...4524Types of Filter Divergence...4524 Classical filter divergence...4524 Catastrophic filter divergence...4524APPENDIX B...4524Systems Available for Download...4524References...4525
1 September 2010 in Journal of Applied Meteorology and Climatology
Accurate depiction of meteorological conditions, especially within the planetary boundary layer (PBL), is important for air pollution modeling, and PBL parameterization schemes play a critical role in simulating the boundary layer. This study examines the sensitivity of the performance of the Weather Research and Forecast (WRF) model to the use of three different PBL schemes [Mellor–Yamada–Janjic (MYJ), Yonsei University (YSU), and the asymmetric convective model, version 2 (ACM2)]. Comparison of surface and boundary layer observations with 92 sets of daily, 36-h high-resolution WRF simulations with different schemes over Texas in July–September 2005 shows that the simulations with the YSU and ACM2 schemes give much less bias than with the MYJ scheme. Simulations with the MYJ scheme, the only local closure scheme of the three, produced the coldest and moistest biases in the PBL. The differences among the schemes are found to be due predominantly to differences in vertical mixing strength and entrainment of air from above the PBL. A sensitivity experiment with the ACM2 scheme confirms this diagnosis.
The ensemble Kalman filter (EnKF) uses an ensemble of short-range forecasts to estimate the flow-dependent background error covariances required in data assimilation. The feasibility of the EnKF for convective-scale data assimilation has been previously demonstrated in perfect-model experiments using simulated observations of radial velocity from a supercell storm. The present study further explores the potential and behavior of the EnKF at convective scales by considering more realistic initial analyses and variations in the availability and quality of the radar observations. Assimilation of simulated radial-velocity observations every 5 min where there is significant reflectivity using 20 ensemble members proves to be successful in most realistic observational scenarios for simulated supercell thunderstorms, although the same degree of success may not be readily expected with real observations and an imperfect model, at least with the present EnKF implementation. Even though the filter converge... Abstract The ensemble Kalman filter (EnKF) uses an ensemble of short-range forecasts to estimate the flow-dependent background error covariances required in data assimilation. The feasibility of the EnKF for convective-scale data assimilation has been previously demonstrated in perfect-model experiments using simulated observations of radial velocity from a supercell storm. The present study further explores the potential and behavior of the EnKF at convective scales by considering more realistic initial analyses and variations in the availability and quality of the radar observations. Assimilation of simulated radial-velocity observations every 5 min where there is significant reflectivity using 20 ensemble members proves to be successful in most realistic observational scenarios for simulated supercell thunderstorms, although the same degree of success may not be readily expected with real observations and an imperfect model, at least with the present EnKF implementation. Even though the filter converge...
For several decades, jets and fronts have been known from observations to be significant sources of internal gravity waves in the atmosphere. Motivations to investigate these waves have included their impact on tropospheric convection, their contribution to local mixing and turbulence in the upper troposphere, their vertical propagation into the middle atmosphere, and the forcing of its global circulation. While many different studies have consistently highlighted jet exit regions as a favored locus for intense gravity waves, the mechanisms responsible for their emission had long remained elusive: one reason is the complexity of the environment in which the waves appear; another reason is that the waves constitute small deviations from the balanced dynamics of the flow generating them; i.e., they arise beyond our fundamental understanding of jets and fronts based on approximations that filter out gravity waves. Over the past two decades, the pressing need for improving parameterizations of nonorographic gravity waves in climate models that include a stratosphere has stimulated renewed investigations. The purpose of this review is to present current knowledge and understanding on gravity waves near jets and fronts from observations, theory, and modeling, and to discuss challenges for progress in coming years.
Assimilation of Doppler radar data into cloud models is an important obstacle to routine numerical weather prediction for convective-scale motions; the difficulty lies in initializing fields of wind, temperature, moisture, and condensate given only observations of radial velocity and reflectivity from the radar. This paper investigates the potential of the ensemble Kalman filter (EnKF), which estimates the covariances between observed variables and the state through an ensemble of forecasts, to assimilate radar observations at convective scales. In the basic experiment, simulated observations are extracted from a reference simulation of a splitting supercell and assimilated using the EnKF and the same numerical model that produced the reference simulation. The EnKF produces accurate analyses, including the unobserved variables, after roughly 30 min (or six scans) of radial velocity observations. Additional experiments, in which forecasts are made from the ensemble-mean analysis, reveal that forecast errors grow significantly in this simple system, so that the ability of the EnKF to track the reference solution is not simply because of stable system dynamics. It is also found that the covariances between radial velocity and temperature, moisture, and condensate are important to the quality of the analyses, as is the initialization chosen for the ensemble members prior to assimilating the first observations. These results are promising, especially given the ease of implementing the EnKF. A number of important issues remain, however, including the initialization of the ensemble prior to the first observation, the treatment of uncertainty in the environmental sounding, the role of error in the forecast model (particularly the microphysical parameterizations), and the treatment of lateral boundary conditions.
This study explores the assimilation of Doppler radar radial velocity observations for cloud-resolving hurricane analysis, initialization, and prediction with an ensemble Kalman filter (EnKF). The case studied is Hurricane Humberto (2007), the first landfalling hurricane in the United States since the end of the 2005 hurricane season and the most rapidly intensifying near-landfall storm in U.S. history. The storm caused extensive damage along the southeast Texas coast but was poorly predicted by operational models and forecasters. It is found that the EnKF analysis, after assimilating radial velocity observations from three Weather Surveillance Radars-1988 Doppler (WSR-88Ds) along the Gulf coast, closely represents the best-track position and intensity of Humberto. Deterministic forecasts initialized from the EnKF analysis, despite displaying considerable variability with different lead times, are also capable of predicting the rapid formation and intensification of the hurricane. These forecasts are also superior to simulations without radar data assimilation or with a three-dimensional variational scheme assimilating the same radar observations. Moreover, nearly all members from the ensemble forecasts initialized with EnKF analysis perturbations predict rapid formation and intensification of the storm. However, the large ensemble spread of peak intensity, which ranges from a tropical storm to a category 2 hurricane, echoes limited predictability in deterministic forecasts of the storm and the potential of using ensembles for probabilistic forecasts of hurricanes.