After extensive efforts over the course of a decade, convective-scale weather forecasts with horizontal grid spacings of 1–5 km are now operational at national weather services around the world, accompanied by ensemble prediction systems (EPSs). However, though already operational, the capacity of forecasts for this scale is still to be fully exploited by overcoming the fundamental difficulty in prediction: the fully three-dimensional and turbulent nature of the atmosphere. The prediction of this scale is totally different from that of the synoptic scale (10³km), with slowly evolving semigeostrophic dynamics and relatively long predictability on the order of a few days.Even theoretically, very little is understood about the convective scale compared to our extensive knowledge of the synoptic-scale weather regime as a partial differential equation system, as well as in terms of the fluid mechanics, predictability, uncertainties, and stochasticity. Furthermore, there is a requirement for a drastic modification of data assimilation methodologies, physics (e.g., microphysics), and parameterizations, as well as the numerics for use at the convective scale. We need to focus on more fundamental theoretical issues—the Liouville principle and Bayesian probability for probabilistic forecasts—and more fundamental turbulence research to provide robust numerics for the full variety of turbulent flows.The present essay reviews those basic theoretical challenges as comprehensibly as possible. The breadth of the problems that we face is a challenge in itself: an attempt to reduce these into a single critical agenda should be avoided.

Potential vorticity (PV) succinctly describes the evolution of large‐scale atmospheric flow because of its material conservation and invertibility properties. However, diabatic processes in extratropical cyclones can modify PV and influence both mesoscale weather and the evolution of the synoptic‐scale wave pattern. In this investigation, modification of PV by diabatic processes is diagnosed in a Met Office Unified Model (MetUM) simulation of a North Atlantic cyclone using a set of PV tracers. The structure of diabatic PV within the extratropical cyclone is investigated and linked to the processes responsible for it. On the mesoscale, a tripole of diabatic PV is generated across the tropopause fold extending down to the cold front. The structure results from a dipole in heating across the frontal interface due to condensation in the warm conveyor belt flanking the upper side of the fold and evaporation of precipitation in the dry intrusion and below. On isentropic surfaces intersecting the tropopause, positive diabatic PV is generated on the stratospheric side, while negative diabatic PV is generated on the tropospheric side. The stratospheric diabatic PV is generated primarily by long‐wave cooling which peaks at the tropopause itself due to the sharp gradient in humidity there. The tropospheric diabatic PV originates locally from the long‐wave radiation and non‐locally by advection out of the top of heating associated with the large‐scale cloud, convection and boundary layer schemes. In most locations there is no diabatic modification of PV at the tropopause itself but diabatic PV anomalies would influence the tropopause indirectly through the winds they induce and subsequent advection. The consequences of this diabatic PV dipole for the evolution of synoptic‐scale wave patterns are discussed.

The North Atlantic Waveguide and Downstream Impact Experiment (NAWDEX) explored the impact of diabatic processes on disturbances of the jet stream and their influence on downstream high-impact weather through the deployment of four research aircraft, each with a sophisticated set of remote sensing and in situ instruments, and coordinated with a suite of ground-based measurements. A total of 49 research flights were performed, including, for the first time, coordinated flights of the four aircraft: the German High Altitude and Long Range Research Aircraft (HALO), the Deutsches Zentrum für Luft- und Raumfahrt (DLR) Dassault Falcon 20, the French Service des Avions Français Instrumentés pour la Recherche en Environnement (SAFIRE) Falcon 20, and the British Facility for Airborne Atmospheric Measurements (FAAM) BAe 146. The observation period from 17 September to 22 October 2016 with frequently occurring extratropical and tropical cyclones was ideal for investigating midlatitude weather over the North Atlantic. NAWDEX featured three sequences of upstream triggers of waveguide disturbances, as well as their dynamic interaction with the jet stream, subsequent development, and eventual downstream weather impact on Europe. Examples are presented to highlight the wealth of phenomena that were sampled, the comprehensive coverage, and the multifaceted nature of the measurements. This unique dataset forms the basis for future case studies and detailed evaluations of weather and climate predictions to improve our understanding of diabatic influences on Rossby waves and the downstream impacts of weather systems affecting Europe.

Diabatic processes can alter Rossby wave structure; consequently, errors arising from model processes propagate downstream. However, the chaotic spread of forecasts from initial condition uncertainty renders it difficult to trace back from root‐mean‐square forecast errors to model errors. Here diagnostics unaffected by phase errors are used, enabling investigation of systematic errors in Rossby waves in winter season forecasts from three operational centers. Tropopause sharpness adjacent to ridges decreases with forecast lead time. It depends strongly on model resolution, even though models are examined on a common grid. Rossby wave amplitude reduces with lead 5 days, consistent with underrepresentation of diabatic modification and transport of air from the lower troposphere into upper tropospheric ridges, and with too weak humidity gradients across the tropopause. However, amplitude also decreases when resolution is decreased. Further work is necessary to isolate the contribution from errors in the representation of diabatic processes.

Examination of conditional instability of the second kind (CISK) and wind-induced surface heat exchange (WISHE), two proposed mechanisms for tropical cyclone and polar low intensification, suggests that the sensitivity of the intensification rate of these disturbances to surface properties, such as surface friction and moisture supply, will be different for the two mechanisms. These sensitivities were examined by perturbing the surface characteristics in a numerical model with explicit convection. The intensification rate was found to have a strong positive dependence on the heat and moisture transfer coefficients, while remaining largely insensitive to the frictional drag coefficient. CISK does not predict the observed dependence of vortex intensification rate on the heat and moisture transfer coefficients, nor the insensitivity to the frictional drag coefficient since it anticipates that intensification rate is controlled by frictional convergence in the boundary layer. Since neither conditiona... Abstract Examination of conditional instability of the second kind (CISK) and wind-induced surface heat exchange (WISHE), two proposed mechanisms for tropical cyclone and polar low intensification, suggests that the sensitivity of the intensification rate of these disturbances to surface properties, such as surface friction and moisture supply, will be different for the two mechanisms. These sensitivities were examined by perturbing the surface characteristics in a numerical model with explicit convection. The intensification rate was found to have a strong positive dependence on the heat and moisture transfer coefficients, while remaining largely insensitive to the frictional drag coefficient. CISK does not predict the observed dependence of vortex intensification rate on the heat and moisture transfer coefficients, nor the insensitivity to the frictional drag coefficient since it anticipates that intensification rate is controlled by frictional convergence in the boundary layer. Since neither conditiona...

A climatology of extratropical cyclones is produced using an objective method of identifying cyclones based on gradients of 1-km height wet-bulb potential temperature. Cyclone track and genesis density statistics are analyzed and this method is found to compare well with other cyclone identification methods. The North Atlantic storm track is reproduced along with the major regions of genesis. Cyclones are grouped according to their genesis location and the corresponding lysis regions are identified. Most of the cyclones that cross western Europe originate in the east Atlantic where the baroclinicity and the sea surface temperature gradients are weak compared to the west Atlantic. East Atlantic cyclones also have higher 1-km height relative vorticity and lower mean sea level pressure at their genesis point than west Atlantic cyclones. This is consistent with the hypothesis that they are secondary cyclones developing on the trailing fronts of preexisting “parent” cyclones. The evolution characteristics of composite west and east Atlantic cyclones have been compared. The ratio of their upper- to lower-level forcing indicates that type B cyclones are predominant in both the west and east Atlantic, with strong upper- and lower-level features. Among the remaining cyclones, there is a higher proportion of type C cyclones in the east Atlantic, whereas types A and C are equally frequent in the west Atlantic.