To date, a large variety of water vapour data records from satellite and reanalysis are available. It is key to understand the quality and uncertainty of these data records in order to fully exploit these records and to avoid data being employed incorrectly or misinterpreted. Therefore, it is important to inform users on accuracy and limitations of these data records based on consistent inter-comparisons carried out in the framework of international assessments. Addressing this challenge is the major objective of the Global Water and Energy Exchanges (GEWEX) water vapor assessment (G-VAP) which was initiated by the GEWEX Data and Assessments Panel (GDAP). Here, an overview of G-VAP objectives and an introduction to the results from G-VAP’s first phase are given. After this overview, a summary of available data records on water vapour and closely related variables and a short introduction to the utilized methods are presented. The results from inter-comparisons, homogeneity testing and inter-comparison of trend estimates, achieved within G-VAP’s first phase are summarized. The conclusions on future research directions for the wider community and for G-VAP’s next phase are outlined and recommendations have been formulated. For instance, a key recommendation is the need for recalibration and improved inter-calibration of radiance data records and subsequent reprocessing in order to increase stability and to provide uncertainty estimates. This need became evident from a general disagreement in trend estimates (e.g., trends in TCWV ranging from −1.51 ± 0.17 kg/m²/decade to 1.22 ± 0.16 kg/m²/decade) and the presence of break points on global and regional scale. It will be a future activity of G-VAP to reassess the stability of updated or new data records and to assess consistency, i.e., the closeness of data records given their uncertainty estimates.

In the last two decades, technological progress has not only seen improvements to the quality of atmospheric upper-air observations but also provided the opportunity to design and implement automated systems able to replace measurement procedures typically performed manually. Radiosoundings, which remain one of the primary data sources for weather and climate applications, are still largely performed around the world manually, although increasingly fully automated upper-air observations are used, from urban areas to the remotest locations, which minimize operating costs and challenges in performing radiosounding launches. This analysis presents a first step to demonstrating the reliability of the automatic radiosonde launchers (ARLs) provided by Vaisala, Meteomodem and Meisei. The metadata and datasets collected by a few existing ARLs operated by the Global Climate Observing System (GCOS) Reference Upper-Air Network (GRUAN) certified or candidate sites (Sodankylä, Payerne, Trappes, Potenza) have been investigated and a comparative analysis of the technical performance (i.e. manual versus ARL) is reported. The performance of ARLs is evaluated as being similar or superior to those achieved with the traditional manual launches in terms of percentage of successful launches, balloon burst and ascent speed. For both temperature and relative humidity, the ground-check comparisons showed a negative bias of a few tenths of a degree and % RH, respectively. Two datasets of parallel soundings between manual and ARL-based measurements, using identical sonde models, provided by Sodankylä and Faa'a stations, showed mean differences between the ARL and manual launches smaller than ±0.2 K up to 10 hPa for the temperature profiles. For relative humidity, differences were smaller than 1 % RH for the Sodankylä dataset up to 300 hPa, while they were smaller than 0.7 % RH for Faa'a station. Finally, the observation-minus-background (O–B) mean and root mean square (rms) statistics for German RS92 and RS41 stations, which operate a mix of manual and ARL launch protocols, calculated using the European Centre for Medium-Range Weather Forecasts (ECMWF) forecast model, are very similar, although RS41 shows larger rms(O–B) differences for ARL stations, in particular for temperature and wind. A discussion of the potential next steps proposed by GRUAN community and other parties is provided, with the aim to lay the basis for the elaboration of a strategy to fully demonstrate the value of ARLs and guarantee that the provided products are traceable and suitable for the creation of GRUAN data products.

Radiosondes are important for calibrating satellite sensors and assessing sounding retrievals. Vaisala RS41 radiosondes have mostly replaced RS92 in the Global Climate Observing System (GCOS) Reference Upper Air Network (GRUAN) and the conventional network. This study assesses RS41 and RS92 upper tropospheric humidity (UTH) accuracy by comparing with Infrared Atmospheric Sounding Interferometer (IASI) upper tropospheric water vapor absorption spectrum measurements. Using single RS41 and RS92 soundings at three GRUAN and DOE Atmospheric Radiation Measurement (ARM) sites and dual RS92/RS41 launches at three additional GRUAN sites, collocated with cloud-free IASI radiances (OBS), we compute Line-by-Line Radiative Transfer Model radiances for radiosonde profiles (CAL). We analyze OBS-CAL differences from 2015 to 2020, for daytime, nighttime, and dusk/dawn separately if data is available, for standard (STD) RS92 and RS41 processing, and RS92 GRUAN Data Processing (GDP; RS41 GDP is in development). We find that daytime RS41 (even without GDP) has ~1% smaller UTH errors than GDP RS92. RS41 may still have a dry bias of 1–1.5% for both daytime and nighttime, and a similar error for nighttime RS92 GDP, while standard RS92 may have a dry bias of 3–4%. These sonde humidity biases are probably upper limits since “cloud-free” scenes could still be cloud contaminated. Radiances computed from European Centre for Medium-Range Weather Forecasts (ECMWF) analyses match better than radiosondes with IASI measurements, perhaps because ECMWF assimilates IASI measurements. Relative differences between RS41 STD and RS92 GDP, or between radiosondes and ECMWF humidity profiles obtained from the radiance analysis, are consistent with their differences obtained directly from the RH measurements.

Radiosonde soundings from the GCOS Reference Upper-Air Network (GRUAN) data record are shown to be consistent with Infrared Atmospheric Sounding Instrument (IASI)-measured radiances via LBLRTM (Line-By-Line Radiative Transfer Model) in the part of the spectrum that is mostly affected by water vapour absorption in the upper troposphere (from 700 hPa up). This result is key for climate data records, since GRUAN, IASI and LBLRTM constitute reference measurements or a reference radiative transfer model in each of their fields. This is specially the case for night-time radiosonde measurements. Although the sample size is small (16 cases), daytime GRUAN radiosonde measurements seem to have a small dry bias of 2.5 % in absolute terms of relative humidity, located mainly in the upper troposphere, with respect to LBLRTM and IASI. Full metrological closure is not yet possible and will not be until collocation uncertainties are better characterized and a full uncertainty covariance matrix is clarified for GRUAN.

Volume mixing ratio water vapour profiles have been retrieved from IASI (Infrared Atmospheric Sounding Interferometer) spectra using the MUSICA (MUlti-platform remote Sensing of Isotopologues for investigating the Cycle of Atmospheric water) processor. The retrievals are done for IASI observations that coincide with Vaisala RS92 radiosonde measurements performed in the framework of the GCOS (Global Climate Observing System) Reference Upper-Air Network (GRUAN) in three different climate zones: the tropics (Manus Island, 2° S), mid-latitudes (Lindenberg, 52° N), and polar regions (Sodankylä, 67° N). The retrievals show good sensitivity with respect to the vertical H₂O distribution between 1 km above ground and the upper troposphere. Typical DOFS (degrees of freedom for signal) values are about 5.6 for the tropics, 5.1 for summertime mid-latitudes, 3.8 for wintertime mid-latitudes, and 4.4 for summertime polar regions. The errors of the MUSICA IASI water vapour profiles have been theoretically estimated considering the contribution of many different uncertainty sources. For all three climate regions, unrecognized cirrus clouds and uncertainties in atmospheric temperature have been identified as the most important error sources and they can reach about 25 %. The MUSICA IASI water vapour profiles have been compared to 100 individual coincident GRUAN water vapour profiles. The systematic difference between the data is within 11 % below 12 km altitude; however, at higher altitudes the MUSICA IASI data show a dry bias with respect to the GRUAN data of up to 21 %. The scatter is largest close to the surface (30 %), but never exceeds 21 % above 1 km altitude. The comparison study documents that the MUSICA IASI retrieval processor provides H₂O profiles that capture the large variations in H₂O volume mixing ratio profiles well from 1 km above ground up to altitudes close to the tropopause. Above 5 km the observed scatter with respect to GRUAN data is in reasonable agreement with the combined MUSICA IASI and GRUAN random errors. The increased scatter at lower altitudes might be explained by surface emissivity uncertainties at the summertime continental sites of Lindenberg and Sodankylä, and the upper tropospheric dry bias might suggest deficits in correctly modelling the spectroscopic line shapes of water vapour.

Water vapor concentration structures in the atmosphere are well approximated horizontally by Gaussian random fields at small scales (≲6 km). These Gaussian random fields have a spatial correlation in accordance with a structure function with a two-thirds slope, following the corresponding law from Kolmogorov's theory of turbulence. This is proven by showing that the horizontal structure functions measured by several satellite instruments and radiosonde measurements do indeed follow the two-thirds law. High-spatial-resolution retrievals of total column water vapor (TCWV) obtained from the Ocean and Land Color Instrument (OLCI) on board the Sentinel-3 series of satellites also qualitatively show a Gaussian random field structure. As a consequence, the atmosphere has an inherently stochastic component associated with the horizontal small-scale water vapor features, which, in turn, can make deterministic forecasting or nowcasting difficult. These results can be useful in areas where high-resolution modeling of water vapor is required, such as the estimation of the water vapor variance within a region or when searching for consistency between different water vapor measurements in neighboring locations. In terms of weather forecasting or nowcasting, the water vapor horizontal variability could be important in estimating the uncertainty of the atmospheric processes driving convection.