Observations of Earth from space have been made for over 40 years and have contributed to advances in many aspects of climate science. However, attempts to exploit this wealth of data are often hampered by a lack of homogeneity and continuity and by insufficient understanding of the products and their uncertainties. There is, therefore, a need to reassess and reprocess satellite datasets to maximize their usefulness for climate science. The European Space Agency has responded to this need by establishing the Climate Change Initiative (CCI). The CCI will create new climate data records for (currently) 13 essential climate variables (ECVs) and make these open and easily accessible to all. Each ECV project works closely with users to produce time series from the available satellite observations relevant to users' needs. A climate modeling users' group provides a climate system perspective and a forum to bring the data and modeling communities together. This paper presents the CCI program. It outlines its benefit and presents approaches and challenges for each ECV project, covering clouds, aerosols, ozone, greenhouse gases, sea surface temperature, ocean color, sea level, sea ice, land cover, fire, glaciers, soil moisture, and ice sheets. It also discusses how the CCI approach may contribute to defining and shaping future developments in Earth observation for climate science.

The second edition of the satellite-derived climate data record CLARA (The CM SAF Cloud, Albedo And Surface Radiation dataset from AVHRR data – second edition denoted as CLARA-A2) is described. The data record covers the 34-year period from 1982 until 2015 and consists of cloud, surface albedo and surface radiation budget products derived from the AVHRR (Advanced Very High Resolution Radiometer) sensor carried by polar-orbiting, operational meteorological satellites. The data record is produced by the EUMETSAT Climate Monitoring Satellite Application Facility (CM SAF) project as part of the operational ground segment. Its upgraded content and methodology improvements since edition 1 are described in detail, as are some major validation results. Some of the main improvements to the data record come from a major effort in cleaning and homogenizing the basic AVHRR level-1 radiance record and a systematic use of CALIPSO-CALIOP cloud information for development and validation purposes. Examples of applications studying decadal changes in Arctic summer surface albedo and cloud conditions are provided.

The question of how to derive and present uncertainty information in climate data records (CDRs) has received sustained attention within the European Space Agency Climate Change Initiative (CCI), a programme to generate CDRs addressing a range of essential climate variables (ECVs) from satellite data. Here, we review the nature, mathematics, practicalities, and communication of uncertainty information in CDRs from Earth observations. This review paper argues that CDRs derived from satellite-based Earth observation (EO) should include rigorous uncertainty information to support the application of the data in contexts such as policy, climate modelling, and numerical weather prediction reanalysis. Uncertainty, error, and quality are distinct concepts, and the case is made that CDR products should follow international metrological norms for presenting quantified uncertainty. As a baseline for good practice, total standard uncertainty should be quantified per datum in a CDR, meaning that uncertainty estimates should clearly discriminate more and less certain data. In this case, flags for data quality should not duplicate uncertainty information, but instead describe complementary information (such as the confidence in the uncertainty estimate provided or indicators of conditions violating the retrieval assumptions). The paper discusses the many sources of error in CDRs, noting that different errors may be correlated across a wide range of timescales and space scales. Error effects that contribute negligibly to the total uncertainty in a single-satellite measurement can be the dominant sources of uncertainty in a CDR on the large space scales and long timescales that are highly relevant for some climate applications. For this reason, identifying and characterizing the relevant sources of uncertainty for CDRs is particularly challenging. The characterization of uncertainty caused by a given error effect involves assessing the magnitude of the effect, the shape of the error distribution, and the propagation of the uncertainty to the geophysical variable in the CDR accounting for its error correlation properties. Uncertainty estimates can and should be validated as part of CDR validation when possible. These principles are quite general, but the approach to providing uncertainty information appropriate to different ECVs is varied, as confirmed by a brief review across different ECVs in the CCI. User requirements for uncertainty information can conflict with each other, and a variety of solutions and compromises are possible. The concept of an ensemble CDR as a simple means of communicating rigorous uncertainty information to users is discussed. Our review concludes by providing eight concrete recommendations for good practice in providing and communicating uncertainty in EO-based climate data records.

We present version 3 of the Cloud_cci Advanced Very High Resolution Radiometer post meridiem (AVHRR-PM) dataset, which contains a comprehensive set of cloud and radiative flux properties on a global scale covering the period of 1982 to 2016. The properties were retrieved from AVHRR measurements recorded by the afternoon (post meridiem – PM) satellites of the National Oceanic and Atmospheric Administration (NOAA) Polar Operational Environmental Satellite (POES) missions. The cloud properties in version 3 are of improved quality compared with the precursor dataset version 2, providing better global quality scores for cloud detection, cloud phase and ice water path based on validation results against A-Train sensors. Furthermore, the parameter set was extended by a suite of broadband radiative flux properties. They were calculated by combining the retrieved cloud properties with thermodynamic profiles from reanalysis and surface properties. The flux properties comprise upwelling and downwelling and shortwave and longwave broadband fluxes at the surface (bottom of atmosphere – BOA) and top of atmosphere (TOA). All fluxes were determined at the AVHRR pixel level for all-sky and clear-sky conditions, which will particularly facilitate the assessment of the cloud radiative effect at the BOA and TOA in future studies. Validation of the BOA downwelling fluxes against the Baseline Surface Radiation Network (BSRN) shows a very good agreement. This is supported by comparisons of multi-annual mean maps with NASA's Clouds and the Earth's Radiant Energy System (CERES) products for all fluxes at the BOA and TOA. The Cloud_cci AVHRR-PM version 3 (Cloud_cci AVHRR-PMv3) dataset allows for a large variety of climate applications that build on cloud properties, radiative flux properties and/or the link between them. For the presented Cloud_cci AVHRR-PMv3 dataset a digital object identifier has been issued: https://doi.org/10.5676/DWD/ESA_Cloud_cci/AVHRR-PM/V003 (Stengel et al., 2019).

A new satellite-derived climate dataset – denoted CLARA-A1 ("The CM SAF cLoud, Albedo and RAdiation dataset from AVHRR data") – is described. The dataset covers the 28 yr period from 1982 until 2009 and consists of cloud, surface albedo, and radiation budget products derived from the AVHRR (Advanced Very High Resolution Radiometer) sensor carried by polar-orbiting operational meteorological satellites. Its content, anticipated accuracies, limitations, and potential applications are described. The dataset is produced by the EUMETSAT Climate Monitoring Satellite Application Facility (CM SAF) project. The dataset has its strengths in the long duration, its foundation upon a homogenized AVHRR radiance data record, and in some unique features, e.g. the availability of 28 yr of summer surface albedo and cloudiness parameters over the polar regions. Quality characteristics are also well investigated and particularly useful results can be found over the tropics, mid to high latitudes and over nearly all oceanic areas. Being the first CM SAF dataset of its kind, an intensive evaluation of the quality of the datasets was performed and major findings with regard to merits and shortcomings of the datasets are reported. However, the CM SAF's long-term commitment to perform two additional reprocessing events within the time frame 2013–2018 will allow proper handling of limitations as well as upgrading the dataset with new features (e.g. uncertainty estimates) and extension of the temporal coverage.

Clouds play a central role in the Earth's atmosphere, and satellite observations are crucial for monitoring clouds and understanding their impact on the energy budget and water cycle. Within the European Organisation for the Exploitation of Meteorological Satellites (EUMETSAT) Satellite Application Facility on Climate Monitoring (CM SAF), a new cloud property data record was derived from geostationary Meteosat Spinning Enhanced Visible and Infrared Imager (SEVIRI) measurements for the time frame 2004–2015. The resulting CLAAS-2 (CLoud property dAtAset using SEVIRI, Edition 2) data record is publicly available via the CM SAF website (https://doi.org/10.5676/EUM_SAF_CM/CLAAS/V002). In this paper we present an extensive evaluation of the CLAAS-2 cloud products, which include cloud fractional coverage, thermodynamic phase, cloud top properties, liquid/ice cloud water path and corresponding optical thickness and particle effective radius. Data validation and comparisons were performed on both level 2 (native SEVIRI grid and repeat cycle) and level 3 (daily and monthly averages and histograms) with reference datasets derived from lidar, microwave and passive imager measurements. The evaluation results show very good overall agreement with matching spatial distributions and temporal variability and small biases attributed mainly to differences in sensor characteristics, retrieval approaches, spatial and temporal samplings and viewing geometries. No major discrepancies were found. Underpinned by the good evaluation results, CLAAS-2 demonstrates that it is fit for the envisaged applications, such as process studies of the diurnal cycle of clouds and the evaluation of regional climate models. The data record is planned to be extended and updated in the future.