Producing a global and comprehensive description of atmospheric aerosols requires integration of ground-based, airborne, satellite and model datasets. Due to its complexity, aerosol monitoring requires the use of several data records with complementary information content. This paper describes the lessons learned while developing and qualifying algorithms to generate aerosol Climate Data Records (CDR) within the European Space Agency (ESA) Aerosol_cci project. An iterative algorithm development and evaluation cycle involving core users is applied. It begins with the application-specific refinement of user requirements, leading to algorithm development, dataset processing and independent validation followed by user evaluation. This cycle is demonstrated for a CDR of total Aerosol Optical Depth (AOD) from two subsequent dual-view radiometers. Specific aspects of its applicability to other aerosol algorithms are illustrated with four complementary aerosol datasets. An important element in the development of aerosol CDRs is the inclusion of several algorithms evaluating the same data to benefit from various solutions to the ill-determined retrieval problem. The iterative approach has produced a 17-year AOD CDR, a 10-year stratospheric extinction profile CDR and a 35-year Absorbing Aerosol Index record. Further evolution cycles have been initiated for complementary datasets to provide insight into aerosol properties (i.e., dust aerosol, aerosol absorption).

We present a 3-D climatology of the desert dust distribution over South and East Asia derived using CALIPSO (Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observation) data. To distinguish desert dust from total aerosol load we apply a methodology developed in the framework of EARLINET (European Aerosol Research Lidar Network). The method involves the use of the particle linear depolarization ratio and updated lidar ratio values suitable for Asian dust, applied to multiyear CALIPSO observations (January 2007–December 2015). The resulting dust product provides information on the horizontal and vertical distribution of dust aerosols over South and East Asia along with the seasonal transition of dust transport pathways. Persistent high D_AOD (dust aerosol optical depth) values at 532 nm, of the order of 0.6, are present over the arid and semi-arid desert regions. Dust aerosol transport (range, height and intensity) is subject to high seasonality, with the highest values observed during spring for northern China (Taklimakan and Gobi deserts) and during summer over the Indian subcontinent (Thar Desert). Additionally, we decompose the CALIPSO AOD (aerosol optical depth) into dust and non-dust aerosol components to reveal the non-dust AOD over the highly industrialized and densely populated regions of South and East Asia, where the non-dust aerosols yield AOD values of the order of 0.5. Furthermore, the CALIPSO-based short-term AOD and D_AOD time series and trends between January 2007 and December 2015 are calculated over South and East Asia and over selected subregions. Positive trends are observed over northwest and east China and the Indian subcontinent, whereas over southeast China trends are mostly negative. The calculated AOD trends agree well with the trends derived from Aqua MODIS (Moderate Resolution Imaging Spectroradiometer), although significant differences are observed over specific regions.

The climate in the Arctic is changing faster than anywhere else on earth. Poorly understood feedback processes relating to Arctic clouds and aerosol–cloud interactions contribute to a poor understanding of the present changes in the Arctic climate system, and also to a large spread in projections of future climate in the Arctic. The problem is exacerbated by the paucity of research-quality observations in the central Arctic. Improved formulations in climate models require such observations, which can only come from measurements in situ in this difficult-to-reach region with logistically demanding environmental conditions. The Arctic Summer Cloud Ocean Study (ASCOS) was the most extensive central Arctic Ocean expedition with an atmospheric focus during the International Polar Year (IPY) 2007–2008. ASCOS focused on the study of the formation and life cycle of low-level Arctic clouds. ASCOS departed from Longyearbyen on Svalbard on 2 August and returned on 9 September 2008. In transit into and out of the pack ice, four short research stations were undertaken in the Fram Strait: two in open water and two in the marginal ice zone. After traversing the pack ice northward, an ice camp was set up on 12 August at 87°21' N, 01°29' W and remained in operation through 1 September, drifting with the ice. During this time, extensive measurements were taken of atmospheric gas and particle chemistry and physics, mesoscale and boundary-layer meteorology, marine biology and chemistry, and upper ocean physics. ASCOS provides a unique interdisciplinary data set for development and testing of new hypotheses on cloud processes, their interactions with the sea ice and ocean and associated physical, chemical, and biological processes and interactions. For example, the first-ever quantitative observation of bubbles in Arctic leads, combined with the unique discovery of marine organic material, polymer gels with an origin in the ocean, inside cloud droplets suggests the possibility of primary marine organically derived cloud condensation nuclei in Arctic stratocumulus clouds. Direct observations of surface fluxes of aerosols could, however, not explain observed variability in aerosol concentrations, and the balance between local and remote aerosols sources remains open. Lack of cloud condensation nuclei (CCN) was at times a controlling factor in low-level cloud formation, and hence for the impact of clouds on the surface energy budget. ASCOS provided detailed measurements of the surface energy balance from late summer melt into the initial autumn freeze-up, and documented the effects of clouds and storms on the surface energy balance during this transition. In addition to such process-level studies, the unique, independent ASCOS data set can and is being used for validation of satellite retrievals, operational models, and reanalysis data sets.

Satellite instruments provide a vantage point for studying aerosol loading consistently over different regions of the world. However, the typical lifetime of a single satellite platform is on the order of 5–15 years; thus, for climate studies, the use of multiple satellite sensors should be considered. Discrepancies exist between aerosol optical depth (AOD) products due to differences in their information content, spatial and temporal sampling, calibration, cloud masking, and algorithmic assumptions. Users of satellite-based AOD time-series are confronted with the challenge of choosing an appropriate dataset for the intended application. In this study, 16 monthly AOD products obtained from different satellite sensors and with different algorithms were inter-compared and evaluated against Aerosol Robotic Network (AERONET) monthly AOD. Global and regional analyses indicate that products tend to agree qualitatively on the annual, seasonal and monthly timescales but may be offset in magnitude. Several approaches were then investigated to merge the AOD records from different satellites and create an optimised AOD dataset. With few exceptions, all merging approaches lead to similar results, indicating the robustness and stability of the merged AOD products. We introduce a gridded monthly AOD merged product for the period 1995–2017. We show that the quality of the merged product is as least as good as that of individual products. Optimal agreement of the AOD merged product with AERONET further demonstrates the advantage of merging multiple products. This merged dataset provides a long-term perspective on AOD changes over different regions of the world, and users are encouraged to use this dataset.

The question of how to derive and present uncertainty information in climate data records (CDRs) has received sustained attention within the European Space Agency Climate Change Initiative (CCI), a programme to generate CDRs addressing a range of essential climate variables (ECVs) from satellite data. Here, we review the nature, mathematics, practicalities, and communication of uncertainty information in CDRs from Earth observations. This review paper argues that CDRs derived from satellite-based Earth observation (EO) should include rigorous uncertainty information to support the application of the data in contexts such as policy, climate modelling, and numerical weather prediction reanalysis. Uncertainty, error, and quality are distinct concepts, and the case is made that CDR products should follow international metrological norms for presenting quantified uncertainty. As a baseline for good practice, total standard uncertainty should be quantified per datum in a CDR, meaning that uncertainty estimates should clearly discriminate more and less certain data. In this case, flags for data quality should not duplicate uncertainty information, but instead describe complementary information (such as the confidence in the uncertainty estimate provided or indicators of conditions violating the retrieval assumptions). The paper discusses the many sources of error in CDRs, noting that different errors may be correlated across a wide range of timescales and space scales. Error effects that contribute negligibly to the total uncertainty in a single-satellite measurement can be the dominant sources of uncertainty in a CDR on the large space scales and long timescales that are highly relevant for some climate applications. For this reason, identifying and characterizing the relevant sources of uncertainty for CDRs is particularly challenging. The characterization of uncertainty caused by a given error effect involves assessing the magnitude of the effect, the shape of the error distribution, and the propagation of the uncertainty to the geophysical variable in the CDR accounting for its error correlation properties. Uncertainty estimates can and should be validated as part of CDR validation when possible. These principles are quite general, but the approach to providing uncertainty information appropriate to different ECVs is varied, as confirmed by a brief review across different ECVs in the CCI. User requirements for uncertainty information can conflict with each other, and a variety of solutions and compromises are possible. The concept of an ensemble CDR as a simple means of communicating rigorous uncertainty information to users is discussed. Our review concludes by providing eight concrete recommendations for good practice in providing and communicating uncertainty in EO-based climate data records.