The Surface ALbedo VALidation (SALVAL) online platform is designed to allow producers of satellite-based albedo products to move to operational validation systems. The SALVAL tool integrates long-term satellite products, global in situ datasets, and community-agreed-upon validation protocols into an online and interactive platform. The SALVAL tool, available on the ESA Cal/Val portal, was developed by EOLAB under the framework outlined by the Committee on Earth Observation Satellites (CEOS) Working Group on Calibration and Validation (WGCV) Land Product Validation (LPV) subgroup, and provides transparency, consistency, and traceability to the validation process. In this demonstration, three satellite-based albedo climate data records from different operational services were validated and intercompared using the SALVAL platform: (1) the Climate Change Service (C3S) multi-sensor product, (2) the NASA MODIS MCD43A3 product (C6.1) and (3) Beijing Normal University’s Global LAnd Surface Satellites (GLASS) version 4 products. This work demonstrates that the three satellite albedo datasets enable long-term reliable and consistent retrievals at the global scale, with some discrepancies between them associated with the retrieval processing chain. The three satellite albedo products show similar uncertainties (RMSD = 0.03) when comparing the best quality retrievals with ground measurements. The SALVAL platform has proven to be a useful tool to validate and intercompare albedo datasets, allowing them to reach stage 4 of the CEOS LPV validation hierarchy.
The Copernicus Climate Change Service (C3S) includes estimates of Essential Climate Variables (ECVs) as a series of Climate Data Records (CDRs) derived from satellite data. The C3S Surface Albedo (SA) v1.0 CDR is composed of observations from National Oceanic and Atmospheric Administration (NOAA) Very High Resolution Radiometers (AVHRR) (1981–2005), and VEGETATION sensors onboard Satellites for the Observation of the Earth (SPOT/VGT) (1998–2014) and Project for Onboard Autonomy satellite (PROBA-V) (2014–2020), and will continue with Sentinel-3 (from 2020 onwards). The goal of this study is to assess the uncertainties associated with the C3S PROBA-V SA v1.0 product, with a focus on the transition from SPOT/VGT to PROBA-V. The methodology followed the good practices recommended by the Land Product Validation sub-group (LPV) of the Working Group on Calibration and Validation (WGCV) of the Committee on Earth Observing Satellites (CEOS) for the validation of satellite-derived global albedo products. Several performance criteria were evaluated, including an intercomparison with National Aeronautics and Space Agency (NASA) MCD43A3 C6 products. C3S PROBA-V SA v1.0 and MCD43A3 C6 showed similar completeness but had higher fractions of missing data than C3S SPOT/VGT SA v1.0. C3S PROBA-V SA v1.0 showed similar precision (~1%) to MCD43A3 C6, improving the results of SPOT/VGT SA v1.0 (2–3%), but C3S PROBA-V SA v1.0 provided residual noise in the near-infrared (NIR). Good spatio-temporal continuity between C3S PROBA-V and SPOT/VGT SA v1.0 products was found with a mean bias between ±2%. The comparison with MCD43A3 C6 showed positive mean biases (5%, 8%, and 12% for visible, NIR and total shortwave, respectively). The accuracy assessment with ground measurements showed a median error of 18.4% with systematic overestimation (positive bias of 11.5%). The percentage of PROBA-V retrievals complying with the C3S target requirements was 28.6%.
This article presents validation and conformity testing of the Sentinel-3 Ocean Land Colour Instrument (OLCI) green instantaneous fraction of absorbed photosynthetically active radiation (FAPAR) and OLCI terrestrial chlorophyll index (OTCI) canopy chlorophyll content (CCC) products with fiducial reference measurements (FRM) collected in 2018 and 2021 over two sites (Las Tiesas—Barrax, Spain, and Wytham Woods, UK) in the context of the European Space Agency (ESA) Fiducial Reference Measurement for Vegetation (FRM4Veg) initiative. Following metrological principles, an end-to-end uncertainty evaluation framework developed in the project is used to account for the uncertainty of reference data based on a two-stage validation approach. The process involves quantifying uncertainties at the elementary sampling unit (ESU) level and incorporating these uncertainties in the upscaling procedures using orthogonal distance regression (ODR) between FRM and vegetation indices derived from Sentinel-2 data. Uncertainties in the Sentinel-2 data are also accounted for. FRM-based high spatial resolution reference maps and their uncertainties were aggregated to OLCI’s native spatial resolution using its apparent point spread function (PSF). The Sentinel-3 mission requirements, which give an uncertainty of 5% (goal) and 10% (threshold), were considered for conformity testing. GIFAPAR validation results revealed correlations > 0.95, RMSD ~0.1, and a slight negative bias (~−0.06) for both sites. This bias could be partly explained by the differences in the FAPAR definitions between the satellite product and the FRM-based reference. For the OTCI-based CCC, leave-one-out cross-validation demonstrated correlations > 0.8 and RMSDcv ~0.28 g·m−2. Despite the encouraging validation results, conclusive conformity with the strict mission requirements was low, with most cases providing inconclusive results (driven by large uncertainties in the satellite products as well as by the uncertainties in the upscaling approach). It is recommended that mission requirements for bio-geophysical products are reviewed, at least at the threshold level. It is also suggested that the large uncertainties associated with the two-stage validation approach may be avoided by directly comparing with spatially representative FRM.