Diatoms are the major marine primary producers on the global scale and, recently, several methods have been developed to retrieve their abundance or dominance from satellite remote sensing data. In this work, we highlight the importance of the Southern Ocean (SO) in developing a global algorithm for diatom using an Abundance Based Approach (ABA). A large global in situ data set of phytoplankton pigments was compiled, particularly with more samples collected in the SO. We revised the ABA to take account of the information on the penetration depth (Zpd) and to improve the relationship between diatoms and total chlorophyll-a (TChla). The results showed that there is a distinct relationship between diatoms and TChla in the SO, and a new global model (ABAZpd) improved the estimation of diatoms abundance by 28% in the SO compared with the original ABA model. In addition, we developed a regional model for the SO which further improved the retrieval of diatoms by 17% compared with the global ABAZpd model. As a result, we found that diatom may be more abundant in the SO than previously thought. Linear trend analysis of diatom abundance using the regional model for the SO showed that there are statistically significant trends, both increasing and decreasing, in diatom abundance over the past eleven years in the region.
Understanding of evapotranspiration (ET) processes over Andean mountain environments is crucial, particularly due to the importance of these regions to deliver water-related ecosystem services. In this context, the detection of spatio-temporal changes in ET remains poorly investigated for specific Andean ecosystems, like the páramo. To overcome this lack of knowledge, we implemented the energy-balance model METRIC with Landsat 7 ETM+ and MODIS-Terra imagery for a páramo catchment. The implementation contemplated adjustments for complex terrain in order to obtain daily, monthly and annual ET maps (between 2013 and 2014). In addition, we compared our results to the global ET product MOD16. Finally, a rigorous validation of the outputs was conducted with residual ET from the water balance. ET retrievals from METRIC (Landsat-based) showed good agreement with the validation-related ET at monthly and annual steps (mean bias error <8 mm·month−1 and annual deviation <17%). However, METRIC (MODIS-based) outputs and the MOD16 product were revealed to be unsuitable for our study due to the low spatial resolution. At last, the plausibility of METRIC to obtain spatial ET retrievals using higher resolution satellite data is demonstrated, which constitutes the first contribution to the understanding of spatially-explicit ET over an alpine catchment in the neo-tropical Andes.
Spaceborne imaging spectroscopy, also called hyperspectral remote sensing, has shown huge potential to improve current water colour retrievals and, thereby, the monitoring of inland and coastal water ecosystems. However, the quality of water colour retrievals strongly depends on successful removal of the atmospheric/surface contributions to the radiance measured by satellite sensors. Atmospheric correction (AC) algorithms are specially designed to handle these effects, but are challenged by the hundreds of narrow spectral bands obtained by hyperspectral sensors. In this paper, we investigate the performance of Polymer AC for hyperspectral remote sensing over coastal waters. Polymer is, in nature, a hyperspectral algorithm that has been mostly applied to multispectral satellite data to date. Polymer was applied to data from the Hyperspectral Imager for the Coastal Ocean (HICO), validated against in situ multispectral (AERONET-OC) and hyperspectral radiometric measurements, and its performance was compared against that of the hyperspectral version of NASA’s standard AC algorithm, L2gen. The match-up analysis demonstrated very good performance of Polymer in the green spectral region. The mean absolute percentage difference across all the visible bands varied between 16% (green spectral region) and 66% (red spectral region). Compared with L2gen, Polymer remote sensing reflectances presented lower uncertainties, greater data coverage, and higher spectral similarity to in situ measurements. These results demonstrate the potential of Polymer to perform AC on hyperspectral satellite data over coastal waters, thus supporting its application in current and future hyperspectral satellite missions.
The O2A (Observation to Archive) is a data-flow framework for heterogeneous sources, including multiple institutions and scales of Earth observation. In the O2A, once data transmission is set up, processes are executed to automatically ingest (i.e. collect and harmonize) and quality control data in near real-time. We consider a web-based sensor description application to support transmission and harmonization of observational time-series data. We also consider a product-oriented quality control, where a standardized and scalable approach should integrate the diversity of sensors connected to the framework. A review of literature and observation networks of marine and terrestrial environments is under construction to allow us, for example, to characterize quality tests in use for generic and specific applications. In addition, we use a standardized quality flag scheme to support both user and technical levels of information. In our outlook, a quality score should pair the quality flag to indicate the overall plausibility of each individual data value or to measure the flagging uncertainty. In this work, we present concepts under development and give insights into the data ingest and quality control currently operating within the O2A framework.
A common challenge for projects with multiple involved research institutes is a well-defined and productive collaboration. All parties measure and analyze different aspects, depend on each other, share common methods, and exchange the latest results, findings, and data. Today this exchange is often impeded by a lack of ready access to shared computing and storage resources. In our talk, we present a new and innovative remote procedure call (RPC) framework. We focus on a distributed setup, where project partners do not necessarily work at the same institute, and do not have access to each others resources.We present the prototype of an application programming interface (API) developed in Python that enables scientists to collaboratively explore and analyze sets of distributed data. It offers the functionality to request remote data through a comfortable interface, and to share and invoke single computational methods or even entire analytical workflows and their results. The prototype enables researchers to make their methods accessible as a backend module running on their own infrastructure. Hence researchers from other institutes may apply the available methods through a lightweight python or Javascript API. This API transforms standard python calls into requests to the backend process on the remote server. In the end, the overhead for both, the backend developer and the remote user, is very low. The effort of implementing the necessary workflow and API usage equalizes the writing of code in a non-distributed setup. Besides that, data do not have to be downloaded locally, the analysis can be executed “close to the data” while using the institutional infrastructure where the eligible data set is stored.With our prototype, we demonstrate distributed data access and analysis workflows across institutional borders to enable effective scientific collaboration, thus deepening our understanding of the Earth system.This framework has been developed in a joint effort of the DataHub and Digitial Earth initiatives within the Research Centers of the Helmholtz-Gemeinschaft Deutscher Forschungszentren e.V. (Helmholtz Association of German Research Centres, HGF).
CAComputing and Data Centre of the Alfred-Wegener-Institute
Computing and Data Centre of the Alfred-Wegener-Institute
+10
Earth system cyberinfrastructures include three types of data services: repositories, collections, and federations. These services arrange data by their purpose, level of integration, and governance. For instance, registered data of uniform measurements fulfill the goal of publication but do not necessarily flow in an integrated data system. The data repository provides the first and high level of integration that strongly depends on the standardization of incoming data. One example here is the framework Observation to Archive and Analysis (O2A) that is operational and continuously developed at the Alfred-Wegener-Institute, Bremerhaven. A data repository is one of the components of the O2A framework and much of its functionality depends on the standardization of the incoming data. In this context, we focus on the development of a modular approach to provide the standardization and quality control for the monitoring of the near real-time data. Two modules are under development. First, the driver module transforms different tabular data to a common format. Second, the quality control module that runs the quality tests on the ingested data. Both modules rely on the sensor operator and on the data scientist, two actors that interact with both ends of the ingest component of the O2A framework (http://data.awi.de/o2a-doc). We demonstrate the driver and the quality control modules in the data flow within Digital Earth showcases that also connect repositories and federated databases to the end-user. The end-user is the scientist, who works closely in the development approach to ensure applicability. The result is the proven benefit of harmonizing data and metadata of multiple sources, easy integration and rapid assessment of the ingested data. Further, we discuss concepts and current development that aim at the enhanced monitoring and scientific workflow.