Quantifying how close two datasets are to each other is a common and necessary undertaking in scientific research. The Pearson product-moment correlation coefficient r is a widely used measure of the degree of linear dependence between two data series, but it gives no indication of how similar the values of these series are in magnitude. Although a number of indexes have been proposed to compare a dataset with a reference, only few are available to compare two datasets of equivalent (or unknown) reliability. After a brief review and numerical tests of the metrics designed to accomplish this task, this paper shows how an index proposed by Mielke can, with a minor modification, satisfy a series of desired properties, namely to be adimensional, bounded, symmetric, easy to compute and directly interpretable with respect to r. We thus show that this index can be considered as a natural extension to r that downregulates the value of r according to the bias between analysed datasets. The paper also proposes an effective way to disentangle the systematic and the unsystematic contribution to this agreement based on eigen decompositions. The use and value of the index is also illustrated on synthetic and real datasets.
For food crises early warning purposes, coarse spatial resolution NDVI data are widely used to monitor vegetation conditions in near real-time (NRT). Different types of NDVI anomalies are typically employed to assess the current state of crops and rangelands as compared to previous years. Timeliness and accuracy of such anomalies are critical factors to an effective monitoring. Temporal smoothing can efficiently reduce noise and cloud contamination in the time series of historical observations, where data points are available before and after each observation to be smoothed. With NRT data, smoothing methods are adapted to cope with the unbalanced availability of data before and after the most recent data points. These NRT approaches provide successive updates of the estimation of the same data point as more observations become available. Anomalies compare the current NDVI value with some statistics (e.g. indicators of central tendency and dispersion) extracted from the historical archive of observations. With multiple updates of the same datasets being available, two options can be selected to compute anomalies, i.e. using the same update level for the NRT data and the statistics or using the most reliable update for the latter. In this study we assess the accuracy of three commonly employed 1 km MODIS NDVI anomalies (standard scores, non-exceedance probability and vegetation condition index) with respect to (1) delay with which they become available and (2) option selected for their computation. We show that a large estimation error affects the earlier estimates and that this error is efficiently reduced in subsequent updates. In addition, with regards to the preferable option to compute anomalies, we empirically observe that it depends on the type of application (e.g. averaging anomalies value over an area of interest vs. detecting “drought” conditions by setting a threshold on the anomaly value) and the employed anomaly type. Finally, we map the spatial pattern in the magnitude of NRT anomaly estimation errors over the globe and relate it to average cloudiness.
1 June 2011 in International Journal of Geographical Information Science
Geographic object-based image analysis is an image-processing method where groups of spatially adjacent pixels are classified as if they were behaving as a whole unit. This approach raises concerns about the way subsequent validation studies must be conducted. Indeed, classical point-based sampling strategies based on the spatial distribution of sample points (using systematic, probabilistic or stratified probabilistic sampling) do not rely on the same concept of objects and may prove to be less appropriate than the methods explicitly built on the concept of objects used for the classification step. In this study, an original object-based sampling strategy is compared with other approaches used in the literature for the thematic accuracy assessment of object-based classifications. The new sampling scheme and sample analysis are founded on a sound theoretical framework based on few working hypotheses. The performance of the sampling strategies is quantified using simulated object-based classifications results of a Quickbird imagery. The bias and the variance of the overall accuracy estimates were used as indicators of the method's benefits. The main advantage of the object-based predictor of the overall accuracy is its performance: for a given confidence interval, it requires fewer sampling units than the other methods. In many cases, this can help to noticeably reduce the sampling effort. Beyond the efficiency, more conceptual differences between point-based and object-based samplings are discussed. First, geolocation errors do not influence the object-based thematic accuracy as they do for point-based accuracy. These errors need to be addressed independently to provide the geolocation precision. Second, the response design is more complex in object-based accuracy assessment. This is interesting for complex classes but might be an issue in case of large segmentation errors. Finally, there is a larger likelihood to reach the minimum sample size for each class with an object-based sampling than in a point-based sampling. Further work is necessary to reach the same suitability than point-based sampling for pixel-based classification, but this pioneer study shows that object-based sampling could be implemented within a statistically sound framework.
The availability of large amounts of Sentinel-2 data has been a trigger for its increasing exploitation in various types of applications. It is, therefore, of importance to understand the limits above which these data still guarantee a meaningful outcome. This paper proposes a new method to quantify and specify restrictions of the Sentinel-2 imagery in the context of checks by monitoring, a newly introduced control approach within the European Common Agriculture Policy framework. The method consists of a comparison of normalized difference vegetation index (NDVI) time series constructed from data of different spatial resolution to estimate the performance and limits of the coarser one. Using similarity assessment of Sentinel-2 (10 m pixel size) and PlanetScope (3 m pixel size) NDVI time series, it was estimated that for 10% out of 867 fields less than 0.5 ha in size, Sentinel-2 data did not provide reliable evidence of the activity or state of the agriculture field over a given timeframe. Statistical analysis revealed that the number of clean or full pixels and the proportion of pixels lost after an application of a 5-m (1/2 pixel) negative buffer are the geospatial parameters of the field that have the highest influence on the ability of the Sentinel-2 data to qualify the field’s state in time. We specified the following limiting criteria: at least 8 full pixels inside a border and less than 60% of pixels lost. It was concluded that compliance with the criteria still assures a high level of extracted information reliability. Our research proved the promising potential, which was higher than anticipated, of Sentinel-2 data for the continuous state assessment of small fields. The method could be applied to other sensors and indicators.
8 November 2006 in Stochastic Environmental Research and Risk Assessment