This article presents the multimodal BigEarthNet (BigEarthNet-MM) benchmark archive consisting of 590,326 pairs of Sentinel-1 and Sentinel-2 image patches to support deep learning (DL) studies in multimodal, multilabel remote sensing (RS) image retrieval and classification. Each pair of patches in BigEarthNet-MM is annotated with multilabels provided by the CORINE Land Cover (CLC) map of 2018 based on its thematically most detailed level-3 class nomenclature. Our initial research demonstrates that some CLC classes are challenging to accurately describe by considering only (single-date) BigEarthNet-MM images. In this article, we also introduce an alternative class nomenclature as an evolution of the original CLC labels to address this problem. This is achieved by interpreting and arranging the CLC level-3 nomenclature based on the properties of BigEarthNet-MM images in a new nomenclature of 19 classes. In our experiments, we show the potential of BigEarthNet-MM for multimodal, multilabel image retrieval and classification problems by considering several state-of-the-art DL models.
Spatial records of species are commonly misidentified, which can change the predicted distribution of a species obtained from a species distribution model (SDM). Experiments were undertaken to predict the distribution of real and simulated species using MaxEnt and presence-only data “contaminated” with varying rates of misidentification error. Additionally, the difference between the niche of the target and contaminating species was varied. The results show that species misidentification errors may act to contract or expand the predicted distribution of a species while shifting the predicted distribution towards that of the contaminating species. Furthermore the magnitude of the effects was positively related to the ecological distance between the species’ niches and the size of the error rates. Critically, the magnitude of the effects was substantial even when using small error rates, smaller than common average rates reported in the literature, which may go unnoticed while using a standard evaluation method, such as the area under the receiver operating characteristic curve. Finally, the effects outlined were shown to impact negatively on practical applications that use SDMs to identify priority areas, commonly selected for various purposes such as management. The results highlight that species misidentification should not be neglected in species distribution modeling.
Portugal is building a land cover monitoring system to deliver land cover products annually for its mainland territory. This paper presents the methodology developed to produce a prototype relative to 2018 as the first land cover map of the future annual map series (COSsim). A total of thirteen land cover classes are represented, including the most important tree species in Portugal. The mapping approach developed includes two levels of spatial stratification based on landscape dynamics. Strata are analysed independently at the higher level, while nested sublevels can share data and procedures. Multiple stages of analysis are implemented in which subsequent stages improve the outputs of precedent stages. The goal is to adjust mapping to the local landscape and tackle specific problems or divide complex mapping tasks in several parts. Supervised classification of Sentinel-2 time series and post-classification analysis with expert knowledge were performed throughout four stages. The overall accuracy of the map is estimated at 81.3% (±2.1) at the 95% confidence level. Higher thematic accuracy was achieved in southern Portugal, and expert knowledge significantly improved the quality of the map.
Tree species classification with satellite data has become more and more popular since Sentinel-2 launch. We compared efficacy and effectiveness of Extreme Gradient Boosting (XGBoost) and Light Gradient Boosting Machine (LGBM) with widely used in remote sensing Random Forest (RF), Support Vector Machine (SVM) and K-Nearest Neighbour (KNN) algorithms. Analyses were performed over an area in Portugal with multi-temporal Sentinel-2 data registered in April, June, August and October 2018. The selected classes were: cork oak, holm oak, eucalyptus, other broadleaved, maritime pine, stone pine and other coniferous. Algorithm efficacy was measured through F1-score and accuracy while efficiency was measured through the median time needed for each fit. XGBoost and LGBM outperformed efficacy of other algorithms, which was already high (above 90% for the best variant of each algorithm). In terms of efficacy, LGBM overcame all algorithms, including XGBoost.