This paper presents a sparse-representation-based classification approach with a novel dictionary construction procedure. By using the constructed dictionary, sophisticated prior knowledge about the spatial nature of the image can be integrated. The approach is based on the assumption that each image patch can be factorized into characteristic spatial patterns, also called shapelets, and patch-specific spectral information. A set of shapelets is learned in an unsupervised way, and spectral information is embodied by training samples. A combination of shapelets and spectral information is represented in an undercomplete spatial-spectral dictionary for each individual patch, where the elements of the dictionary are linearly combined to a sparse representation of the patch. The patch-based classification is obtained by means of the representation error. Experiments are conducted on three well-known hyperspectral image data sets. They illustrate that our proposed approach shows superior results in comparison to sparse-representation-based classifiers that use only limited spatial information and behaves competitively with or better than state-of-the-art classifiers utilizing spatial information and kernelized sparse-representation-based classifiers.
1 October 2021 in Science of The Total Environment
Earth observation missions such as Sentinel and Landsat support the large-scale identification of agricultural crops by providing free radar and multispectral satellite images. The extraction of representative image information as well as the combination of different image sources for improved feature selection still represent a major challenge in the field of remote sensing. In this paper, we propose a novel three-dimensional (3D) deep learning U-Net model to fuse multi-level image features from multispectral and synthetic aperture radar (SAR) time series data for seasonal crop-type mapping at a regional scale. For this purpose, we used a dual-stream U-Net with a 3D squeeze-and-excitation fusion module applied at multiple stages in the network to progressively extract and combine multispectral and SAR image features. Additionally, we introduced a distinctive method for generating patch-based multitemporal multispectral composites by selective image sampling within a 14-day window, prioritizing those with minimal cloud cover. The classification results showed that the proposed network provided the best overall accuracy (94.5%) compared to conventional two-dimensional (2D) and three-dimensional U-Net models (2D: 92.6% and 3D: 94.2%). Our network successfully learned multi-modal dependencies between the multispectral and SAR satellite images, leading to improved field mapping of spectrally similar and heterogeneous classes while mitigating the limitations imposed by persistent cloud coverage. Additionally, the feature representations extracted by the proposed network demonstrated their transferability to a new cropping season, providing a reliable mapping of spatio-temporal crop type patterns.
20 March 2023 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
The documentation of historical remains and cultural heritage is of great importance to preserve historical knowledge. Many studies use low-resolution airplane-based laser scanning and manual interpretation for this purpose. In this study, a concept to automatically detect terrain anomalies in a historical conflict landscape using high-resolution UAV-LiDAR data was developed. We applied different ground filter algorithms and included a spline-based approximation step in order to improve the removal of low vegetation. Due to the absence of comprehensive labeled training data, a one-class support vector machine algorithm was used in an unsupervised manner in order to automatically detect the terrain anomalies. We applied our approach in a study site with different densities of low vegetation. The morphological ground filter was the most suitable when dense near-ground vegetation is present. However, with the use of the spline-based processing step, all filters used could be significantly improved in terms of the F1-score of the classification results. It increased by up to 42 percentage points in the area with dense low vegetation and by up to 14 percentage points in the area with sparse low vegetation. The completeness (recall) reached maximum values of 0.8 and 1.0, respectively, when taking into account the results leading to the highest F1-score for each filter. Therefore, our concept can support on-site field prospection.