While semisupervised methods based on graph convolutional networks (GCNs) can achieve good results in hyperspectral image (HSI) classification, their performance is limited as they rely only on spatial-spectral similarity when constructing local adjacency graphs. Moreover, relying on local adjacency graphs can limit the ability of the methods to ensure the consistency of global feature in complex hyperspectral remote sensing environments. Using the spatial-spectral information is typically not sufficient for providing a reliable similarity measurement to construct a global graph when the spectral variability is large and the spatial distance is long in intraclass pixels. To address this issue, this article presents a novel globally consistent GCN (GCGCN) for HSI classification. According to the proposed method, a local reliable initial graph is first built from inherent spatial-spectral information by considering this graph as a variable to optimize. Then, adaptive global high-order neighbors are explored to capture the underlying rich spatial contextual information by utilizing the graph topological consistent connectivity instead of the common strategy of using only the spatial-spectral similarity measurement. Finally, the adaptive global high-order graph structure and two-layer networks are combined to achieve the global feature smoothing of the same class samples and maintain high global feature consistency. The proposed GCGCN method is evaluated on three real HSI data sets to demonstrate its superiority compared to ten different classification methods. Moreover, the proposed GCGCN method achieves state-of-the-art classification results on three data sets in terms of four classification evaluation metrics, including overall accuracy (OA), kappa coefficient (KC), average accuracy (AA), and class accuracy (CA).
22 April 2020 in IEEE Geoscience and Remote Sensing Letters
Owing to the rapid development of deep neural networks, prominent advances have been recently achieved in the semantic segmentation of remote sensing images. As the vital components of computer vision, semantic segmentation, and edge detection have strong correlation whether in the extracted features or task objective. Prior studies treated edge detection as a postprocessing operation to semantic segmentation, or they implicitly combined the two tasks. We consider that pixels around the edges are easy to be misdivided because of the prevalence of intraclass inconsistencies and interclass indistinctions, which reflect the discriminative ability of models to distinguish different classes. In this letter, we propose a multipath atrous module to first enrich the deep semantic information. Then, we combine the enhanced deep semantic information and dilated edge information generated by canny and morphological operations to obtain edge-region maps via edge-region detection module, which identifies pixels around the edges. Then, we relearn these error-prone pixels using a guidance module for the segmentation branch in a progressive guided manner. Combined with edge and segmentation branches, our progressive edge guidance network achieves an overall accuracy of 91.0% on the ISPRS Vaihingen test set, which is the new state-of-the-art result.
22 August 2022 in IEEE Transactions on Geoscience and Remote Sensing
By reason of factors such as terrains, weather conditions, sensor imaging methods, and cultural and economic development, there is a large shift between the remote sensing imagery collected from different geographic locations and different sensors, which makes the state-of-the-art semantic segmentation models trained on source domain (an image set gathered from specific geographic locations and sensors) difficult to generalize to target domain (another image set collected from other geographic locations and sensors). Currently, unsupervised domain adaptation (UDA) using adversarial training, whose purpose is to align the marginal distribution in the output space between the source and target domains, is the most explored and practical approach to address this issue. However, this global alignment approach does not take into account diversities of different regions in a specific image nor the category-level distribution, which leads to the consequence that some regions and categories which are already well aligned between the source and target domains may be incorrectly remapped. Therefore, we propose a region and category adaptive domain discriminator (RCA-DD), aiming to emphasize the differences in regions and categories during the process of alignment. Specifically, on the one hand, we propose an entropy-based regional attention module (ERAM) in domain discriminator to emphasize the importance of difficult-to-align regions. On the other hand, we propose a class-clear module (CCM) to update only the distribution of existing categories in one iteration without affecting all categories. Finally, a lot of experiments are introduced to indicate that the proposed method can obtain better results when compared with other state-of-the-art UDA methods using adversarial training.
23 September 2021 in IEEE Transactions on Neural Networks and Learning Systems
In hyperspectral image (HSI) classification task, semisupervised graph convolutional network (GCN)-based methods have received increasing attention. However, two problems still need to be addressed. The first is that the initial graph structure in the GCN-based methods is not sufficiently flexible to encode the homogenous structure similarity of HSI pixels when facing the complex scenarios induced by the spatial variability. Another problem is that the input (graph structure) and output (output features) of the GCN-based methods are separated with a ``single pass'' procedure, which is a suboptimal problem for HSI classification because it does not flexibly optimize the graph construction with a feedback method via output features. In this article, a novel spatial-spectral unified adaptive probability GCN (SSAPGCN) method is proposed for HSI classification. First, considering the homogeneous structural similarity of the pairwise relationships of HSI pixels, this article combines the inherent spectral information and spatial coordinates to obtain the spatial-spectral adaptive probability graph (SSAPG) structure, which can capture the probabilistic connectivity between each pair of the homogeneous HSI pixels. Second, the SSAPG structure and GCN model are combined into a unified framework to a daptively learn both the graph structure and the output features simultaneously with feedback. Finally, the proposed SSAPGCN method with two layers is evaluated on four public HSI datasets to demonstrate its superiority over different classification methods in terms of two evaluation metrics, the overall accuracy (OA) and kappa coefficient (KC), especially with small training sample sizes.
14 September 2020 in IEEE Geoscience and Remote Sensing Letters
Semantic segmentation of small-scale objects in very high resolution (VHR) remote sensing images plays an important role in some special tasks, such as change detection and mapping of land cover. However, due to small size, small-scale objects are more likely to be completely obscured by shadows than large-scale objects, which make it difficult for the traditional convolutional neural network (CNN) to distinguish small-scale objects from shadows. Furthermore, even if small-scale objects are distinguished, their boundaries are still difficult to refine. To solve the above problems, a novel context union edge network (CEN) for small-scale objects semantic segmentation is proposed by comprehensively considering both the contextual and edge information. In CEN, a plug-and-play context-based feature enhancement module (CFEM) is designed to enhance the ability of CNNs to distinguish small-scale objects. Then, an information exchange mechanism (IEM) is proposed based on the dual-stream (semantic and edge stream) network to refine the boundaries of small-scale objects. Finally, some experiments based on the ISPRS Vaihingen data set are conducted in terms of both overall accuracy (OA) and F1-score. The proposed CEN achieves 89.9% of F1-score for small-scale objects (cars) and 90.9% of OA, harvesting new state-of-the-art results.