While semisupervised methods based on graph convolutional networks (GCNs) can achieve good results in hyperspectral image (HSI) classification, their performance is limited as they rely only on spatial-spectral similarity when constructing local adjacency graphs. Moreover, relying on local adjacency graphs can limit the ability of the methods to ensure the consistency of global feature in complex hyperspectral remote sensing environments. Using the spatial-spectral information is typically not sufficient for providing a reliable similarity measurement to construct a global graph when the spectral variability is large and the spatial distance is long in intraclass pixels. To address this issue, this article presents a novel globally consistent GCN (GCGCN) for HSI classification. According to the proposed method, a local reliable initial graph is first built from inherent spatial-spectral information by considering this graph as a variable to optimize. Then, adaptive global high-order neighbors are explored to capture the underlying rich spatial contextual information by utilizing the graph topological consistent connectivity instead of the common strategy of using only the spatial-spectral similarity measurement. Finally, the adaptive global high-order graph structure and two-layer networks are combined to achieve the global feature smoothing of the same class samples and maintain high global feature consistency. The proposed GCGCN method is evaluated on three real HSI data sets to demonstrate its superiority compared to ten different classification methods. Moreover, the proposed GCGCN method achieves state-of-the-art classification results on three data sets in terms of four classification evaluation metrics, including overall accuracy (OA), kappa coefficient (KC), average accuracy (AA), and class accuracy (CA).
23 September 2021 in IEEE Transactions on Neural Networks and Learning Systems
In hyperspectral image (HSI) classification task, semisupervised graph convolutional network (GCN)-based methods have received increasing attention. However, two problems still need to be addressed. The first is that the initial graph structure in the GCN-based methods is not sufficiently flexible to encode the homogenous structure similarity of HSI pixels when facing the complex scenarios induced by the spatial variability. Another problem is that the input (graph structure) and output (output features) of the GCN-based methods are separated with a ``single pass'' procedure, which is a suboptimal problem for HSI classification because it does not flexibly optimize the graph construction with a feedback method via output features. In this article, a novel spatial-spectral unified adaptive probability GCN (SSAPGCN) method is proposed for HSI classification. First, considering the homogeneous structural similarity of the pairwise relationships of HSI pixels, this article combines the inherent spectral information and spatial coordinates to obtain the spatial-spectral adaptive probability graph (SSAPG) structure, which can capture the probabilistic connectivity between each pair of the homogeneous HSI pixels. Second, the SSAPG structure and GCN model are combined into a unified framework to a daptively learn both the graph structure and the output features simultaneously with feedback. Finally, the proposed SSAPGCN method with two layers is evaluated on four public HSI datasets to demonstrate its superiority over different classification methods in terms of two evaluation metrics, the overall accuracy (OA) and kappa coefficient (KC), especially with small training sample sizes.
7 November 2019 in IEEE Transactions on Geoscience and Remote Sensing
Generally, the apparent spectral information of hyperspectral images (HSIs) is directly used to measure the similarity among HSI pixels in the feature space, but this process cannot reveal the inherent characteristics of HSI pixels. Moreover, constructing spatial-spectral block-diagonal subspace structure representations of intraclass land-cover samples remains a challenge for low-rank representation (LRR) in HSI classification. In this article, we propose two methods to reveal the complex intrinsic spatial-spectral features of HSIs using block-diagonal subspace structures, namely, the spatial-spectral block-diagonal structure representation with class probability (SSBDCP) and spatial-spectral block-diagonal structure representation with fuzzy class probability (SSBDFCP) methods, for HSI classification. First, the SSBDFCP and SSBDCP methods explore the structure similarity characteristics of the latent subspace to form a block-diagonal LRR (BDLRR) of intraclass pixels with class probability and fuzzy class probability (FCP) and suppress the interclass pixels' representations. Then, the spatial information is considered in the proposed methods to enhance spatial-spectral graph expression and capture more comprehensive information. Note that SSBDFCP can perform better than SSBDCP because the FCP considers the “typicalness” that a sample belongs to a specific category and utilizes complex intrinsic discriminative information based on the feedback of “weakly” supervised information. Moreover, the feedback information can remove the noise features around the pixels and take advantage of the benefits of true neighbors. The experimental results for the Indian Pines and Pavia University data sets show that the SSBDFCP and SSBDCP methods achieve better HSI classification results than other popular graph construction methods.
25 July 2023 in IEEE Transactions on Geoscience and Remote Sensing
Hyperspectral image classification methods based on the graph convolutional network (GCN) have received more attention because they can handle irregular regions by graph encoding techniques. However, GCN-based HSI classification methods are highly sensitive to the quality of the graph structure. Its performance degrades in the case of underdeveloped graphs because it cannot excavate the intrinsic adjacency relationships. Thus, it is necessary to improve the quality of graph structure in GCN-based methods. In this paper, a novel diversity-connected graph convolutional network (DCGCN) method is proposed to improve the quality of the graph structure for HSI classification, and its basic idea can be adopted by other GCN-based methods. First, the potential neighbors are excavated by performing topological extensions based on the given graph. The diversity of surrounding neighbors is maintained by adaptively smoothing operation via a global threshold value from Kullback-Leibler divergence to eliminate weak interclass connections caused by weakly spectral variability. Second, another key connectivity restriction is imposed on the diverse neighbors to further refine the ambiguous connections of hard samples aiming at removing strong interclass connections where the spectral information is heavily confounded. Finally, the DCGCN method is analyzed theoretically to demonstrate its low-pass filter property. The comprehensive experiments demonstrate the effectiveness of the proposed DCGCN method and the basic idea of the diversity-connected graph in terms of overall accuracy (OA), kappa coefficient (KC), average accuracy (AA) indexes.
1 December 2021 in IEEE Transactions on Geoscience and Remote Sensing
Graph convolutional networks (GCNs) have been shown to be effective for hyperspectral image (HSI) classification due to their capacity to learn representations of spatial-spectral features. However, existing GCN based models heavily rely on predefined receptive fields to capture and aggregate neighbor information for each node, which limits the ability to adaptively selecting the most significant receptive field from graph data. To address the aforementioned problem, in this paper, we propose a novel dynamic adaptive sampling GCN (DAS-GCN) algorithm that captures neighbor information through adaptive sampling to allow the receptive field to be dynamically obtained. The basic underlying idea is that the most meaningful receptive field for each target node can be adaptively discovered, and the edge adjacency weights can be adjusted simultaneously after each adaptive sampling operation. Thus, we enable the graph to be dynamically updated and refined. Specifically, the adaptive sampling operation consists of two complementary components; in the first step, the importance of different remote nodes in a large-scale neighborhood is learned, while in the second step, rich underlying spatial-spectral information is extracted from local neighbors and filtered. The proposed model has the ability to learn how to extensively exploit spectral-spatial correlations from both local and remote nodes. Moreover, the proposed DAS-GCN model has a superior ability to leverage node feature information to naturally generalize and efficiently generate node embeddings for unseen data. Experimental results with overall accuracy on four real HSI data sets i.e., Indian Pines, Pavia university, Houston 2013, Salinas are 95.63%, 96.40%, 94.70%, 99.08%, respectively, which clearly demonstrate the advantages of the proposed method compared to other state-of-the-art approaches.