Hyperspectral image (HSI) clustering is a challenging task due to the high complexity of HSI data. Subspace clustering has been proven to be powerful for exploiting the intrinsic relationship between data points. Despite the impressive performance in the HSI clustering, traditional subspace clustering methods often ignore the inherent structural information among data. In this article, we revisit the subspace clustering with graph convolution and present a novel subspace clustering framework called graph convolutional subspace clustering (GCSC) for robust HSI clustering. Specifically, the framework recasts the self-expressiveness property of the data into the non-Euclidean domain, which results in a more robust graph embedding dictionary. We show that traditional subspace clustering models are the special forms of our framework with the Euclidean data. On the basis of the framework, we further propose two novel subspace clustering models by using the Frobenius norm, namely efficient GCSC (EGCSC) and efficient kernel GCSC (EKGCSC). Each model has a globally optimal closed-form solution, making it easier to implement, train, and apply in practice. Extensive experiments strongly evidence that EGCSC and EKGCSC dramatically outperform current models on three popular HSI data sets consistently.
1 June 2022 in IEEE Transactions on Geoscience and Remote Sensing
Deep subspace clustering (DSC) has achieved remarkable performances in the unsupervised classification of hyperspectral images. However, previous models based on pixel-level self-expressiveness of data suffer from the exponential growth of computational complexity and access memory requirements with an increasing number of samples, thus leading to poor applicability to large hyperspectral images. This article presents a neighborhood contrastive subspace clustering (NCSC) network, a scalable and robust DSC approach, for unsupervised classification of large hyperspectral images. Instead of using a conventional autoencoder, we devise a novel superpixel pooling autoencoder to learn the superpixel-level latent representation and subspace, allowing a contracted self-expressive layer. To encourage a robust subspace representation, we propose a novel neighborhood contrastive regularization to maximize the agreement between positive samples in subspace. We jointly train the resulting model in an end-to-end fashion by optimizing an adaptively weighted multitask loss. Extensive experiments on three hyperspectral benchmarks demonstrate the effectiveness of the proposed approach and its substantial advancement of state-of-the-art approaches.
20 August 2020 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Hyperspectral image (HSI) band selection (BS) is an important task for HSI dimensionality reduction, whose goal is to select an informative band subset containing less redundancy. However, traditional BS methods basically work in the Euclidean domain and thus often neglect to consider the structural information of spectral bands. In this paper, to make full use of the structural information, a novel BS method termed as Efficient Graph Convolutional Self-Representation (EGCSR) is proposed by incorporating graph convolution into the self-representation model. Since the proposed method is typically modeled in the non-Euclidean domain, it tends to result in a more robust self-representation coefficient matrix. We provide a closed-form solution to the EGCSR model, which leads to high computational efficiency. We further propose two strategies to determine the informative band subset from the coefficient matrix. The first is a ranking-based strategy (EGCSR-R), which ranks every band by calculating the cumulative contribution, and the second is a clustering-based strategy (EGCSR-C), which treats band selection as a band clustering task based on using subspace segmentation. Extensive experimental results on three real HSI data sets show that the proposed EGCSR model is dramatically superior to many existing band selection methods and with high computational efficiency.
6 May 2024 in IEEE Transactions on Neural Networks and Learning Systems
The joint clustering of multimodal remote sensing (RS) data poses a critical and challenging task in Earth observation. Although recent advances in multiview subspace clustering have shown remarkable success, existing methods become computationally prohibitive when dealing with large-scale RS datasets. Moreover, they neglect intrinsic nonlinear and spatial interdependencies among heterogeneous RS data and lack generalization ability for out-of-sample data, thereby restricting their applicability. This article introduces a novel unified framework called anchor-based multiview kernel subspace clustering with spatial regularization (AMKSC). It learns a scalable anchor graph in the kernel space, leveraging contributions from each modality instead of seeking a consensus full graph in the feature space. To ensure spatial consistency, we incorporate a spatial smoothing operation into the formulation. The method is efficiently solved using an alternating optimization strategy, and we provide theoretical evidence of its scalability with linear computational complexity. Furthermore, an out-of-sample extension of AMKSC based on multiview collaborative representation-based classification is introduced, enabling the handling of larger datasets and unseen instances. Extensive experiments on three real heterogeneous RS datasets confirm the superiority of our proposed approach over state-of-the-art methods in terms of clustering performance and time efficiency. The source code is available at https://github.com/AngryCai/AMKSC.
5 February 2021 in IEEE Geoscience and Remote Sensing Letters
Deep neural networks have gained increasing interest in hyperspectral image (HSI) processing. However, prior arts often neglect the high-order correlation among data points, failing to capture intraclass variations. In this letter, we present a unified neural network framework, termed as hypergraph-structured autoencoder (HyperAE), to leverage the high-order relationship among data and learn robust deep representation for downstream tasks. Technically, the proposed method adopts a deep autoencoder regularized by hypergraph structure as the backbone network, which is jointly trained with a task-specific branch, resulting in a multitask architecture. We separately combine the subspace clustering model and the softmax classifier into the HyperAE to deal with HSI unsupervised and semisupervised classification problems. Benefiting from the hypergraph, HyperAE endows traditional networks with the capacity of preserving the high-order structured information. We evaluate the proposed methods on three benchmarking HSI data sets, demonstrating that the proposed HyperAE dramatically outperforms many existing methods with significant margins in both unsupervised and semisupervised HSI classification problems.
9 November 2022 in Expert Systems with Applications