Convolutional neural network (CNN)-based hyperspectral image (HSI) classification models often exhibit high volume and complexity. This not only poses challenges in deploying them on mobile and embedded devices due to storage and power constraints but also introduces a dilemma between the growing demand for labeled samples and the high cost associated with manual labeling. To address these challenges, we propose an ultra-lightweight hybrid CNN based on redundancy removal (ULite-R2HCN), specifically designed for HSI classification in scenarios with limited samples. To reduce computational costs and enhance feature extraction effectiveness, we focus on optimizing the widely used depthwise convolution (DW-Conv) and pointwise convolution (PW-Conv) in the lightweight HSI classification model. For DW-Conv, we design a spatial convolution with redundancy removal (R2Spatial-Conv). This involves the design of multi-scale 3D convolution kernels with specific structures instead of 2D convolution kernels, aiming to reduce redundant convolution kernels and extract multi-scale spatial features. Simultaneously, for PW-Conv, we design a spectral convolution with redundancy removal (R2Spectral-Conv). This utilizes a “copy-splicing-grouping” structure to extract spectral features within arbitrary range intervals, effectively reducing redundant spectral extractions and capturing long-range spectral relationships. Numerous experiments have shown that the proposed ULite-R2HCN achieves higher classification accuracy with an ultra-light volume for a few training samples. In addition, sufficient ablation experiments also verified the advanced performance of the designed R2Spatial-Conv and R2Spectral-Conv.

Traditional two-dimensional Otsu algorithm has several drawbacks; that is, the sum of probabilities of target and background is approximate to 1 inaccurately, the details of neighborhood image are not obvious, and the computational cost is high. In order to address these problems, a method of fast image segmentation using two-dimensional Otsu based on estimation of distribution algorithm is proposed. Firstly, in order to enhance the performance of image segmentation, the guided filtering is employed to improve neighborhood image template instead of mean filtering. Additionally, the probabilities of target and background in two-dimensional histogram are exactly calculated to get more accurate threshold. Finally, the trace of the interclass dispersion matrix is taken as the fitness function of estimation of distributed algorithm, and the optimal threshold is obtained by constructing and sampling the probability model. Extensive experimental results demonstrate that our method can effectively preserve details of the target, improve the segmentation precision, and reduce the running time of algorithms.

Recent studies have demonstrated the potential of hybrid convolutional models that combine 3D and 2D convolutional neural networks (CNNs) for hyperspectral image (HSI) classification. However, these models do not fully utilize the benefits of hybrid convolution due to inefficient connections between the two types of CNNs. Moreover, most CNNs, including hybrid models, require a significant number of parameters and computational resources for accurate classification, which increases the need for labeled samples and computational cost. Although the common lightweight strategies like depthwise separable convolution (DSC) can reduce parameters and computation compared to normal convolution (NC), they often compromise accuracy. To address these challenges, we propose a lightweight hybrid convolutional neural network (Lite-HCNet) for HSI classification with minimal model parameters and computational effort. Firstly, we design a novel channel attention module (NCAM) and combine it with a convolutional kernel decomposition (CKD) strategy to propose a lightweight and efficient DSC (LE-DSC) deployed in Lite-HCNet. The LE-DSC not only reduces the DSC volume further but also enhances its performance. Secondly, a lightweight and efficient hybrid convolutional layer (LE-HCL) is designed in Lite-HCNet to explore the efficient connection structure between 3D CNNs and 2D CNNs. Experiments show that the Lite-HCNet reduces the required computational cost and practical deployment difficulty while offering advanced performance with a small number of training samples. Furthermore, abundant ablation experiments confirm the superior performance of the designed LE-DSC.

The joint classification of hyperspectral image (HSI) and LiDAR data has attracted considerable attention in the field of remote sensing. Integrating the advantages of the two data sources can provide precise data support and analytical decision-making for remote sensing applications. However, due to the inherent differences in properties and semantic information from heterogeneous data, most existing deep learning methods suboptimally extract the characteristic features of both data sources while utilizing their interactive information. In this paper, we propose a Dual-branch Feature Fusion Network based Cross-modal Enhanced CNN and Transformer (DF ² NCECT) to make full use of the respective features and interactive information of multi-source data. DF ² NCECT consists of two main stages. One is basic feature extraction stage, which builds a hybrid convolution module based on 3DCNN and inception structure to fully extract the joint features of HSI from multiple spatial perspectives. The other is deep feature fusion stage, where CNN and Transformer are designed in parallel to fully explore and fuse deep features between HSI and LiDAR. More importantly, to achieve the efficacious interactive information between HSI and LiDAR, a cross-modal enhanced CNN and Transformer module is designed to deeply enhance the fused interactive features from global/local perspectives. Experiments show that the proposed method is superior, outperforms the comparison methods by an average of 3.06% in OA on Houston2013 and 1.79% on Summer, respectively.

In recent years, convolutional neural networks (CNNs) have been widely used in hyperspectral images (HSIs) classification. However, 2-D CNN, 3-D CNN, and even the newly emerged hybrid CNN (HCNN) all require multiple or deep CNN layers to obtain excellent classification performance, which inevitably results in the high complexity and the need for a large number of training samples. Moreover, as a local operator, convolution is challenging to fully use global information. To solve the above two issues, we design a HCNN based on global reasoning (GloRe-HCNN) for HSI classification. On the one hand, the GloRe-HCNN uses only one layer of 3-D CNN and one layer of 2-D CNN to jointly extract the spatial–spectral features of HSI. On the other hand, we contrive a spatial–spectral global reasoning unit (SS-GloRe-Unit) to take the place of stacked multilayer 3-D CNN for extracting global features fully. We select small training samples in three standard datasets and compare them with state-of-the-art CNN methods. Numerous experiments show that our GloRe-HCNN performs advanced performance.