Hyperspectral images (HSIs) contain rich spatial and spectral information about the earth, and are widely used in the remote sensing field. However, an HSI is frequently corrupted by various types of noise, such as Gaussian noise, sparse noise, stripe noise, and so on, which severely limits the subsequent application of the HSI. In this paper, we propose a graph Laplacian regularizer (GLR) to exploit the low-rank information across the bands of the HSI. Compared with the traditional low-rank regularization, our graph Laplacian regularization can achieve equivalent or better performance with less time consumption. Besides, a sparse constraint and a low-rank constraint are employed to remove the sparse and stripe noise. In addition, the augmented Lagrangian multiplier is used to solve each component to restore a clean image. Finally, we have carried out experiments on the simulated and real noisy HSI data. The results show the superiority of the proposed method over state-of-the-art methods, in terms of PSNR and SSIM, time cost and visual effect. The MATLAB code is available through: https://github.com/zzhang-99/FGLR.
Hyperspectral image (HSI) is easily corrupted by different kinds of noise, such as stripes, dead pixels, impulse noise, Gaussian noise, etc. Due to less consideration of the structural specificity of stripes, many existing HSI denoising methods cannot effectively remove the heavy stripes in mixed noise. In this paper, we classify the noise on HSI into three types: sparse noise, stripe noise, and Gaussian noise. The clean image and different types of noise are treated as independent components. In this way, the image denoising task can be naturally regarded as an image decomposition problem. Thanks to the structural characteristic of stripes and the low-rank property of HSI, we propose to destripe and denoise the HSI by using stripe and spectral low-rank matrix recovery and combine it with the global spatial-spectral TV regularization (SSLR-SSTV). By considering different properties of different HSI ingredients, the proposed method separates the original image from the noise components perfectly. Both simulation and real image denoising experiments demonstrate that the proposed method can achieve a satisfactory denoising result compared with the state-of-the-art methods. Especially, it outperforms the other methods in the task of stripe noise removal visually and quantitatively.
11 December 2015 in Journal of Mathematical Imaging and Vision
The joint use of hyperspectral image (HSI) and Light Detection And Ranging (LiDAR) data has been widely applied for land cover classification because it can comprehensively represent the urban structures and land material properties. However, existing methods fail to combine the different image information effectively, which limits the semantic relevance of different data sources. To solve this problem, in this paper, an Attention-guided Fusion and Classification framework based on Convolutional Neural Network (AFC-CNN) is proposed to classify the land cover based on the joint use of HSI and LiDAR data. In the feature extraction module, AFC-CNN employs the three dimensional convolutional neural network (3D-CNN) combined with a multi-scale structure to extract the spatial-spectral features of HSI, and uses a 2D-CNN to extract the spatial features from LiDAR data. Simultaneously, the spectral attention mechanism is adopted to assign weights to the spectral channels, and the cross attention mechanism is introduced to impart significant spatial weights from LiDAR to HSI, which enhance the interaction between HSI and LiDAR data and leverage the fusion information. Then two feature branches are concatenated and transferred to the feature fusion module for higher-level feature extraction and fusion. In the fusion module, AFC-CNN adopts the depth separable convolution connected through the residual structures to obtain the advanced features, which can help reduce computational complexity and improve the fitting ability of the model. Finally, the fused features are sent into the linear classification module for final classification. Experimental results on three datasets, i.e., Houston, MUUFL and Trento datasets show that the proposed AFC-CNN framework achieves better classification accuracy compared with the state-of-the-art algorithms. The overall accuracy of AFC-CNN on Houston, MUUFL and Trento datasets are 94.2%, 95.3% and 99.5%, respectively.
Point cloud registration is a crucial preprocessing step for point cloud data analysis and applications. Nowadays, many deep-learning-based methods have been proposed to improve the registration quality. These methods always use the sum of two cross-entropy as a loss function to train the model, which may lead to mismatching in overlapping regions. In this paper, we designed a new loss function based on the cross-entropy and applied it to the ROPNet point cloud registration model. Meanwhile, we improved the ROPNet by adding the channel attention mechanism to make the network focus on both global and local important information, thus improving the registration performance and reducing the point cloud registration error. We tested our method on ModelNet40 dataset, and the experimental results demonstrate the effectiveness of our proposed method.