How to enhance the spatial resolution for a remote sensing image is an important issue that we face. Many image super-resolution (SR) techniques have been proposed for this purpose and deep convolutional neural network (CNN) is the most effective approach in recent years. However, we observe that most CNN-based SR methods treat low-frequency areas and high-frequency areas equally, hence hindering the recovery of high-frequency information. In this paper, we propose a network named inception residual attention network (IRAN) to address this problem. Specifically, we propose a spatial attention module to make the network adaptively learn the importance of different spatial areas, so as to pay more attention to the areas with high-frequency information. Furthermore, we present an inception module to fuse local multilevel features, so as to provide richer information for reconstructing detailed textures. In order to evaluate the effectiveness of the proposed method, a large number of experiments are performed on UCMerced-LandUse data set and the results show that the proposed method is superior to the current state-of-the-art methods in both visual effects and objective indicators.
5 September 2022 in IEEE Transactions on Geoscience and Remote Sensing
Reconstructing a high-resolution hyperspectral image (HR-HSI) using a single low-resolution hyperspectral image (LR-HSI) is a significant technique for increasing the spatial resolution of HSIs and overcoming the physical limitation of the HSI sensor. Most single HSI super-resolution methods have achieved great success recently. However, owning to the difficulty of acquiring an HSI, the available training samples are relatively few, which will inevitably lead to relatively low performance. To address this issue, in this article, we propose a novel single HSI super-resolution method by combining a trainable grouped joint tensor dictionary and a low-rank prior (GJTD-LR). First, we design a trainable grouped joint tensor dictionary, which can build an accurate mapping relationship between training HR-HSIs and their corresponding LR-HSIs with relatively few training samples. To be specific, the training HR-HSI and LR-HSI pairs are decomposed into a joint tensor dictionary and a set of sparse coefficients using tensor–tensor product to fully preserve the spectral correlation. In addition, we apply a grouped strategy to divide the training images into several groups and learn a compact joint dictionary for each group. Second, a tensor low-rank model is forced into the reconstruction model to further capture the spatial correlation. Finally, GJTD-LR is optimized using alternating direction method of multipliers (ADMM), soft threshold algorithm, singular value decomposition, and Fourier domain transform. The experimental results on both remote sensed HSIs and indoor HSIs show the superiority of GJTD-LR to some other traditional and advanced single HSI super-resolution methods.
The small-sample problem that widely existed in the hyperspectral image (HSI) super-resolution task will lead to insufficient feature extraction in network training. Therefore, it is necessary to design an effective network to extract the feature of HSIs fully. In addition, existing HSI super-resolution (SR) networks usually capture multiple receptive fields by staking massive convolutions, which will inevitably produce many parameters. In this paper, we propose a novel HSI SR network based on the convolution neural network enhanced graph attention network (CEGATSR), which can fully capture different features by using a graph attention block (GAB) and a depthwise separable convolution block (DSCB). Moreover, the graph attention block can also capture different receptive fields by using relatively few layers. Specifically, we first divide the whole spectral bands into several groups and extract the features separately for each group to reduce the parameters. Second, we design a parallel feature extraction unit to extract non-local and local features by combining the graph attention block (GAB) and the depthwise separable convolution block (DSCB). The graph attention block makes full use of the non-local self-similarity strategy not only to self-learn the effective information but also to capture the multiple receptive fields by using relatively few parameters. The depthwise separable convolution block is designed to extract the local feature information with few parameters. Third, we design a spatial-channel attention block (SCAB) to capture the global spatial-spectral features and to distinguish the importance of different channels. A large number of experiments on three hyperspectral datasets show that the proposed CEGATSR performs better than the state-of-the-art SR methods. The source code is available at [Online]. Available: https://github.com/Dongyx1128/CEGATSR.
Image segmentation plays a key role in many fields such as image processing and recognition. Although various segmentation methods have been proposed in recent decades, most of these methods are based on only a single feature space. How to combine various features to image segmentation is a challenge problem. To address this problem, the authors propose to combine different features based on evolutionary multiobjective optimisation. Two optimisation objectives, which are based on colour and texture features, respectively, are therefore designed for image segmentation. The experiments show that the author's method is able to combine multiple features for image segmentation successfully.