30 August 2019 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
With the development of very high resolution satellite image acquisition technology, remote sensing scene classification has become an important and challenging task. In this article, aiming at tackling this task, we propose a hybrid architecture, i.e., aggregated deep Fisher feature (ADFF), which can make full use of deep convolutional features’ rich semantic information and unsupervised encoding's high robustness. Unlike the previous methods, we first explore the optimal encoding layer in the pretraining CNN model, which naturally fuses the local and global image information in a novel way, making the ability of semantic acquisition further enhanced. ADFF can learn more suitable internal features from the remote sensing data, boosting the final performance. We evaluate our algorithm based on several public datasets, and the results show that our approach achieves superior performance compared with the state-of-the-art methods. The proposed ADFF obtains average classification accuracy of 98.81%, 95.21%, 86.01%, and 88.79%, respectively, on the UC Merced Land-Use, RSSCN7, NWPU-RESISC45 (10% for training), and NWPU-RESISC45 (20% for training) datasets.
22 September 2021 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Remote sensing image scene classification is an important method for understanding the high-resolution remote sensing images. Based on Convolutional Neural Network, various classification methods have been applied into this field and achieved remarkable results. These methods mainly rely on the semantic information to improve the classification performance. However, as the network goes deeper, the highly abstract and global semantic information makes it difficult for the network to accurately classify scene images with similar layout and structures, limiting the further improvement of classification accuracy. Relying on the semantic information only is not sufficient to effectively classify these similar scene images and the network needs spatial information to enhance the classification capability. To solve this dilemma, this paper proposes a best representation branch model, which reaches the optimal balance point where the network can make use of both the semantic information and spatial information to improve the final classification accuracy. In the proposed method, ResNet50 pretrained on the ImageNet dataset is first divided into four branches with different depths to extract feature maps and Capsule Network is used as the classifier. The Grad-CAM algorithm is adopted to explain the mechanism of the optimal balance point from the perspective of attention and guide the further feature fusion. In addition, ablation studies are conducted to prove the effectiveness of our method and extensive experiments are conducted on three public benchmark remote sensing datasets. The results demonstrate that the proposed method can achieve competitive classification performance compared to the state-of-the-art methods.