3 March 2020 in IEEE Transactions on Image Processing
In contrast with nature scenes, aerial scenes are often composed of many objects crowdedly distributed on the surface in bird’s view, the description of which usually demands more discriminative features as well as local semantics. However, when applied to scene classification, most of the existing convolution neural networks (ConvNets) tend to depict global semantics of images, and the loss of low- and mid-level features can hardly be avoided, especially when the model goes deeper. To tackle these challenges, in this paper, we propose a multiple-instance densely-connected ConvNet (MIDC-Net) for aerial scene classification. It regards aerial scene classification as a multiple-instance learning problem so that local semantics can be further investigated. Our classification model consists of an instance-level classifier, a multiple instance pooling and followed by a bag-level classification layer. In the instance-level classifier, we propose a simplified dense connection structure to effectively preserve features from different levels. The extracted convolution features are further converted into instance feature vectors. Then, we propose a trainable attention-based multiple instance pooling. It highlights the local semantics relevant to the scene label and outputs the bag-level probability directly. Finally, with our bag-level classification layer, this multiple instance learning framework is under the direct supervision of bag labels. Experiments on three widely-utilized aerial scene benchmarks demonstrate that our proposed method outperforms many state-of-the-art methods by a large margin with much fewer parameters.
6 November 2019 in IEEE Geoscience and Remote Sensing Letters
Deep learning methods have boosted the performance of a series of visual tasks. However, the aerial image scene classification remains challenging. The object distribution and spatial arrangement in aerial scenes are often more complicated than in natural image scenes. Possible solutions include highlighting local semantics relevant to the scene label and preserving more discriminative features. To tackle this challenge, in this letter, we propose an attention pooling-based dense connected convolutional network (APDC-Net) for aerial scene classification. First, it uses a simplified dense connection structure as the backbone to preserve features from different levels. Then, we propose a trainable pooling to down-sample the feature maps and to enhance the local semantic representation capability. Finally, we introduce a multi-level supervision strategy, so that features from different levels are all allowed to supervise the training process directly. Exhaustive experiments on three aerial scene classification benchmarks demonstrate that our proposed APDC-Net outperforms other state-of-the-art methods with much fewer parameters and validate the effectiveness of our attention-based pooling and multi-level supervision strategy.
13 January 2020 in IEEE Transactions on Geoscience and Remote Sensing
The accuracy and efficiency of scene classification have immensely improved with the extensive application of deep convolutional neural networks (CNNs). However, standard CNNs classify images mostly based on the global features from the last fully connected layer, which may cause the negligence of discriminative local information and the sensitivity to various spatial transformations. In this article, we consider the problem of scene classification from the perspective of multiple instance learning (MIL) and propose an end-to-end multiple instance CNN (MI-CNN) for learning more robust scene representations. In MI-CNN, a scene is represented as a bag of local patches (instances). An instance-level classifier is trained to obtain the label of each patch in an MIL fashion, which makes the classifier more sensitive to the discriminative local patches. The patch labels are then aggregated into an image label by an MIL pooling layer, which is invariant to the order of local patches and helps construct more robust representations. We present extensive experiments on UC Merced Land use (UCM), Aerial Image data set (AID), and NWPU-RESISC (NWPU) data sets. Experimental results show that the proposed method achieves 1.17%, 1.70%, and 3.61% accuracy improvements with 90% parameter reduction compared with the standard CNNs.
21 April 2025 in International Journal of Geographical Information Science
5 December 2025 in Remote Sensing of Environment