Object detection in remote sensing is becoming a conspicuous challenge with the rapidly increasing quantity and quality of remote sensing images. Although the application of Deep Learning has obtained remarkable performance in Computer Vision, detecting multi-scale targets in remote sensing images is still an unsolved problem, especially for small instances which possess limited features and intricate backgrounds. In this work, we managed to cope with this problem by designing a neck attention block (NAB), a simple and flexible module which combines the convolutional bottleneck structure and the attention mechanism, different from traditional attention mechanisms that focus on designing complicated attention branches. In addition, Vehicle in High-Resolution Aerial Imagery (VHRAI), a diverse, dense, and challenging dataset, was proposed for studying small object detection. To validate the effectiveness and generalization of NAB, we conducted experiments on a variety of datasets with the improved YOLOv3, YOLOv4-Tiny, and SSD. On VHRAI, the improved YOLOv3 and YOLOv4-Tiny surpassed the original models by 1.98% and 1.89% mAP, respectively. Similarly, they exceeded the original models by 1.12% and 3.72% mAP on TGRS-HRRSD, a large multi-scale dataset. Including SSD, these three models also showed excellent generalizability on PASCAL VOC.
Object detection is a basic and important task in the field of aerial image processing and has gained much attention in computer vision. However, previous aerial image object-detection approaches have insufficient use of scene semantic information between different regions of large-scale aerial images. In addition, complex background and scale changes make it difficult to improve detection accuracy. To address these issues, we propose a relationship representation network for object detection in aerial images (RelationRS): (1) Firstly, multi-scale features are fused and enhanced by a dual relationship module (DRM) with conditional convolution. The dual relationship module learns the potential relationship between features of different scales and learns the relationship between different scenes from different patches in a same iteration. In addition, the dual relationship module dynamically generates parameters to guide the fusion of multi-scale features. (2) Secondly, the bridging visual representations module (BVR) is introduced into the field of aerial images to improve the object detection effect in images with complex backgrounds. Experiments with a publicly available object detection dataset for aerial images demonstrate that the proposed RelationRS achieves a state-of-the-art detection performance.
During long-range imaging, the turbid medium in the atmosphere absorbs and scatters light, resulting in reduced contrast, a narrowed dynamic range, and obscure detail information in remote sensing images. The prior-based method has the advantages of good real-time performance and a wide application range. However, few of the existing prior-based methods are applicable to the dehazing of panchromatic images. In this paper, we innovatively propose a prior-based dehazing method for panchromatic remote sensing images through statistical histogram features. First, the hazy image is divided into plain image patches and mixed image patches according to the histogram features. Then, the features of the average occurrence differences between adjacent gray levels (AODAGs) of plain image patches and the features of the average distance to the gray-level gravity center (ADGG) of mixed image patches are, respectively, calculated. Then, the transmission map is obtained according to the statistical relation equation. Then, the atmospheric light of each image patch is calculated separately based on the maximum gray level of the image patch using the threshold segmentation method. Finally, the dehazed image is obtained based on the physical model. Extensive experiments in synthetic and real-world panchromatic hazy remote sensing images show that the proposed algorithm outperforms state-of-the-art dehazing methods in both efficiency and dehazing effect.
Optical remote sensing images are easily affected by atmospheric absorption and scattering, and the low contrast and low signal-to-noise ratio (SNR) of aerial images as well as the different sensors of aerial and satellite images bring a great challenge to image matching. A tilted aerial image and satellite image matching algorithm based on edge curve direction angle features (ECDAF) is proposed, which accomplishes image matching by extracting the edge features of the images and establishing the curve direction angle feature descriptors. First, tilt and resolution transforms are performed on the satellite image, and edge detection and contour extraction are performed on the aerial image and transformed satellite image to make preparations for image matching. Then, corner points are detected and feature descriptors are constructed based on the edge curve direction angle. Finally, the integrated matching similarity is computed to realize aerial–satellite image matching. Experiments run on a variety of remote sensing datasets including forests, hills, farmland, and lake scenes demonstrate that the effectiveness of the proposed algorithm shows a great improvement over existing state-of-the-art algorithms.
Anomaly detection is hampered by band redundancy and the restricted reconstruction ability of spectral–spatial information in hyperspectral remote sensing. A novel hyperspectral anomaly detection method integrating differential attribute profiles and genetic algorithms (DAPGA) is proposed to sufficiently extract the spectral–spatial features and automatically optimize the selection of the optimal features. First, a band selection method with cross-subspace combination is employed to decrease the spectral dimension and choose representative bands with rich information and weak correlation. Then, the differentials of attribute profiles are calculated by four attribute types and various filter parameters for multi-scale and multi-type spectral–spatial feature decomposition. Finally, the ideal discriminative characteristics are reserved and incorporated with genetic algorithms to cluster each differential attribute profile by dissimilarity assessment. Experiments run on a variety of genuine hyperspectral datasets including airport, beach, urban, and park scenes show that the effectiveness of the proposed algorithm has great improvement with existing state-of-the-art algorithms.