22 September 2020 in IEEE Journal on Miniaturization for Air and Space Systems
The object detection in UAV application is a challenging task due to the diversity of target scales, variation of views and complex backgrounds. To solve several challenges, including dense objects, objects with arbitrary orientation and diversity of aspect ratios, this paper proposes an end-to-end object detection method based on the convolutional neural network. In this paper, the feature extraction performance is enhanced by utilizing a deep residual neural network. Multi-scale feature maps are obtained through fusion with different convolutional layers, thus combining the high-level semantic information and low-level detail information. Rotation Region Proposal Network is adopted to generate rotated regions, which makes the bounding box sensitive to dense objects in aerial images. Meanwhile, the RoIAlign is used and a convolution layer is appended in the classification stage. And Focal loss is used in the classification stage. The proposed method focuses on arbitrary-oriented and dense objects in UAV images. After a comprehensive evaluation with several state-of-the-art object detection algorithms, the proposed method is proved to be effective to detect multi-class artificial objects in aerial images. Extensive experiments are conducted on the DOTA, VEDAI and the VisDrone UAV image datasets, which demonstrate that the proposed method can obtain discriminative features through the improved multi-scale feature extraction and the rotating region network. The results on the above datasets show that our method obtains gains in mAP compared with several state-of-the-art methods.