23 November 2021 in IEEE Transactions on Geoscience and Remote Sensing
Satellite video cameras can provide continuous observation for a large-scale area, which is important for many remote sensing applications. However, achieving moving object detection and tracking in satellite videos remains challenging due to the insufficient appearance information of objects and lack of high-quality datasets. In this paper, we first build a large-scale satellite video dataset with rich annotations for the task of moving object detection and tracking. This dataset is collected by the Jilin-1 satellite constellation and composed of 47 high-quality videos with 1,646,038 instances of interest for object detection and 3,711 trajectories for object tracking. We then introduce a motion modeling baseline to improve the detection rate and reduce false alarms based on accumulative multi-frame differencing and robust matrix completion. Finally, we establish the first public benchmark for moving object detection and tracking in satellite videos, and extensively evaluate the performance of several representative approaches on our dataset. Comprehensive experimental analyses and insightful conclusions are also provided. The dataset is available at https://github.com/QingyongHu/VISO.
15 October 2021 in IEEE Transactions on Geoscience and Remote Sensing
Ship detection in remote sensing images plays a crucial role in various applications and has drawn increasing attention in recent years. However, existing arbitrary-oriented ship detection methods are generally developed on a set of predefined rotated anchor boxes. These predefined boxes not only lead to inaccurate angle predictions but also introduce extra hyperparameters and high computational cost. Moreover, the prior knowledge of ship size has not been fully exploited by existing methods, which hinders the improvement of their detection accuracy. Aiming at solving the above issues, in this article, we propose a center-head point extraction-based detector (CHPDet) to achieve arbitrary-oriented ship detection in remote sensing images. Our CHPDet formulates arbitrary-oriented ships as rotated boxes with head points that are used to determine the direction. Also, a rotated Gaussian kernel is used to map the annotations into target heatmaps. Keypoint estimation is performed to find the center of ships. Then, the size and head point of the ships are regressed. The orientation-invariant model (OIM) is also used to produce orientation-invariant feature maps. Finally, we use the target size as prior to fine-tune the results. Moreover, we introduce a new dataset for multiclass arbitrary-oriented ship detection in remote sensing images at a fixed ground sample distance (GSD) that is named FGSD2021. Experimental results on FGSD2021 and two other widely used datasets, i.e., HRSC2016 and UCAS-AOD, demonstrate that our CHPDet achieves the state-of-the-art performance and can well distinguish between bow and stern. Code and FGSD2021 dataset are available at https://github.com/zf020114/CHPDet .
26 October 2021 in IEEE Geoscience and Remote Sensing Letters
Rotated object detection in aerial images has received increasing attention for a wide range of applications. However, it is also a challenging task due to the huge variations of scale, rotation, aspect ratio, and densely arranged targets. Most existing methods heavily rely on a large number of predefined anchors with different scales, angles, and aspect ratios, and are optimized with a distance loss. Therefore, these methods are sensitive to anchor hyperparameters and easily suffer from performance degradation caused by boundary discontinuity. To handle this problem, in this letter, we propose a dense anchor-free rotated object detector (DARDet) for rotated object detection in aerial images. Our DARDet directly predicts five parameters of rotated boxes at each foreground pixel of feature maps. We design a new alignment convolution module (ACM) to extract aligned features and introduce a pixels-intersection over union (PIoU) loss for precise and stable regression. Our method achieves state-of-the-art performance on three commonly used aerial objects datasets (i.e., DOTA, HRSC2016, and UCAS-AOD) while keeping high efficiency. Code is available at https://github.com/zf020114/DARDet .
17 July 2024 in IEEE Transactions on Geoscience and Remote Sensing
Recently, impressive improvements have been achieved in general object detection. However, tiny object detection remains a very challenging problem since tiny objects only occupy a few pixels. Consequently, the label assignment strategies used in general object detectors are not suitable for tiny object detection, because these algorithms tend to assign few or even no positive samples for tiny objects. In this article, we propose a simple yet effective Gaussian assignment (GA) strategy to solve this problem. Specifically, we first model the bounding boxes as 2-D Gaussian distributions and then encode training samples with a threshold. This strategy can assign more high-quality positive samples for tiny objects and adjust the weight of positive samples to balance the contribution from different-size objects. Extensive experiments on four tiny object detection datasets show that the proposed strategy significantly and consistently improves the performance of single-stage tiny object detectors. In particular, with our strategy, we bridge the performance gap between single-stage and state-of-the-art multistage detectors on the AI-TOD dataset (24.2% versus 24.8% in mAP) while maintaining the inference speed. The code is available at https://github.com/zf020114/GaussianAssignment .
15 November 2025 in Franklin Open