At present, deep learning has been widely used in SAR ship target detection, but the accurate and real-time detection of multi-scale targets still faces tough challenges. CNN-based SAR ship detectors are challenged to meet real-time requirements because of a large number of parameters. In this paper, we propose a lightweight, single-stage SAR ship target detection model called YOLO-based lightweight multi-scale ship detector (LMSD-YOLO), with better multi-scale adaptation capabilities. The proposed LMSD-YOLO consists of depthwise separable convolution, batch normalization and activate or not (ACON) activation function (DBA) module, Mobilenet with stem block (S-Mobilenet) backbone module, depthwise adaptively spatial feature fusion (DSASFF) neck module and SCYLLA-IoU (SIoU) loss function. Firstly, the DBA module is proposed as a general lightweight convolution unit to construct the whole lightweight model. Secondly, the improved S-Mobilenet module is designed as the backbone feature extraction network to enhance feature extraction ability without adding additional calculations. Then, the DSASFF module is proposed to achieve adaptive fusion of multi-scale features with fewer parameters. Finally, the SIoU is used as the loss function to accelerate model convergence and improve detection accuracy. The effectiveness of the LMSD-YOLO is validated on the SSDD, HRSID and GFSDD datasets, respectively, and the experimental results show that our proposed model has a smaller model volume and higher detection accuracy, and can accurately detect multi-scale targets in more complex scenes. The model volume of LMSD-YOLO is only 7.6MB (52.77% of model size of YOLOv5s), the detection speed on the NVIDIA AGX Xavier development board reached 68.3 FPS (32.7 FPS higher than YOLOv5s detector), indicating that the LMSD-YOLO can be easily deployed to the mobile platform for real-time application.
7 December 2020 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
The deployment of deep convolutional neural networks (CNNs) in SAR ship real-time detection is largely hindered by huge computational cost. In this paper, we propose a novel learning scheme for training a lightweight ship detector called Tiny YOLO-Lite, which simultaneously 1) reduces the model storage size; 2) decreases the floating point operations (FLOPs) calculation; 3) guarantees the high accuracy with faster speed. This is achieved by self-designed backbone structure and network pruning, which enforces channel-level sparsity in the backbone network and yields a compact model. In addition, knowledge distillation is also applied to make up for the performance decline caused by network pruning. Hereinto, we propose to let small student model mimic cumbersome teacher's output to achieve improved generalization. Rather than applying vanilla full feature imitation, we redefine the distilled knowledge as the inter-relationship between different levels of feature maps and then transfer it from the large network to a smaller one. On account that the detectors should focus more on the salient regions containing ships while background interference is overwhelming, a novel attention mechanism is attached to the distilled feature for enhanced representation. Finally, extensive experiments are conducted on SSDD, HRSID and two large-scene SAR images to verify the effectiveness ofthe thinner SAR ship object detector in comparison of with other CNN-based algorithms. The detection results demonstrate that the proposed detector can achieve lighter architecture with 2.8M model size, more efficient inference (>200fps) with low computation cost, and more accurate prediction with knowledge transfer strategy.
Geospatial object detection from high spatial resolution (HSR) remote sensing imagery is a heated and challenging problem in the field of automatic image interpretation. Despite convolutional neural networks (CNNs) having facilitated the development in this domain, the computation efficiency under real-time application and the accurate positioning on relatively small objects in HSR images are two noticeable obstacles which have largely restricted the performance of detection methods. To tackle the above issues, we first introduce semantic segmentation-aware CNN features to activate the detection feature maps from the lowest level layer. In conjunction with this segmentation branch, another module which consists of several global activation blocks is proposed to enrich the semantic information of feature maps from higher level layers. Then, these two parts are integrated and deployed into the original single shot detection framework. Finally, we use the modified multi-scale feature maps with enriched semantics and multi-task training strategy to achieve end-to-end detection with high efficiency. Extensive experiments and comprehensive evaluations on a publicly available 10-class object detection dataset have demonstrated the superiority of the presented method.
In recent years, deep learning has made breakthroughs in the field of computer vision, the single-stage detection algorithm represented by You Only Look Once (YOLO) has achieved satisfying detection results in SAR ship target detection. For the multi-scale problem of SAR ship targets in complex scenes, we proposed an improved YOLOv5 detection method using Convolutional Block Attention Module (CBAM) and Bidirectional Feature Pyramid Network (BiFPN). The CBAM module and BiFPN are added in YOLOv5 so that it can fully learn the feature information of space and channel dimensions, and enhance information fusion transfer between multi-scale targets. Experiments on our dataset show that the proposed YOLOv5 algorithm achieves 92.8% Average Precision (AP), which gains a 1.9% improvement in AP compared to the standard YOLOv5 algorithm in SAR ship target detection. The problem of missed detection of multi-scale targets is well solved.
Recently, convolutional neural network (CNN)-based methods have been extensively explored for ship detection in synthetic aperture radar (SAR) images due to their powerful feature representation abilities. However, there are still several obstacles hindering the development. First, ships appear in various scenarios, which makes it difficult to exclude the disruption of the cluttered background. Second, it becomes more complicated to precisely locate the targets with large aspect ratios, arbitrary orientations and dense distributions. Third, the trade-off between accurate localization and improved detection efficiency needs to be considered. To address these issues, this paper presents a rotate refined feature alignment detector (R FA-Det), which ingeniously balances the quality of bounding box prediction and the high speed of the single-stage framework. Specifically, first, we devise a lightweight non-local attention module and embed it into the stem network. The recalibration of features not only strengthens the object-related features yet adequately suppresses the background interference. In addition, both forms of anchors are integrated into our modified anchor mechanism and thus can enable better representation of densely arranged targets with less computation burden. Furthermore, considering the shortcoming of the feature misalignment existing in the cascaded refinement scheme, a feature-guided alignment module which encodes both the position and shape information of current refined anchors into the feature points is adopted. Extensive experimental validations on two SAR ship datasets are performed and the results demonstrate that our algorithm has higher accuracy with faster speed than some state-of-the-art methods.
2 May 2022 in IEEE Geoscience and Remote Sensing Letters
Current synthetic aperture radar (SAR) ship detectors achieve excellent performance with sufficient samples while encountering degraded results when the sensors and imaging conditions change. The mismatch of view, shape, and illumination inevitably result in the variations of feature distribution between source domain and target domain, which will lead to detection performance degradation. Therefore, devising a detector with well transferability to new domains remains a challenging issue. To this end, this letter proposes a novel domain adaptive YOLOv5 framework for cross-domain SAR ship detection, which is composed of the following keypoints: 1) a cross-domain co- attention feature correlation module, which models spatial and semantic interdependencies by capturing pixel correspondence between source and target domain in a bidirectional way; 2) a multilevel feature alignment module, which constrains the inter-domain difference of features from different scales by inserting three domain classifiers; and 3) teacher–student mutual learning, which makes full use of unlabeled target data and iteratively generates higher-quality pseudo-labels, thus further improving a teacher model with narrowed domain gap. Model performance is evaluated on three SAR ship datasets, and comprehensive results demonstrate the superiority of our method on multiple domain transfer scenarios, i.e., cross resolution, cross-sensor adaptation, and cross-resolution adaptation under the same sensor.