The automatic ship detection method for thermal infrared remote sensing images (TIRSIs) is of great significance due to its broad applicability in maritime security, port management, and target searching, especially at night. Most ship detection algorithms utilize manual features to detect visible image blocks which are accurately cut, and they are limited by illumination, clouds, and atmospheric strong waves in practical applications. In this paper, a complete YOLO-based ship detection method (CYSDM) for TIRSIs under complex backgrounds is proposed. In addition, thermal infrared ship datasets were made using the SDGSAT-1 thermal imaging system. First, in order to avoid the loss of texture characteristics during large-scale deep convolution, the TIRSIs with the resolution of 30 m were up-sampled to 10 m via bicubic interpolation method. Then, complete ships with similar characteristics were selected and marked in the middle of the river, the bay, and the sea. To enrich the datasets, the gray value stretching module was also added. Finally, the improved YOLOv5 s model was used to detect the ship candidate area quickly. To reduce intra-class variation, the 4.23–7.53 aspect ratios of ships were manually selected during labeling, and 8–10.5 μm ship datasets were constructed. Test results show that the precision of the CYSDM is 98.68%, which is 9.07% higher than that of the YOLOv5s algorithm. CYSDM provides an effective reference for large-scale, all-day ship detection.
1 August 2022 in IEEE Transactions on Geoscience and Remote Sensing
Due to the complicated background and noise of infrared images, infrared small target detection is one of the most difficult problems in the field of computer vision. In most existing studies, semantic segmentation methods are typically used to achieve better results. The centroid of each target is calculated from the segmentation map as the detection result. In contrast, we propose a novel end-to-end framework for infrared small target detection and segmentation in this article. First, with the use of UNet as the backbone to maintain resolution and semantic information, our model can achieve a higher detection accuracy than other state-of-the-art methods by attaching a simple anchor-free head. Then, a pyramid pool module is used to further extract features and improve the precision of target segmentation. Next, we use semantic segmentation tasks that pay more attention to pixel-level features to assist in the training process of object detection, which increases the average precision (AP) and allows the model to detect some targets that were previously not detectable. Furthermore, we develop a multi-task framework for infrared small target detection and segmentation. Our multi-task learning model reduces complexity by nearly half and speeds up inference by nearly twice compared to the composite single-task model while maintaining accuracy. The code and models are publicly available at https://github.com/Chenastron/MTUNet .
3 August 2022 in IEEE Transactions on Geoscience and Remote Sensing
Remote sensing images (RSIs) have been applied to many fields, such as environmental monitoring, urban planning, and military defense. All-day thermal infrared imaging observation system can finely portray the trajectory of human activities and provide data support for United Nations sustainable development planning. However, in the process of RSIs, image quality degradation containing image blurring is caused by optical system aberration, satellite platform vibration, imaging system out-of-focus, and atmospheric turbulence. Moreover, stripe noise in the image is produced by the nonuniformity of infrared sensors. Image deblurring and destriping are classical tasks in RSIs, but the above two problems are discussed separately in almost all research, i.e., denoising after adding stripe noise on clear images or deblurring under the assumption that only random noise exists. In this article, stripe noise and blur are jointly removed from on-orbit RSIs acquired by the thermal infrared spectrometer (TIS) on the SDGSAT-1 satellite, using a method based on stripe component residuals and gradient property. According to the experimental results, the performance of the proposed method is greatly improved compared with processing these two tasks separately, which can provide a valuable reference for the study of high-resolution thermal infrared RSIs recovery.
7 December 2021 in IEEE Geoscience and Remote Sensing Letters
The performance of small target detection restricts the development of the infrared search and track (IRST) system. Against the complicated background clutter of the infrared (IR) image, the small targets are difficult to separate from a noisy background. Aiming at solving the problem of residual background clutter in the local contrast method, a weighted three-layer window local contrast method (WTLLCM) is proposed in this letter. First, the images are filtered by a layered gradient kernel to enhance the contrast between targets and background. Then, a three-layer window is utilized to calculate the local contrast of the filtered images. Next, it is worth mentioning that a simple target aggregation strategy is considered to preserve the integrity of the target. Especially, a new region intensity level (NRIL) algorithm is proposed to weigh the local contrast map to further suppress the background. Finally, the targets are detected by adaptive threshold segmentation. Compared with state-of-the-art small targets detection baseline algorithms based on local contrast, extensive experimental results demonstrate the superiority of the proposed method, especially in complex backgrounds. And instead of utilizing multi-scale windows, multi-scale targets detection is accomplished by using a single-scale window to reduce the calculation of the method.
Infrared dim and small target detection is widely used in military and civil fields. Traditional methods in that application rely on the local contrast between the target and background for single-frame detection. On the other hand, those algorithms depend on the motion model with fixed parameters for multi-frame association. For the great similarity of gray value and the dynamic changes of motion model parameters in the condition of low SNR and strong clutter, those methods possess weak robustness, low detection probability, and high false alarm rate. In this paper, an infrared video sequences encoding and decoding model based on Bidirectional Convolutional Long Short-Term Memory structure (Bi-Conv-LSTM) and 3D Convolutional structure (3D-Conv) is proposed, addressing the problem of high similarity and dynamic changes of parameters. For solving the problem of dynamic change in parameters, Bi-Conv-LSTM structure is used to learn the motion model of targets. And for the problem of low local contrast, 3D-Conv structure is adopted to extend receptive field in the time dimension. In order to improve the precision of detection, the Decoding part is divided into two different full connections with distinctive active function. Simulation results show that the trajectory detection accuracy of the proposed model is more than 90% under the condition of low SNR and maneuvering motion, which is better than traditional method of 80% in DB-TBD 20% in others. Real data experiment to illustrate that that our proposed method can detect small infrared targets of a low false alarm rate and high detection probability.
18 April 2022 in IEEE Geoscience and Remote Sensing Letters
Research about infrared dim and small target detection (DSTD) is concentrated on single-frame algorithms, which are limited by the contrast between target and background and face with the problems of low detection probability, high false alarm rate, and lack of robustness in low signal-to-clutter ratio (SCR) and strong noise environment. Studying the use of multiframe sequences adequately is necessary. In order to effectively utilize the temporal and local spatial information of infrared sequences, we propose a similarity model for pixel temporal profile (TP). Different from current TP detection methods, we study waveform similarity calculation for detection, and local time-shift characteristics to eliminate false alarms. First, fast Fourier transform (FFT) and KL divergence are applied to calculate the similarity of TP and reference waveform, and errors due to time offsets can be avoided through the frequency domain; second, the peak ratio of the FFT is applied to calculate the time shift of the neighboring pixels relative to the center pixel; third, maximum suppression strategy is used to reduce false alarms. Experiments show that the model and algorithms proposed in this letter have excellent performance in target enhancement and background suppression, and have higher performance than other methods in receiver operator characteristic curve (ROC).