Change detection in heterogeneous remote sensing images is crucial for disaster damage assessment. Recent methods use homogenous transformation, which transforms the heterogeneous optical and SAR remote sensing images into the same feature space, to achieve change detection. Such transformations mainly operate on the low-level feature space and may corrupt the semantic content, deteriorating the performance of change detection. To solve this problem, this paper presents a new homogeneous transformation model termed deep homogeneous feature fusion (DHFF) based on image style transfer (IST). Unlike the existing methods, the DHFF method segregates the semantic content and the style features in the heterogeneous images to perform homogeneous transformation. The separation of the semantic content and the style in homogeneous transformation prevents the corruption of image semantic content, especially in the regions of change. In this way, the detection performance is improved with accurate homogeneous transformation. Furthermore, we present a new iterative IST (IIST) strategy, where the cost function in each IST iteration measures and thus maximizes the feature homogeneity in additional new feature subspaces for change detection. After that, change detection is accomplished accurately on the original and the transformed images that are in the same feature space. Real remote sensing images acquired by SAR and optical satellites are utilized to evaluate the performance of the proposed method. The experiments demonstrate that the proposed DHFF method achieves significant improvement for change detection in heterogeneous optical and SAR remote sensing images, in terms of both accuracy rate and Kappa index.
28 February 2023 in IEEE Transactions on Geoscience and Remote Sensing
Convolutional neural networks (CNNs) have been widely applied in the context of ship detection in synthetic aperture radar (SAR) images, but the detection performance is still not ideal in scenarios with clutter interference. Mining frequency-domain information to suppress the sea clutter in SAR ship detection has attracted wide attention. However, existing frequency-domain ship detection methods do not process frequency-domain information adaptively, which results in the degradation of ship detection performance. To overcome this problem, this article proposes a novel deep learning network called YOLO-FA. YOLO-FA contains the proposed Frequency Attention Module (FAM), which can process frequency-domain information of SAR images adaptively. The proposed method can suppress the sea clutter in the SAR images with the help of frequency-domain information. We evaluate the proposed method YOLO-FA on two datasets, i.e., the High-Resolution SAR images dataset (HRSID) and SAR Ship Detection Dataset (SSDD). Compared with the baseline method YOLOv5 and existing commonly used methods, YOLO-FA achieves state-of-the-art detection performance on both datasets.
12 April 2021 in IEEE Transactions on Geoscience and Remote Sensing
Recently, anchor-free object detectors have shown promising performance in oriented object detection on remote sensing images. However, the objects in remote sensing images always have large variations in arbitrary orientations, sizes, and aspect ratios, which makes the existing anchor-free methods hard to obtain satisfactory results. In this article, we propose a novel anchor-free detector, center-boundary dual attention (CBDA) network (CBDA-Net), for fast and accurate oriented object detection on remote sensing images. In CBDA-Net, we construct a CBDA module, which utilizes a dual attention mechanism to extract attention features on the center and boundary regions of objects. The CBDA module can learn more essential features for rotating objects and reduce the interference from complex background. Besides, to resolve the influence of object aspect ratio on angle errors, we propose an aspect ratio weighted angle loss (arwLoss), where diffident penalties are assigned on the angle loss based on the aspect ratios of objects. This loss construction is effective in improving the detection accuracy of oriented objects, especially for slender objects. We conduct extensive experiments on two publish benchmarks, i.e., DOTA and HRSC2016. The experimental results demonstrate that our CBDA-Net achieves favorable performance against other anchor-free state of the arts with a real-time speed of 50 FPS.
8 March 2021 in IEEE Transactions on Geoscience and Remote Sensing
Change detection in heterogeneous remote sensing images is crucial for emergencies, such as disaster assessment. Existing methods based on homogeneous transformation suffer from the high computational cost that makes the change detection tasks time-consuming. To solve this problem, this article presents a new semisupervised Siamese network (S 3 N) based on transfer learning. In the proposed S 3 N, the low- and deep-level features are separated and treated differently for transfer learning. By incorporating two identical subnetworks that are both pretrained on natural images, the proposed S 3 N eliminates the computational cost for learning the low-level features that are universal for both remote sensing images and natural images. As the deep-level features contain different semantics between remote sensing images and natural images, a novel transfer learning strategy is presented to train only the weights of the layers for deep-level features in the proposed S 3 N. The decrease in the number of network parameters to be trained reduces the demand for training samples, leading to a significant decrease in computational cost. Afterward, the thresholding method, Otsu , is applied to the difference map derived by the proposed S 3 N to obtain the final binary map of change detection. Three data sets including different types of heterogeneous remote sensing images are employed to evaluate the performance of the proposed S 3 N. The experimental results demonstrate that the proposed S 3 N can achieve a comparable detection performance with much lower computational cost, compared with state-of-the-art change detection algorithms.
Multiple extended target tracking (METT) is a common and challenging problem. Various solutions for METT have been proposed, however, most of them focus on the single-sensor or centralized multi-sensor scenarios. In this letter, we explore the multi-sensor METT problem in a distributed fusion framework. Specifically, there are two stages in the implementation process: 1) to perform a Gamma Gaussian Inverse Wishart Cardinalized Probability Hypothesis Density (GGIW-CPHD) filter for each sensor node, and 2) to perform a fusion by resorting to the so-called Generalized Covariance Intersection (GCI) fusion rule. In the fusion stage, we derive an approximate GGIW mixture form of the fused spatial density. Lastly, simulation experiments via a consensus sensor network are provided to verify the effectiveness of the proposed approach.
18 March 2020 in IEEE Transactions on Geoscience and Remote Sensing
Existing superpixel-based detection algorithms for ship targets in synthetic aperture radar (SAR) images are often derived from the local contrast of intensities (i.e., the local contrast of the first-order information of superpixels) leading to deteriorating performance in low signal-to-clutter ratio (SCR) cases due to the low contrast between the intensities of targets and the clutter. In this article, we propose a new superpixel-based detector to improve the performance of ship target detection in SAR images via the local contrast of fisher vectors (LCFVs). The new LCFV-based detector exploits multiorder features of the superpixels based on the Gaussian mixture model (GMM) and accordingly improves the discrimination capability between the ship targets and the sea clutter, especially in low SCR cases. Experimental results demonstrate that the proposed LCFV-based detection algorithm provides better detection performance than the commonly used detection algorithms.