Despite many state-of-the-art methods have been proposed for infrared (IR) small target detection, target detectability (TD) and background suppressibility (BS) cannot be significantly improved simultaneously, especially in complex situations. This paper proposes a novel IR small target detection method named improved multi-mode nuclear norm joint local weighted entropy contrast (IMNN-LWEC), which represents the IR target detection task as an optimization problem for tensor decomposition of three components in spatial-temporal domain, including background tensor, target tensor and sparse structure tensor. First, to utilize the spatial and temporal information in an IR sequence effectively, we transform the original IR sequence into a nonoverlapping spatial-temporal patch-tensor. Second, a nonconvex approximation of tensor rank called improved multi-mode weighted tensor nuclear norm (IMWTNN) is proposed to estimate background tensor rank, which is of benefit to separate the background component more completely from the original image. Third, based on structure tensor theory, we introduce a new sparse prior map called local weighted entropy contrast (LWEC) via a designed image entropy operator and a new prior information filter, which can further preserve the target and suppress the background simultaneously. Besides, a novel tube-wise sparse regularization term is designed to identify linear sparse structures. And Frobenius norm is used to characterize noise. Finally, to solve the proposed model, an efficient optimization scheme utilizing the alternating direction multiplier method (ADMM) is designed to retrieve the small targets. Comprehensive experiments on five datasets witness the superior TD and BS performance of the proposed method compared with nine state-of-the-art detection methods.
27 May 2019 in IEEE Geoscience and Remote Sensing Letters
Infrared small target detection is one of the most important parts of infrared search and tracking (IRST) system. Generally, the small and dim target is of low signal-to-noise ratio and buried in the complicated background and heavy noise, which makes it extremely difficult to be detected with low false alarm rates. To solve this problem, we propose a small target detection method based on multiscale local contrast measure. Different from conventional methods, we novelly measure the local contrast from two aspects: local dissimilarity and local brightness difference. First, we present a new dissimilarity measure called the local energy factor (LEF) to describe the dissimilarity between the small targets and their surrounding backgrounds. Second, the feature of the brightness difference between the small targets and the backgrounds is utilized. Afterward, the local contrast is measured by taking both features of the above into account. Finally, an adaptive segmentation method is applied to extract the small targets from the backgrounds. Extensive experiments on real test data set demonstrate that our approach outperforms the state-of-the-art approaches.
20 March 2018 in IEEE Transactions on Geoscience and Remote Sensing
Band selection (BS) is a special case of the feature selection problem, and it tries to remove redundant bands and select a few informative and distinctive bands to represent the whole image cube. The maximum ellipsoid volume (MEV) method regards the band subset with the maximum volume as the optimal band combination. However, the MEV method cannot be directly applied for hyperspectral imagery due to the high dimensionality of the data sets. Therefore, we first combine MEV with the sequential forward search (SFS) and propose a new unsupervised BS method called MEV-SFS. Furthermore, a subtle relationship between the ellipsoid volume of the band set and the orthogonal projections (OPs) of the candidate bands is observed. Based on this relationship, we propose another equivalent method, namely, the OP-based BS (OPBS) method. OPBS is the fast version of MEV-SFS, and it has a better computational efficiency and the potential to determine the number of bands to be selected. We specifically explain the rationality of the MEV-based methods (MEV-SFS and OPBS) and illustrate their theoretical significance and physical meaning from different aspects. Theoretical analysis also demonstrates that OPBS can be regarded as a model or framework for BS, and thus, we further propose a third novel BS method named the OPBS-information divergence (OPBS-ID) method, which is a variant of OPBS. OPBS-ID can achieve a better classification performance than OPBS in many cases. Experimental results on different hyperspectral data sets demonstrate that the proposed methods have high computational efficiency, and the selected bands can achieve satisfactory classification performances.
22 July 2020 in IEEE Transactions on Geoscience and Remote Sensing
Due to significant geometric distortions and illumination differences, developing techniques for high precision and robust multisource remote sensing image registration poses a great challenge. This article presents an iterative image registration approach, called iterative scale-invariant feature transform (ISIFT) for remote sensing images, which extends the traditional scale-invariant feature transform (SIFT)-based registration system to a close-feedback SIFT system that includes a rectification feedback loop to update rectified parameters in an iterative manner. Its key idea uses consistent feature point sets obtained by maximum similarity to calculate new alignment parameters to rectify the current sensed image and the resulting rectified sensed image is then fed back to update and replace the current sensed image as a new sensed image to reimplement SIFT for next iteration. The same process is repeated iteratively until an automatic stopping rule is satisfied. To evaluate the performance of ISIFT, both the simulated and real images are used for experiments for the validation of ISIFT. In addition, several data sets are particularly designed to conduct a comparative study and analysis with existing state-of-the-art methods. Furthermore, experiments with different rotation are also performed to verify the adaptability of ISIFT under different rotation distortions. The experimental results demonstrate that ISIFT improves performance and produces better registration accuracy than traditional SIFT-based methods and existing state-of-the-art methods.
9 October 2019 in IEEE Geoscience and Remote Sensing Letters
This letter presents a superpixel-based dual window RX (SPDWRX) anomaly detection (AD) algorithm that uses superpixel segmentation (SPS) to adaptively determine the dual window for local RX (LRX) detection, rather than using a fixed dual window. The main premise of SPDWRX is to first divide the hyperspectral image into multiple superpixels and then extend the minimum bounding rectangle to determine the background of each superpixel. Finally, LRX AD is conducted on each pixel in the same superpixel using the same background. Furthermore, a fine SPS method is proposed based on the entropy rate superpixel to quickly obtain uniform superpixels. The experimental results show that the proposed SPDWRX method can significantly improve the detection speed and slightly improve the detection performance, and the modified SPS can further improve the detection performance of SPDWRX.
23 July 2018 in IEEE Geoscience and Remote Sensing Letters
Band selection (BS) tries to find a few useful bands to represent the whole hyperspectral image cube. This letter proposes a novel unsupervised BS method based on the band correlation analysis (BCA). The BCA method tries to find a subset of bands that can well represent the whole image data set. To avoid the exhaustive search, the BCA method iteratively adds the band with the good representative ability and low redundancy into the selected band set, until the sufficient quantity of bands has been obtained. The redundancy and the representative ability of one band are computed by its correlation with the currently selected bands and the remaining unselected bands, respectively. Through constructing a correlation matrix of total bands, the BCA method can find the bands that with large amounts of information and low redundancy, which ensures that the selected bands are useful for the further applications like pixels classification. Experimental results on three different data sets demonstrate that the proposed method is very effective and can achieve the best performance among the competitors.