In complex scenes, dynamic background, illumination variation, and shadow are important factors, which make conventional moving object detection algorithms suffer from poor performance. To solve this problem, a moving object detection method via ResNet-18 with encoder-decoder structure is proposed to segment moving objects from complex scenes. ResNet-18 with encoder-decoder structure possesses pixel-level classification capability to divide pixels into foreground and background, and it performs well in feature extraction because of its layers are so shallow that many more low-scale features will be retained. First, the object frames and their corresponding artificial labels are input to the network. Then, feature vectors will be generated by the encoder, and they are converted into segmentation maps by the decoder through deconvolution processing. Third, a rough matching of the moving object regions will be obtained, and finally, the Euclidean distance is used to match the moving object regions accurately. The proposed method is suitable for the scenes where dynamic background, illumination variation, and shadow exist, and experimental results on the public standard CDnet2014 and I2R datasets, from both qualitative and quantitative comparison aspects, demonstrate that the proposed method outperforms state-of-the-art algorithms significantly, and its mean F-measure increased by 1.99%~29.17%.
30 October 2018 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Superpixel segmentation has been demonstrated to be a powerful tool in hyperspectral image (HSI) classification. Each superpixel region can be regarded as a homogeneous region, which is composed of a series of spatial neighboring pixels. However, a superpixel region may contain the pixels from different classes. To further explore the optimal representations of superpixels, a new framework based on two k selection rules is proposed to find the most representative training and test samples. The proposed method consists of the following four steps: first, a superpixel segmentation algorithm is performed on the HSI to cluster the pixels with similar spectral features into the same superpixel. Then, a domain transform recursive filtering is used to extract the spectral–spatial features of the HSI. Next, the $k$ nearest neighbor (KNN) method is utilized to select k $_1$ representative training samples and k $_2$ test pixels for each superpixel, which can effectively overcome the within-class variations and between-class interference, respectively. Finally, the class label of superpixels can be determined by measuring the averaged distances among the selected training and test samples. Experiments conducted on four real hyperspectral datasets show that the proposed method provides competitive classification performances with respect to several recently proposed spectral–spatial classification methods.
2 March 2022 in IEEE Transactions on Geoscience and Remote Sensing
Change detection approaches can detect changed areas of the same scene at different times. Hyperspectral remote-sensing images contain large amounts of spectral information at high resolution. As hyperspectral datasets become abundant, more and more change detection technologies use hyperspectral images as raw data. Hyperspectral images suffer from band redundancy. There is an urgent need to improve the directionality of change of information features. To solve these problems, in this article, we propose a CNN framework involving slow-fast band selection (SFBS) and feature fusion grouping (SFBS-FFGNET) for hyperspectral image change detection. The main contributions of this article are as follows: 1) based on slow feature analysis (SFA), an SFBS method is proposed, which selects slow and fast feature bands to better extract changed and unchanged features, to more effectively separate changed and unchanged pixels; 2) we used a difference matrix to enrich the level of change information to provide more change characteristics for change detection; and 3) an FFG method was used to generate a more discriminative feature group, and the related loss function was designed. Experimental results on multiple real hyperspectral datasets showed that SFBS can reduce the operating load on the computer and improve the accuracy of change detection, and FFG can also improve the accuracy of change detection. In summary, SFBS-FFGNET is superior to most existing change detection methods.
22 March 2023 in IEEE Transactions on Image Processing
With the increasing spectral dimension of hyperspectral images (HSI), how correctly choose bands based on band correlation and information has become more significant, but also complicated. Band selection is a combinatorial optimization problem, and intelligent optimization algorithms have been shown to be crucial in solving combinatorial optimization problems. However, major of them only use a single objective as the selection index, while neglecting the overall features of hyperspectral images, which may lead to inaccuracy in object detection. To tackle this, we propose a band selection method based on a multi-objective cuckoo search algorithm (MOCS) when constructing a multi-objective unsupervised band selection model based on the amount of information and correlation of the bands (MOCS-BS). Specifically, an adaptive strategy based on population crowding degree is first proposed to assist Lévy flight in overcoming the influence of the parameter constancy. Then, an information-sharing strategy based on grouping and crossover is designed to balance the search ability between global exploration and local exploitation, which can overcome the shortcomings caused by the lack of information interaction between individuals. Finally, the HSI classification experiments are performed by Random Forest and KNN classifiers based on the subset of bands selected by the proposed MOCS-BS method. The proposed method is compared with state-of-the-art algorithms including neighborhood grouping normalized matched filter (NGNMF) and multi-objective artificial bee colony with band selection (MABC-BS) on four HSI datasets. The experimental results demonstrate that MOCS-BS is more effective and robust than other methods.
6 September 2022 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Hyperspectral images (HSIs) have high spatial resolution and spectral resolution, and using HSI as a change detection (CD) data source is crucial for detecting surface changes. However, there is a large amount of real noise in HSIs, and most deep-learning-based CD methods require a large number of ground-truth labels for training, which is difficult and expensive to label manually. To reduce the dependence of CD on ground-truth labels and weaken the interference of noise on CD in HSIs, in this article, we propose an HSI change detection framework with a self-supervised contrastive learning pretrained model (CDSCL). CDSCL consists of two parts: self-supervised contrastive learning pretrained model and CD classification network. The main contributions of this article are as follows: a data augmentation strategy based on Gaussian noise is proposed to improve the ability of the model to extract variation information from HSIs with different random Gaussian noises; based on the information bottleneck theory, a progressive feature extraction module is developed to remove redundant or irrelevant details in changing information spectrum; and a contrastive loss function based on the Pearson correlation coefficient and negative cosine correlation is designed to make the features extracted by the two branches of the siamese network close to each other. Experimental results on four real hyperspectral datasets demonstrate that the CD performance of CDSCL outperforms the most representative CD methods.