With the rapid development of Earth observation technology, very-high-resolution (VHR) images from various satellite sensors are more available, which greatly enrich the data source of change detection (CD). Multisource multitemporal images can provide abundant information on observed landscapes with various physical and material views, and it is exigent to develop efficient techniques to utilize these multisource data for CD. In this article, we propose a novel and general deep siamese convolutional multiple-layers recurrent neural network (RNN) (SiamCRNN) for CD in multitemporal VHR images. Superior to most VHR image CD methods, SiamCRNN can be used for both homogeneous and heterogeneous images. Integrating the merits of both convolutional neural network (CNN) and RNN, SiamCRNN consists of three subnetworks: deep siamese convolutional neural network (DSCNN), multiple-layers RNN (MRNN), and fully connected (FC) layers. The DSCNN has a flexible structure for multisource image and is able to extract spatial-spectral features from homogeneous or heterogeneous VHR image patches. The MRNN stacked by long-short term memory (LSTM) units is responsible for mapping the spatial-spectral features extracted by DSCNN into a new latent feature space and mining the change information between them. In addition, FC, the last part of SiamCRNN, is adopted to predict change probability. The experimental results in two homogeneous data sets and one challenging heterogeneous VHR images data set demonstrate that the promising performances of the proposed network outperform several state-of-the-art approaches.
A large number of publications have incorporated deep learning in the process of remote sensing change detection. In these Deep Learning Change Detection (DLCD) publications, deep learning methods have demonstrated their superiority over conventional change detection methods. However, the theoretical underpinnings of why deep learning improves the performance of change detection remain unresolved. As of today, few in-depth reviews have investigated the mechanisms of DLCD. Without such a review, five critical questions remain unclear. Does DLCD provide improved information representation for change detection? If so, how? How to select an appropriate DLCD method and why? How much does each type of change benefits from DLCD in terms of its performance? What are the major limitations of existing DLCD methods and what are the prospects for DLCD? To address these five questions, we reviewed according to the following strategies. We grouped the DLCD information assemblages into the four unique dimensions of remote sensing: spectral, spatial, temporal, and multi-sensor. For the extraction of information in each dimension, the difference between DLCD and conventional change detection methods was compared. We proposed a taxonomy of existing DLCD methods by dividing them into two distinctive pools: separate and coupled models. Their advantages, limitations, applicability, and performance were thoroughly investigated and explicitly presented. We examined the variations in performance between DLCD and conventional change detection. We depicted two limitations of DLCD, i.e. training sample and hardware and software dilemmas. Based on these analyses, we identified directions for future developments. As a result of our review, we found that DLCD’s advantages over conventional change detection can be attributed to three factors: improved information representation; improved change detection methods; and performance enhancements. DLCD has to surpass the limitations with regard to training samples and computing infrastructure. We envision this review can boost developments of deep learning in change detection applications.
1 March 2009 in International Journal of Remote Sensing
As a first step in developing classification procedures for remotely acquired hyperspectral mapping of mangrove canopies, we conducted a laboratory study of mangrove leaf spectral reflectance at a study site on the Caribbean coast of Panama, where the mangrove forest canopy is dominated by Avicennia germinans, Laguncularia racemosa, and Rhizophora mangle. Using a high‐resolution spectrometer, we measured the reflectance of leaves collected from replicate trees of three mangrove species growing in productive and physiologically stressful habitats. The reflectance data were analysed in the following ways. First, a one‐way ANOVA was performed to identify bands that exhibited significant differences (P value<0.01) in the mean reflectance across tree species. The selected bands then formed the basis for a linear discriminant analysis (LDA) that classified the three types of mangrove leaves. The contribution of each narrow band to the classification was assessed by the absolute value of standardised coefficients associated with each discriminant function. Finally, to investigate the capability of hyperspectral data to diagnose the stress condition across the three mangrove species, four narrow band ratios (R695/R420, R605/R760, R695/R760, and R710/R760 where R695 represents reflectance at wavelength of 695nm, and so on) were calculated and compared between stressed and non‐stressed tree leaves using ANOVA. Results indicate a good discrimination was achieved with an average kappa value of 0.9. Wavebands at 780, 790, 800, 1480, 1530, and 1550 nm were identified as the most useful bands for mangrove species classification. At least one of the four reflectance ratio indices proved useful in detecting stress associated with any of the three mangrove species. Overall, hyperspectral data appear to have great potential for discriminating mangrove canopies of differing species composition and for detecting stress in mangrove vegetation.
2 October 2012 in International Journal of Remote Sensing
Urban land-use information plays a key role in a wide variety of planning and environmental management processes. The purpose of this study was to develop an automatic method for classifying detailed urban land-use classes with remote-sensing data. Seven land-use parcel attributes, derived from relevant remote-sensing data, were incorporated for classifying four land-use classes, namely office, industrial, civic, and transportation, which were reported as the most difficult ones to classify from previous studies. An experiment was carried out in a study site in Austin, Texas. An overall accuracy of 61.68% and a kappa coefficient of 0.54 were achieved with a decision tree method. Building area and building height turned out to be the most influential factors among all the adopted variables. In addition, the variable of floor area ratio played the second dominant role among the seven variables, demonstrating that synthesized horizontal and vertical properties of buildings and their relevant spatial characteristics are important in differentiating the four classes.
1 August 2016 in International Journal of Remote Sensing
Effort has been devoted to automatic or semi-automatic individual tree detection and crown delineation from remotely sensed data, aiming at the effective creation of forest inventory, to assist forest management and ecosystem modelling. However, there is no uniform evaluation scheme to assess the resulting products. This paper reviews the available techniques and essential considerations for evaluating remote sensing-based forest inventory products, including detected individual tree locations, crown delineation maps, forest structure parameters, and species classification results. The reference data collection, individual tree matching method, mismatched individual tree crown treatment, and stratification criteria are summarized as four key factors in the evaluation process. Additionally, a discussion of future working directions, regarding limitations of existing techniques, multi-scale evaluation, sampling schemes, uncertainty analysis, and results interpretation, is also included. A new accuracy assessment framework is proposed, and an accuracy report example is provided.