Feature-based matching methods have been widely used in remote sensing image matching given their capability to achieve excellent performance despite image geometric and radiometric distortions. However, most of the feature-based methods are unreliable for complex background variations, because the gradient or other image grayscale information used to construct the feature descriptor is sensitive to image background variations. Recently, deep learning-based methods have been proven suitable for high-level feature representation and comparison in image matching. Inspired by the progresses made in deep learning, a new technical framework for remote sensing image matching based on the Siamese convolutional neural network is presented in this paper. First, a Siamese-type network architecture is designed to simultaneously learn the features and the corresponding similarity metric from labeled training examples of matching and non-matching true-color patch pairs. In the proposed network, two streams of convolutional and pooling layers sharing identical weights are arranged without the manually designed features. The number of convolutional layers is determined based on the factors that affect image matching. The sigmoid function is employed to compute the matching and non-matching probabilities in the output layer. Second, a gridding sub-pixel Harris algorithm is used to obtain the accurate localization of candidate matches. Third, a Gaussian pyramid coupling quadtree is adopted to gradually narrow down the searching space of the candidate matches, and multiscale patches are compared synchronously. Subsequently, a similarity measure based on the output of the sigmoid is adopted to find the initial matches. Finally, the random sample consensus algorithm and the whole-to-local quadratic polynomial constraints are used to remove false matches. In the experiments, different types of satellite datasets, such as ZY3, GF1, IKONOS, and Google Earth images, with complex background variations are used to evaluate the performance of the proposed method. The experimental results demonstrate that the proposed method, which can significantly improve the matching performance of multi-temporal remote sensing images with complex background variations, is better than the state-of-the-art matching methods. In our experiments, the proposed method obtained a large number of evenly distributed matches (at least 10 times more than other methods) and achieved a high accuracy (less than 1 pixel in terms of root mean square error).
A system understanding of the patterns, causes, and trends of long-term land use and land cover (LULC) change at the regional scale is essential for policy makers to address the growing challenges of local sustainability and global climate change. However, it still remains a challenge for estuarine and coastal regions due to the lack of appropriate approaches to consistently generate accurate and long-term LULC maps. In this work, an object-based classification framework was designed to mapping annual LULC changes in the Yangtze River estuary region from 1985–2016 using Landsat time series data. Characteristics of the inter-annual changes of LULC was then analyzed. The results showed that the object-based classification framework could accurately produce annual time series of LULC maps with overall accuracies over 86% for all single-year classifications. Results also indicated that the annual LULC maps enabled the clear depiction of the long-term variability of LULC and could be used to monitor the gradual changes that would not be observed using bi-temporal or sparse time series maps. Specifically, the impervious area rapidly increased from 6.42% to 22.55% of the total land area from 1985 to 2016, whereas the cropland area dramatically decreased from 80.61% to 55.44%. In contrast to the area of forest and grassland, which almost tripled, the area of inland water remained consistent from 1985 to 2008 and slightly increased from 2008 to 2016. However, the area of coastal marshes and barren tidal flats varied with large fluctuations.
Automatic building extraction using a single data type, either 2D remotely-sensed images or light detection and ranging 3D point clouds, remains insufficient to accurately delineate building outlines for automatic mapping, despite active research in this area and the significant progress which has been achieved in the past decade. This paper presents an effective approach to extracting buildings from Unmanned Aerial Vehicle (UAV) images through the incorporation of superpixel segmentation and semantic recognition. A framework for building extraction is constructed by jointly using an improved Simple Linear Iterative Clustering (SLIC) algorithm and Multiscale Siamese Convolutional Networks (MSCNs). The SLIC algorithm, improved by additionally imposing a digital surface model for superpixel segmentation, namely 6D-SLIC, is suited for building boundary detection under building and image backgrounds with similar radiometric signatures. The proposed MSCNs, including a feature learning network and a binary decision network, are used to automatically learn a multiscale hierarchical feature representation and detect building objects under various complex backgrounds. In addition, a gamma-transform green leaf index is proposed to truncate vegetation superpixels for further processing to improve the robustness and efficiency of building detection, the Douglas–Peucker algorithm and iterative optimization are used to eliminate jagged details generated from small structures as a result of superpixel segmentation. In the experiments, the UAV datasets, including many buildings in urban and rural areas with irregular shapes and different heights and that are obscured by trees, are collected to evaluate the proposed method. The experimental results based on the qualitative and quantitative measures confirm the effectiveness and high accuracy of the proposed framework relative to the digitized results. The proposed framework performs better than state-of-the-art building extraction methods, given its higher values of recall, precision, and intersection over Union (IoU).
26 October 2020 in IEEE Geoscience and Remote Sensing Letters
The methods in remote sensing image retrieval (RSIR) usually search the whole retrieval data set in the retrieval process, which takes much time and is unnecessary. To reduce the overall search time, this letter proposes a new retrieval scheme based on fuzzy rules. The proposed method calculates the fuzzy class membership of images using two ways. The first way predicts the fuzzy class membership by convolutional neural network (CNN). The other uses the image-to-class distance that is a distance between an image and each class on the training data set. The two fuzzy class memberships are used to measure the classification confidence, and a query image is classified into three fuzzy sets, namely, ``low classification confidence,'' ``medium classification confidence,'' and ``high classification confidence,'' based on the classification confidence. The fuzzy rules are built according to fuzzy classification to choose the search space for each fuzzy set. The final search space is determined by the two search spaces obtained by fuzzy rules. Moreover, the fuzzy distance between a query image and a retrieved image is used to improve the retrieval performance, which is calculated according to their fuzzy class memberships and the Euclidean distance between the two images. The experimental results on University of California, Merced data set (UCMD) and PatternNet databases show that our proposed method can not only enhance the retrieval performance but also reduce the search time in comparison to other state-of-the-art techniques.
The goal of this paper is to present a new model of fuzzy topological relations for simple spatial objects in Geographic Information Sciences (GIS). The concept of computational fuzzy topological space is applied to simple fuzzy objects to efficiently and more accurately solve fuzzy topological relations, extending and improving upon previous research in this area. Firstly, we propose a new definition for simple fuzzy line segments and simple fuzzy regions based on computational fuzzy topology. And then, we also propose a new model to compute fuzzy topological relations between simple spatial objects, an analysis of the new model exposes:(1) the topological relations of two simple crisp objects; (2) the topological relations between one simple crisp object and one simple fuzzy object; (3) the topological relations between two simple fuzzy objects. In the end, we have discussed some examples to demonstrate the validity of the new model, through an experiment and comparisons of existing models, we showed that the proposed method can make finer distinctions, as it is more expressive than the existing fuzzy models.