Extracting buildings accurately from very high-resolution (VHR) remote sensing imagery is challenging due to diverse building appearances, spectral variability, and complex background in VHR remote sensing images. Recent studies mainly adopt a variant of the fully convolutional network (FCN) with an encoder–decoder architecture to extract buildings, which has shown promising improvement over conventional methods. However, FCN-based encoder–decoder models still fail to fully utilize the implicit characteristics of building shapes. This adversely affects the accurate localization of building boundaries, which is particularly relevant in building mapping. A contour-guided and local structure-aware encoder–decoder network (CGSANet) is proposed to extract buildings with more accurate boundaries. CGSANet is a multitask network composed of a contour-guided (CG) and a multiregion-guided (MRG) module. The CG module is supervised by a building contour that effectively learns building contour-related spatial features to retain the shape pattern of buildings. The MRG module is deeply supervised by four building regions that further capture multiscale and contextual features of buildings. In addition, a hybrid loss function was designed to improve the structure learning ability of CGSANet. These three improvements benefit each other synergistically to produce high-quality building extraction results. Experimental results on the WHU and NZ32km2 building datasets demonstrate that compared with the tested algorithms, CGSANet can produce more accurate building extraction results and achieve the best intersection over union value 91.55% and 90.02%, respectively. Experiments on the INRIA building dataset further demonstrate the ability for generalization of the proposed framework, indicating great practical potential.
28 January 2020 in IEEE Transactions on Intelligent Transportation Systems
Vehicle re-identification supports cross-camera tracking and the location of specific vehicles in a smart city. The gallery images of vehicles are ranked based on the similarities in the appearance of objects to a vehicle query image. Previous work on vehicle re-identification has mainly focused on global or local analyses of predefined regions of vehicles to classify the vehicle images with a softmax loss function. On the one hand, separate global or predefined local regions of vehicles are often sensitive to perspective and occlusions. On the other hand, the embedding space supervised by the softmax loss function is not sufficiently compact for the object class. To solve these problems, we propose an end-to-end distance-based global and partial multi-regional deep network (DGPM) that combines multi-regional features to identify global and local differences. We exploit a three-branch architecture to learn the global and partial features from coarsely partitioned regions. A global similarity module is introduced to reduce the background information interference in the local branches. Unlike general classification, we design a distance-based classification layer that maintains consistency among criteria for similarity evaluation. Furthermore, we use spatiotemporal vehicle information to improve the vehicle re-identification results when the camera and shooting time are available. Systematic comparative evaluations performed on the large-scale VeRi and VehicleID datasets showed that our approach robustly achieved state-of-the-art performance. For instance, for the VeRi dataset, we achieve (79.39 + 2.78)% mAP and (96.19 + 2.26)% Rank-1 accuracy.
28 September 2022 in ISPRS Journal of Photogrammetry and Remote Sensing
Extracting buildings from remotely sensed data is a fundamental task in many geospatial applications. However, this task is resistant to automation due to variability in building shapes and the environmental complexity surrounding buildings. To solve this problem, this article introduces a novel automatic building extraction method that integrates LiDAR data and high spatial resolution imagery using adaptive iterative segmentation and hierarchical overlay analysis based on data fusion. An adaptive iterative segmentation method overcomes over- and undersegmentation based on the globalized probability of boundary contour detection algorithm. A data-fusion-based hierarchical overlay analysis extracts building candidate regions based on segmentation results. A morphological operation optimizes a building candidate region to obtain final building results. Experiments were conducted on the international society for photogrammetry and remote sensing (ISPRS) Vaihingen benchmark dataset. The extracted building footprints were compared with those extracted using the state-of-the-art methods. Evaluation results show that the proposed method achieved the highest area-based quality compared to results from the other tested methods on the ISPRS website. A detailed comparison with four state-of-the-art methods shows that the proposed method requiring no samples achieves competitive extraction results. Furthermore, the proposed method achieved a completeness of 94.1%, a correctness of 90.3%, and a quality of 85.5% over the whole Vaihingen dataset, indicating that the method is robust, with great potential in practical applications.
4 July 2022 in IEEE Transactions on Intelligent Transportation Systems
Timely updated road networks are the basis for many real-world applications such as intelligent navigation and traffic management. Existing road updating methods based on remote sensing images learn from historical road databases to update roads. Road extraction models learned from historical images however, are not easily applied to a current image due to spectral differences; and only changed roads need updating. In this paper, an Unchanged-Guided Road Updating (UGRoadUpd) framework is proposed to improve the quality of updated road networks by limiting the road updating range and learning from historical unchanged roads. The UGRoadUpd framework identifies road changes using a novel dual-task dominant-transformer-based neural network for road change detection (DT-RoadCDNet). DT-RoadCDNet executes road segmentation and change detection simultaneously, from bi-temporal remote sensing images. The Dominant-Transformer based Global Context Modeling module in DT-RoadCDNet globally models the contextual spatial structure for improved integrity in roads and road changes. Based on the discovery of road changes, an unchanged-guided road update strategy updates the roads in changed areas by learning from the prior information provided by unchanged roads in a historical road database. Experiments on two newly annotated road change detection and update datasets confirms the effectiveness of our UGRoadUpd framework.