25 October 2023 in IEEE Transactions on Intelligent Transportation Systems
Absolute pose regression has shown great potential in LiDAR localization, which learns to regress 6-DoF LiDAR poses through deep networks. However, recent regression methods suffer from scene ambiguities in challenging scenarios, leading to inaccurate and unstable localization. Inspired by neurobiological localization mechanisms, i.e., the firing mechanism of place cells, head-direction cells, and grid cells in mammalian brains, we propose a novel LiDAR localization framework called NIDALoc to achieve more robust and accurate results. First, we propose a Hebbian memory module, motivated by place cells, to preserve historical information, which helps refine local view features to reduce scene ambiguities. Specifically, the memory module stores scene information and then recalls it when revisiting an old place. Second, we propose a novel pose constrained framework, consisting of an orientation classification task and a grid center regression task, to regularize orientation and position estimation, respectively. The framework based on head-direction cells and grid cells constrains the absolute pose regression to reduce wrong predictions. Extensive experiments on two outdoor datasets demonstrate the effectiveness of NIDALoc, which outperforms state-of-the-art localization methods, especially in large-scale challenging scenes. The source code is available on the project website at https://github.com/PSYZ1234/NIDALoc.
15 September 2023 in IEEE Transactions on Geoscience and Remote Sensing
The contours, one of the most significant human perceptual features, have a significant impact on point cloud processing. In urban scenes, contour extraction is quite challenging due to the enormous number of unstructured and irregular points (typically greater than 10 7 points). In this paper, we propose a Large-scale 3D point cloud Contour Extraction Network (LCE-NET) to generate contours consistent with human perception of outdoor scenes. To our knowledge, it is the first time that an end-to-end learning-based framework has been proposed for contour extraction on point cloud at this scale. The proposed LCE-Net is essentially a two-phase system. In the first phase, potential vertexes are detected from the input point cloud by the vertex detection module, then in the second phase, a designed overcomplete line proposal set is generated, and invalid line segments are further suppressed by the line proposal discrimination module. The two phases are jointly trained by a uniform loss function to promote the information interchange, thus leading to extraction results with satisfied accurate and false alarm ratings. Since there is hardly any available dataset with labeled contours for the large-scale outdoor scene, we open sourced SemanticLine, the first dataset for large-scale point clouds with labeled contour information, based on re-annotation of previous mapping level point cloud dataset semantic3D. Experimental results demonstrate that LCE-NET can effectively extract parametric contour lines from large-scale point clouds of urban scenes. Additionally, it outperforms the state-of-the-art approaches. The code will be open source on GitHub soon.
13 October 2023 in IEEE Transactions on Geoscience and Remote Sensing
Object detection for remote sensing images (ODRSI) is an important task in computer vision. Effective algorithms inspired by oriented object detection have been proposed recently. However, a major challenge still remains. Different categories of objects may be similar under different scales, causing cross-scale confusion. Different from natural images, remote sensing images have a consistent scale within the same image, which is generally referred to as Ground Sample Distance (GSD). In this paper, we show, that GSD can be utilized to address the cross-scale confusion problem, and effectively boost the performance of ODRSI. Specifically, we propose GSDDet, which embeds the deep features that represent GSD constraints to decrease the cross-scale confusion between different object categories. In GSDDet, a deep GSD classification network is first designed to extract the GSD deep features from remote sensing images. Then, the GSD deep feature is coupled with an attention framework to detect multiple categories of objects. Due to the simplicity of our framework, GSDDet can be applied to improve both one-stage and two-stage methods. Experiments demonstrate that GSDDet outperforms state-of-the-art methods on challenging benchmarks, including DOTA-v1.0, DOTA-v1.5, and HRSC2016. The source code will be released upon publication.