Accurate and reliable extraction of building footprints from LiDAR point clouds is a fundamental task in remote sensing and urban scene reconstruction. Building footprints serve as essential geospatial products that support GIS database updating, land-use monitoring, disaster management, and digital twin development. Traditional image-based methods enable large-scale mapping but suffer from 2D perspective limitations and radiometric distortions, while airborne or vehicle-borne LiDAR systems often face single-viewpoint constraints that lead to incomplete or fragmented footprints. Recently, backpack mobile laser scanning (MLS) has emerged as a flexible platform for capturing dense urban geometry at the pedestrian level. However, the high noise, point sparsity, and structural complexity of MLS data make reliable footprints delineation particularly challenging. To address these issues, this study proposes a Deep Line-Segment Detection–Driven Building Footprints Extraction Framework that integrates multi-layer accumulated occupancy mapping, deep geometric feature learning, and structure-aware regularization. The accumulated occupancy maps aggregate stable wall features from multiple height slices to enhance contour continuity and suppress random noise. A deep line-segment detector is then employed to extract robust geometric cues from noisy projections, achieving accurate edge localization and reduced false responses. Finally, a structural chain-based completion and redundancy filtering strategy repairs fragmented contours and removes spurious lines, ensuring coherent and topologically consistent footprints reconstruction. Extensive experiments conducted on two campus scenes containing 102 buildings demonstrate that the proposed method achieves superior performance with an average Precision of 95.7%, Recall of 92.2%, F1-score of 93.9%, and IoU of 88.6%, outperforming existing baseline approaches by 4.5–7.8% in F1-score. These results highlight the strong potential of backpack LiDAR point clouds, when combined with deep line-segment detection and structural reasoning, to complement traditional remote sensing imagery and provide a reliable pathway for large-scale urban scene reconstruction and geospatial interpretation.
Spherical harmonic (SH) has shown excellent advantages in terms of accuracy and efficiency in the retrieval of complete three-dimensional shapes. However, since the spherical function directly takes the shape centroid as the global reference point, the SH features depend heavily on the central position. In this context, the features become no longer reliable in the query of incomplete shapes that may cause erratic centroid. In this work, we propose a novel shape descriptor, namely spherical harmonic energy over the Gaussian sphere (SHE-GS), especially for the incomplete shape retrieval. Firstly, all unit normal vectors on the shape surface are mapped to points on a Gaussian sphere, which has the constant center. Secondly, kernel density estimation is used to establish a Gaussian Sphere Model (GSM) to describe the density change of these mapping points. Finally, the shape descriptor is generated by applying an SH transformation on the model. According to the way of GSM being regarded as a surface model or a volume model, we have separately designed two specific algorithm implementations. Experimental results, on two engineering shape sets containing artificially defective shapes, indicate that the proposed method outperforms other traditional methods also defined in the sphere space for incomplete shape retrieval. The superiority is verified for both similar objects in the same category or the single specific object of query.
Accurate and reliable extraction of building footprints from LiDAR point clouds is a fundamental task in remote sensing and urban scene reconstruction. Building footprints serve as essential geospatial products that support GIS database updating, land-use monitoring, disaster management, and digital twin development. Traditional image-based methods enable large-scale mapping but suffer from 2D perspective limitations and radiometric distortions, while airborne or vehicle-borne LiDAR systems often face single-viewpoint constraints that lead to incomplete or fragmented footprints. Recently, backpack mobile laser scanning (MLS) has emerged as a flexible platform for capturing dense urban geometry at the pedestrian level. However, the high noise, point sparsity, and structural complexity of MLS data make reliable footprint delineation particularly challenging. To address these issues, this study proposes a Deep Line-Segment Detection–Driven Building Footprint Extraction Framework that integrates multi-layer accumulated occupancy mapping, deep geometric feature learning, and structure-aware regularization. The accumulated occupancy maps aggregate stable wall features from multiple height slices to enhance contour continuity and suppress random noise. A deep line-segment detector is then employed to extract robust geometric cues from noisy projections, achieving accurate edge localization and reduced false responses. Finally, a structural chain–based completion and redundancy filtering strategy repairs fragmented contours and removes spurious lines, ensuring coherent and topologically consistent footprint reconstruction. Extensive experiments conducted on a self-constructed campus-scale MLS dataset containing more than one hundred buildings demonstrate that the proposed framework achieves superior accuracy and robustness across diverse architectural morphologies, including irregular and partially occluded structures. These results highlight the strong potential of backpack LiDAR point clouds, when combined with deep line-segment detection and structural reasoning, to complement traditional remote sensing imagery and provide a reliable pathway for large-scale urban scene reconstruction and geospatial interpretation.
Automated manhole cover detection, a key task in urban infrastructure inspection, is hindered by modality-specific limitations: conventional monocular image-based detectors do not directly quantify cover-to-road elevation differences, LiDAR-based methods suffer from sparse sampling that limits recall for small, distant targets, and existing fusion approaches suffer from cross-modal spatial misalignment and lack 3D defect quantification. This paper proposes SDFA-Net, an end-to-end fisheye image and LiDAR point cloud fusion framework for manhole cover detection and diagnosis in wearable mobile mapping scenarios. The semi-dense depth-supervised view transformation (SDS-VT) module constructs semi-dense depth ground truth from multi-frame accumulated point clouds to explicitly supervise image-to-bird’s-eye-view (BEV) feature projection, addressing cross-modal spatial registration under wide-angle fisheye distortion. The fidelity-adaptive fusion (FA-Fusion) module builds a physical fidelity map by combining point-cloud projection density with depth-prediction entropy, then performs quality-aware adaptive fusion via cascaded channel-spatial attention. The geometry-aware decoupled detection head (Geo-Head) adopts an anchor-free decoupled architecture to jointly predict 2D localization, physical dimensions, and millimeter-level relative elevation in a single forward pass. A multimodal dataset of 3500 spatiotemporally aligned frames is constructed using the NavVis VLX wearable platform, covering five defect categories, with Random Sample Consensus (RANSAC)-derived relative-elevation reference labels independently validated by digital leveling. Experiments show that SDFA-Net achieves 92.9% mAP@0.5 and 63.5% mAP@0.5:0.95 with 18.5 M parameters, improving over the best single-modal baseline by 4.6, 11.0, and 8.7 percentage points in mAP@0.5, mAP@0.5:0.95, and Recall, respectively. Compared with BEVFusion, SDFA-Net achieves higher detection accuracy while maintaining a smaller overall model size and an inference speed of 35 FPS.