This paper presents a new approach to address the challenge of combining ground-based LiDAR data with satellite images for cross-view image geo-localization. The task is to figure out the position and orientation of the LiDAR within the given satellite image. While previous research has mainly focused on imagery, the integration of ground-based point clouds with satellite images has been limited due to significant differences in modalities. To release this limitation, we propose a novel method that utilizes the road structure as a consistent reference between satellite images and ground LiDAR data for accurate geo-localization. Our methodology encompasses the extraction of road structures from both point clouds and satellite images. To extract road structures from point clouds, we leverage the enhanced viewpoint beam model, which effectively captures the spatial characteristics of ground landmarks. In addition, we utilize fractional-order differential-based super-resolution technology for satellite images to improve road structure detection, ensuring reliable performance across different altitudes. Following this, our approach involves matching road structures from the ground and satellite views, simplifying the localization process to a template-matching task. Consequently, we successfully address the challenge of accurately determining the 3-DoF pose of the LiDAR within the satellite image context. Experimental results demonstrate that the proposed method achieves state-of-the-art performance in geo-localization, outperforming comparable methods. Additionally, the approach shows versatility across various altitudes.
Road intersection is a kind of important navigation landmark, while existing detection methods exhibit clear limitations in terms of their robustness and efficiency. A real-time algorithm for road intersection detection and location in large-scale sparse point clouds is proposed in this paper. Different from traditional approaches, our method establishes the augmented viewpoints beam model to perceive the road bifurcation structure. Explicitly, the spatial features from point clouds are jointly extracted in various viewpoints in front of the robot. In addition, the evaluation metrics are designed to self-assess the quality of detection results, enabling our method to optimize the detection process in real time. Considering the scarcity of datasets for intersection detection, we also collect and annotate a VLP-16 point cloud dataset specifically for intersections, called NCP-Intersection. Quantitative and qualitative experiments demonstrate that the proposed method performs favorably against the other parallel methods. Specifically, our method performs an average precision exceeding 90% and an average processing time of approximately 88 ms/frame.
Remote sensing image analysis is crucial for many research fields, yet acquiring frequent high-quality remote sensing imagery is not always feasible due to prohibitive costs and logistical efforts. As a solution, ground-to-satellite cross-view image generation has emerged as a promising approach for synthesizing remote sensing images from readily available ground sensor data. However, existing methods face two critical limitations that bottleneck their performance, including instability in object structural attributes in ground views and reduced image fidelity and consistency due to environmental occlusions. To address these challenges, this paper proposes a geometrically constrained controllable generation model specifically tailored for remote sensing image generation, called GCCG-RSI. To overcome the limitation of structural instability, GCCG-RSI introduces LiDAR ranging accuracy to constrain the geometric shapes of the generated image. To mitigate occlusion-induced fidelity issues, GCCG-RSI employs an attention mechanism to derive a unified fused representation that integrates texture and spatial structure information. The representation is utilized as a conditional control signal to guide the diffusion model in accurately synthesizing remote sensing imagery. Experimental results demonstrate that, compared with state-of-the-art methods, GCCG-RSI infers remote sensing images with superior realism and fidelity using ground-view images and point clouds with limited perspective. Overall, the proposed method provides an effective image preprocessing approach that contributes to significantly narrowing the domain discrepancy between ground and satellite images, thereby facilitating the execution of downstream tasks.