To ensure long-term space missions, an autonomous localization and mapping system for lunar rovers is demanded. While the target-oriented localization and mapping problem can be solved through state-of-the-art methods, they greatly rely on human-in-loop remote operations, posing several challenges for the visual system of a rover when operating in a distant, unknown, and feature-sparse lunar environment. This paper presents a SAM-augmented target-oriented SLAM framework that enables rovers to estimate the relative distance to the target on the lunar surface, thus ensuring the safety of the exploration task. Based on the proposed point-prompted object instance extraction pipeline, object correspondences are firstly predicted in the middle-end of Lo-SLAM, where reliable semantic constraints are robustly associated cross image frames. We then maintain camera-object relative positioning between the camera and target in the visual odometry of Lo-SLAM. Meanwhile, a multi-level mapping and representation framework is proposed to keep the target explicit and characterized in different subtasks. Extensive experiments are conducted on our dataset, SePT (i.e., Stereo Planetary Tracks). Results show that the proposed Lo-SLAM is validated on challenging lunar scenarios with dramatic viewpoints and object scale changes. The average pose errors are 0.36 meters in centroid and 0.27 meters in scale, and the average object-centric trajectory error is 0.49% or so. An open-source dataset has been released at https://github.com/miaTian99/SePT_Stereo-Planetary-Tracks.
Spacecraft component segmentation is one of the key technologies which enables autonomous navigation and manipulation for non-cooperative spacecraft in OOS (On-Orbit Service). While most of the studies on spacecraft component segmentation are based on 2D image segmentation, this paper proposes spacecraft component segmentation methods based on 3D point clouds. Firstly, we propose a multi-source 3D spacecraft component segmentation dataset, including point clouds from lidar and VisualSFM (Visual Structure From Motion). Then, an improved PointNet++ based 3D component segmentation network named 3DSatNet is proposed with a new geometrical-aware FE (Feature Extraction) layers and a new loss function to tackle the data imbalance problem which means the points number of different components differ greatly, and the density distribution of point cloud is not uniform. Moreover, when the partial prior point clouds of the target spacecraft are known, we propose a 3DSatNet-Reg network by adding a Teaser-based 3D point clouds registration module to 3DSatNet to obtain higher component segmentation accuracy. Experiments carried out on our proposed dataset demonstrate that the proposed 3DSatNet achieves 1.9% higher instance mIoU than PointNet++_SSG, and the highest IoU for antenna in both lidar point clouds and visual point clouds compared with the popular networks. Furthermore, our algorithm has been deployed on an embedded AI computing device Nvidia Jetson TX2 which has the potential to be used on orbit with a processing speed of 0.228 s per point cloud with 20,000 points.
To ensure long-term space missions, an autonomous visual navigation system for lunar rovers supporting selfexploration is demanded. While the object-centric localization and mapping problem can be solved through state-of-the-art methods, they greatly rely on human-in-loop remote operations, posing several challenges for the visual system of a rover when operating in a distant, unknown, and feature-sparse lunar environment. This paper presents a SAM-augmented object-centric SLAM framework which enable rovers to estimate the relative distance to the target on lunar surface, thus ensuring the safety of exploration task. Based on the feature-matching baseline and an auto-label segmentation approach, a prompted-based object instance extraction pipeline is first proposed to predict object correspondences at a pixel level. We then integrate with front-end outputs in the middle-end of SLAM to tightly associate reliable object-centric constraints between image frames. Moreover, the data association in LO-SLAM maintains robust camera-object relative position estimation between the camera and target object. Extensive experiments are conducted on our dataset, Stereo Planetary Tracks (SePT). Results show that the proposed LO-SLAM is validated on challenging lunar scenarios with dramatic viewpoints and object scale changes. The average pose errors are less than 0.37 meters in centroid, and the average object-centric trajectory error is less than 0.49%. An open-source dataset has been released at https://github.com/miaTian99/SePT_Stereo-Planetary-Tracks.
1 January 2026 in IEEE Transactions on Geoscience and Remote Sensing