Point cloud registration is a crucial task in computer vision and 3D reconstruction, aiming to align multiple point clouds to achieve globally consistent geometric structures. However, traditional point cloud registration methods face challenges when dealing with low overlap and large-scale point cloud data. To overcome these issues, we propose an end-to-end point cloud registration method called CCAG. The CCAG algorithm leverages the Cross-Convolution Attention module, which combines cross-attention mechanism and depth-wise separable convolution to capture relationships between point clouds and integrate features. Through cross-attention computation, this module establishes associations between point clouds and utilizes depth-wise separable convolution operations to extract local features and spatial relationships. Furthermore, the CCAG algorithm introduces Adaptive Graph Convolution MLP, which dynamically adjusts node representations based on the positions of nodes in the graph structure and features of neighboring nodes, enhancing the expressive power of nodes through MLP. Our algorithm demonstrates competitive performance in multiple benchmark tests, including 3DMatch/3DLoMatch, KITTI, ModelNet/ModelLoNet, and MVP-RG.
Point cloud registration is not only a key step in constructing high-precision three-dimensional maps, but is also of great significance in fields such as autonomous navigation, environmental perception, and robot operation. However, in outdoor environments, point cloud registration tasks face challenges such as complex terrains and object occlusion, leading to significant overlap and incomplete data. To address these challenges, this paper proposes a novel approach that utilizes geometric Transformer for precise point cloud registration. This method employs a learnable geometric position update module that automatically learns and captures the geometric structure and features among point cloud data. Additionally, the algorithm introduces a deeper cross attention module that applies deep convolutional operations on the key and value of cross-attention, enabling the attention mechanism to capture both local spatial structures and global contextual information of the point cloud. Through information interaction, the expressiveness and adaptability of the point cloud registration model can be enhanced. Experimental evaluations on multiple benchmark tests, including 3DMatch/3DLoMatch, KITTI, ModelNet/ModelLoNet and MVP-RG, demonstrate the competitive performance of our algorithm. Compared to the UDPReg and REGTR algorithms, our method demonstrates performance improvements in the RR metric, increasing by 11.3% and 10.8% respectively in the low overlap case.
Point cloud registration technology, by precisely aligning repair components with the original artifacts, can accurately record the geometric shape of cultural heritage objects and generate three-dimensional models, thereby providing reliable data support for the digital preservation, virtual exhibition, and restoration of cultural relics. However, traditional point cloud registration methods face challenges when dealing with cultural heritage data, including complex morphological and structural variations, sparsity and irregularity, and cross-dataset generalization. To address these challenges, this paper introduces an innovative method called Enhancing Point Cloud Registration with Transformer (EPCRT). Firstly, we utilize local geometric perception for positional encoding and combine it with a dynamic adjustment mechanism based on local density information and geometric angle encoding, enhancing the flexibility and adaptability of positional encoding to better characterize the complex local morphology and structural variations of artifacts. Additionally, we introduce a convolutional-Transformer hybrid module to facilitate interactive learning of artifact point cloud features, effectively achieving local–global feature fusion and enhancing detail capture capabilities, thus effectively handling the sparsity and irregularity of artifact point cloud data. We conduct extensive evaluations on the 3DMatch, ModelNet, KITTI, and MVP-RG datasets, and validate our method on the Terracotta Warriors cultural heritage dataset. The results demonstrate that our method has significant performance advantages in handling the complexity of morphological and structural variations, sparsity and irregularity of relic data, and cross-dataset generalization.
26 November 2024 in Artificial Intelligence Review
With the widespread application of large-scale 3D point cloud data in real-world scenarios, efficient and accurate point cloud registration has become a crucial challenge. We propose an end-to-end point cloud registration method based on the Transformer architecture. This method addresses the issues of low overlap and registration in large scenes, exhibiting strong algorithmic versatility and efficiency. We introduce a combination of dynamic position encoding and ternary angular position encoding within the Transformer, effectively enhancing the representation capability of point cloud data and algorithmic generality, thus better tackling point cloud registration challenges in large scenes. Additionally, to enhance the learning capacity of the attention mechanism, we employ an improved cross-attention mechanism that multiplies the softmax with adaptive weights, enabling the model to capture key information within the point cloud more accurately. In the decoding stage, we introduce a multi-scale feature fusion approach that fully exploits the multi-layer information in point cloud data, further improving registration accuracy and robustness. Through the fusion of multi-scale features, we effectively mitigate information loss and handle matching problems between point clouds of varying sizes. Experimental results demonstrate the excellence of our method in addressing low overlap and registration tasks in large scenes, validated across multiple datasets including 3DMatch, ModelNet, KITTI, and MVP-RG.
1 April 2024 in IEEE Transactions on Circuits and Systems for Video Technology
Point cloud registration is a critical issue in 3D reconstruction and computer vision, particularly challenging in cases of low overlap and different datasets, where algorithm generalization and robustness are pressing challenges. In this paper, we propose a point cloud registration algorithm called Neighborhood Multi-compound Transformer (NMCT). To capture local information, we introduce Neighborhood Position Encoding for the first time. By employing a nearest neighbor approach to select spatial points, this encoding enhances the algorithm’s ability to extract relevant local feature information and local coordinate information from dispersed points within the point cloud. Furthermore, NMCT utilizes the Multi-compound Transformer as the interaction module for point cloud information. In this module, the Spatial Transformer phase engages in local-global fusion learning based on Neighborhood Position Encoding, facilitating the extraction of internal features within the point cloud. The Temporal Transformer phase, based on Neighborhood Position Encoding, performs local position-local feature interaction, achieving local and global interaction between two point cloud. The combination of these two phases enables NMCT to better address the complexity and diversity of point cloud data. The algorithm is extensively tested on different datasets (3DMatch, ModelNet, KITTI, MVP-RG), demonstrating outstanding generalization and robustness.
As an important representative of ancient Chinese cultural heritage, the classification of Terracotta Warriors point cloud data aids in cultural heritage preservation and digital reconstruction. However, these data face challenges such as complex morphological and structural variations, sparsity, and irregularity. This paper proposes a method named Multi-scale Local Geometric Transformer-Mamba (MLGTM) to improve the accuracy and robustness of Terracotta Warriors point cloud classification tasks. To effectively capture the geometric information of point clouds, we introduce local geometric encoding, including local coordinates and feature information, effectively capturing the complex local morphology and structural variations of the Terracotta Warriors and extracting representative local features. Additionally, we propose a multi-scale Transformer-Mamba information aggregation module, which employs a dual-branch Transformer with a Mamba structure and finally aggregates them on multiple scales to effectively handle the sparsity and irregularity of the Terracotta Warriors point cloud data. We conducted experiments on several datasets, including the ModelNet40, ScanObjectNN, ShapeNetPart, ETH, and 3D Terracotta Warriors fragment datasets. The results show that our method significantly improves the classification task of Terracotta Warriors point clouds, demonstrating strong accuracy.