Local feature descriptors are a critical problem in computer vision; the majority of current approaches find it difficult to achieve a balance between descriptiveness, robustness, compactness, and efficiency. This paper proposes the local discrete feature histogram (LDFH), a novel local feature descriptor, as a solution to this problem. The LDFH descriptor is constructed based on a robust local reference frame (LRF). It partitions the local space based on radial distance and calculates three geometric features, including the normal deviation angle, polar angle, and normal lateral angle, in each subspace. These features are then discretized to generate three feature statistical histograms, which are combined using a weighted fusion strategy to generate the final LDFH descriptor. Experiments on public datasets demonstrate that, compared with the existing methods, LDFH strikes an excellent balance between descriptiveness, robustness, compactness, and efficiency, making it suitable for various scenes and sensor datasets.
Aiming at the problem that the range profile of the current array lidar has a low resolution and contains few target details and little edge information, a super-resolution reconstruction method based on projection onto convex sets (POCS) combining the Lucas–Kanade (LK) optical flow method with a Gaussian pyramid was proposed. Firstly, the reference high-resolution range profile was obtained by the nearest neighbor interpolation of the single low-resolution range profile. Secondly, the LK optical flow method was introduced to achieve the motion estimation of low-resolution image sequences, and the Gaussian pyramid was used to perform multi-scale correction on the estimated vector, effectively improving the accuracy of motion estimation. On the basis of data consistency constraints, gradient constraints were introduced based on the distance value difference between the target edge and the background to enhance the reconstruction ability of the target edge. Finally, the residual between the estimated distance and the actual distance was calculated, and the high-resolution reference range profile was iteratively corrected by using the point spread function according to the residual. Bilinear interpolation, bicubic interpolation, POCS, POCS with adaptive correction threshold, and the proposed method were used to reconstruct the range profile of the datasets and the real datasets. The effectiveness of the proposed method was verified by the range profile reconstruction effect and objective evaluation index. The experimental results show that the index of the proposed method is improved compared to the interpolation method and the POCS method. In the redwood-3dscan dataset experiments, compared to the traditional POCS, the average gradient (AG) of the proposed method is increased by at least 8.04%, and the edge strength (ES) is increased by at least 4.84%. In the real data experiments, compared to the traditional POCS, the AG of the proposed method is increased by at least 5.85%, and the ES is increased by at least 7.01%, which proves that the proposed method can effectively improve the resolution of the reconstructed range map and the quality of the detail edges.
LiDAR point cloud object recognition plays an important role in robotics, remote sensing, and automatic driving. However, it is difficult to fully represent the object feature information only by using the point cloud information. To address this challenge, we proposed a point cloud object recognition method that uses intensity image compensation, which is highly descriptive and computationally efficient. First, we constructed the local reference frame for the point cloud. Second, we proposed a method to calculate the deviation angle between the normal vector and local reference frame in the local neighborhood of the point cloud. Third, we extracted the contour information of the object from the intensity image corresponding to the point cloud, carried out Discrete Fourier Transform on the distance sequence between the barycenter of the contour and each point of the contour, and took the obtained result as Discrete Fourier Transform contour feature of the object. Finally, we repeated the above steps for the existing prior data and marked the obtained results as the feature information of the corresponding object to build a model library. We can recognize an unknown object by calculating the feature information of the object to be recognized and matching the feature information with the model library. We rigorously tested the proposed method with avalanche photon diode array LiDAR data and compared the results with those of four other methods. The experimental results show that the proposed method is superior to the comparison method in terms of description and computational efficiency and that it can meet the needs of practical applications.
3D single object tracking within LIDAR point clouds is a pivotal task in computer vision, with profound implications for autonomous driving and robotics. However, existing methods, which depend solely on appearance matching via Siamese networks or utilize motion information from successive frames, encounter significant challenges. Issues such as similar objects nearby or occlusions can result in tracker drift. To mitigate these challenges, we design an innovative spatio-temporal bi-directional cross-frame distractor filtering tracker, named STMD-Tracker. Our first step involves the creation of a 4D multi-frame spatio-temporal graph convolution backbone. This design separates KNN graph spatial embedding and incorporates 1D temporal convolution, effectively capturing temporal fluctuations and spatio-temporal information. Subsequently, we devise a novel bi-directional cross-frame memory procedure. This integrates future and synthetic past frame memory to enhance the current memory, thereby improving the accuracy of iteration-based tracking. This iterative memory update mechanism allows our tracker to dynamically compensate for information in the current frame, effectively reducing tracker drift. Lastly, we construct spatially reliable Gaussian masks on the fused features to eliminate distractor points. This is further supplemented by an object-aware sampling strategy, which bolsters the efficiency and precision of object localization, thereby reducing tracking errors caused by distractors. Our extensive experiments on KITTI, NuScenes and Waymo datasets demonstrate that our approach significantly surpasses the current state-of-the-art methods.