1 May 2023 in IEEE Sensors Journal
Most existing dynamic SLAM methods integrating neural networks require high computational support and pre-defined categories of dynamic objects. This paper proposes an online visual SLAM system without pre-defined dynamic labels for dynamic environments, which is built on ORB-SLAM3. We combine semantic information, depth information and optical flow to distinguish foreground and background and recognize dynamic regions. The foreground points in dynamic areas are regarded as moving points. We also restore static points on moving objects by the average re-projection error between multiple frames to adapt to non-rigid motion and low-dynamic environments. In pose optimization, we define an optimization weight for every point to decrease the negative influence of potential dynamic points. The experiments on TUM RGB-D and Bonn datasets show that OVD-SLAM achieves more accurate and robust localization than other state-of-art dynamic SLAM methods. To further verify our system’s online performance and robustness, we also test it in real dynamic scenes and apply it to an AR application using a handheld RGB-D camera.
1 November 2023 in IEEE Robotics and Automation Letters
3 January 2025 in IEEE Sensors Journal
Camera and IMU are widely used in robotics to achieve accurate and robust pose estimation. However, this fusion relies heavily on sufficient visual feature observations and precise inertial state variables. This paper proposes PLE-SLAM, a real-time visual-inertial SLAM for complex environments, which introduces line features to point-based SLAM and propose an efficient IMU initialization method. Firstly, we use parallel computing methods to extract point-line features and compute descriptors to ensure real-time performance. Adjacent short-line segments are merged into long-line segments for more stable tracking, and isolated short-line segments are directly eliminated. Secondly, to overcome rapid rotation and low texture scenes, we estimate gyroscope bias by tightly coupling rotation pre-integration and 2D point-line observations without 3D point cloud and vision-only rotation estimation. Accelerometer bias and gravity direction are solved by an analytical method, which is more efficient than non-linear optimization. To improve the system’s robustness in complex environments, an improved method of dynamic feature elimination and a solution for loop detection and loop frames pose estimation using CNN and GNN are integrated into the system. The experiment results on public datasets demonstrate that PLE-SLAM achieves more than 20%~50% improvement in localization performance than ORB-SLAM3 and outperforms other state-of-the-art visual-inertial SLAM systems in most environments.