It is challenging to obtain accurate trajectories with standard camera visual odometry (VO) in environments with weak textures and light variations. This article introduces a novel approach [cubic B-spline-based visual–inertial odometry (CB-VIO)], using the dynamic and active-pixel vision sensor (DAVIS) camera. In the proposed CB-VIO method, the matching mechanism between images and events is designed to improve the success rate of event tracking, based on which the template points from events are utilized to construct a cubic B-spline-based event tracking model within a continuous spatiotemporal window [under SE(3)]. Based on the tracking model to interpolate poses at any time point, the inertial measurement unit (IMU) measurement model is constructed to achieve data fusion from asynchronous and synchronous sensors with different rates. Compared with the Spline-visual–inertial odometry (VIO) and the event-based VO (EVO), the proposed continuous spatiotemporal window method can effectively solve the data association for EVO and the continuous-time trajectory with fixed-time intervals for Spline-VIO. The experimental results are compared on public datasets of multiple different scenes, which demonstrate the superior performance of CB-VIO in terms of accuracy and robustness (translation error ${\leq }1.3\%$ and rotation error ${\leq }2^{\circ} $ ).
As a new type of vision sensor, the dynamic and active-pixel vision sensor (DAVIS) outputs image intensity and asynchronous event streams in the same pixel array. We present a novel visual odometry algorithm based on the DAVIS in this paper. The Harris detector and the Canny detector are utilized to extract an initialized tracking template from the image sequence. The spatio-temporal window is selected by determining the life cycle of the asynchronous event streams. The alignment on timestamps is achieved by tracking the motion relationship between the template and events within the window. A contrast maximization algorithm is adopted for the estimation of the optical flow. The IMU data are used to calibrate the position of the templates during the update process that is exploited to estimate camera trajectories via the ICP algorithm. In the end, the proposed visual odometry algorithm is evaluated in several public object tracking scenarios and compared with several other algorithms. The tracking results show that our visual odometry algorithm can achieve better accuracy and lower latency tracking trajectory than other methods.