This paper proposes an online method for calibrating the orientation of cameras mounted on vehicles. To calibrate the orientation of the target camera relative to the vehicle, we propose using a high-speed vision sensor, focused on the ground, in conjunction with the target camera. First, the high-speed camera's planar motion parallel to ground plane and target camera's motion are estimated by a semi-dense approach and visual odometry method, respectively. Then, the motions are used to calibrate the target camera's orientation through nonlinear optimization based on the invariance constraint of the extrinsic parameters and the nonholonomic constraint of the vehicle. Unlike traditional methods, this approach does not depend on artificial features such as lane markings and utilizes ground information more efficiently, making it applicable in broader scenarios. Simulation and field tests have demonstrated that the target camera orientation calibration errors are approximately 1°, even on a bumpy road, affirming the accuracy and robustness of the proposed method.
Accurate velocity estimation plays a key role in ensuring precise motion control and safe navigation of ground robots. Ground-view event cameras provide a reliable sensing modality for this task. They exploit the static and stable nature of the ground, together with the sensor’s high temporal resolution, to extract motion cues robustly even under challenging environments such as scene dynamics. Building on this observation, this paper proposes a novel velocity estimation method for ground robots using a ground-view event camera, whose application in a ground-looking configuration has received limited attention, and leverages a spiking neural network to process event-based visual information. The neural network exploits its intrinsic temporal dynamics to infer motion directly from ground texture event streams, eliminating the need for long-term event accumulation. The recurrence of output spikes is also integrated into the network to aid in preserving past sequential information. To address the challenge of costly hyperparameter tuning associated with the conventional loss function, we propose a novel geometric loss function that automatically balances translation and rotation by utilizing the differences between the coordinates of events, warped by the predicted and ground-truth motion, as the loss, thereby leading to more balanced learning across outputs and more accurate motion estimation. Experiment results on both synthetic and real-world data demonstrate that the proposed method not only can effectively handle diverse ground surface textures and variations in the camera’s pose relative to the ground, but also generalizes well to real-world scenarios, even when the network is trained exclusively on synthetic data.
Accurate motion estimation and online camera orientation calibration are important for onboard vision systems on ground vehicles. Ground-view sensing is attractive for these tasks because the ground is typically static, close to the vehicle, and continuously observable, but fast ground-relative motion requires high-temporal-resolution sensing. This paper presents a unified framework that uses a ground-view event camera to estimate ground-view camera motion and support online orientation calibration of a target vehicle-mounted camera. The event camera provides high temporal resolution with sparse measurements, making it suitable for fast ground-view sensing. The framework couples online event-based ground-view motion estimation with an improved calibration process, allowing the estimated motion to support calibration and be further refined during calibration. Specifically, ground-view motion is first estimated online from short event windows using a spiking neural network, providing direct short-term motion information from the event stream. The estimated motion is then integrated with target-camera motion and geometric constraints to estimate the target-camera orientation while further refining the ground-view motion. Experiments on real-vehicle data show accurate ground-view motion estimation, improved rotational components through motion refinement, and better target-camera orientation calibration, especially in yaw, while improvements in pitch and roll are less pronounced. These results demonstrate the effectiveness of integrating event-camera-based ground-view motion estimation and online target-camera orientation calibration for ground vehicles.