16 September 2024 in IEEE Transactions on Intelligent Vehicles
Unsupervised monocular depth estimation frameworks have shown promising performance in autonomous driving. However, existing solutions primarily rely on a simple convolutional neural network for ego-motion recovery, which struggles to estimate precise camera poses in dynamic, complicated real-world scenarios. These inaccurately estimated camera poses can inevitably deteriorate the photometric reconstruction and mislead the depth estimation networks with wrong supervisory signals. In this article, we introduce SCIPaD, a novel approach that incorporates spatial clues for unsupervised depth-pose joint learning. Specifically, a confidence-aware feature flow estimator is proposed to acquire 2D feature positional translations and their associated confidence levels. Meanwhile, we introduce a positional clue aggregator, which integrates pseudo 3D point clouds from DepthNet and 2D feature flows into homogeneous positional representations. Finally, a hierarchical positional embedding injector is proposed to selectively inject spatial clues into semantic features for robust camera pose decoding. Extensive experiments and analyses demonstrate the superior performance of our model compared to other state-of-the-art methods. Remarkably, SCIPaD achieves a reduction of 22.2% in average translation error and 34.8% in average angular error for camera pose estimation task on the KITTI Odometry dataset. Our source code is available at mias.group/SCIPaD .
1 January 2026 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Unsupervised learning of depth and ego-motion, two fundamental tasks in 3D perception, has made significant strides in recent years. Nevertheless, existing methods often treat ego-motion estimation as an auxiliary task, typically indiscriminately mixing all motion types when generating supervisory signals. Such designs hinder the incorporation of sufficiently strong geometric constraints into the joint learning framework, thereby limiting its robustness under diverse adverse conditions. This study introduces a discriminative treatment of motion components by leveraging the distinct geometric regularities inherent in their respective rigid flows, which simultaneously benefits both depth and ego-motion estimation. Given consecutive video frames, the network outputs are first employed to align the optical axes and imaging planes of the source and target cameras. Optical flows between the original frames are then transformed through these alignment processes, and their deviations are quantified to impose geometric constraints on each estimated ego-motion component. These alignments further reformulate joint learning into coaxial and coplanar forms, where depth and each translation component can be mutually derived through closed-form geometric relationships, thereby introducing constraints that improve the stability of depth learning. Extensive experiments on multiple public datasets and a newly collected, diverse real-world dataset demonstrate the superior performance of the proposed method, particularly under challenging conditions where existing approaches often fail. Our source code is publicly available at https://mias.group/DiMoDE.