Estimating depth from a single underwater image is one of the main tasks of underwater visual perception. However, data-driven underwater depth estimation methods have long been challenging to make breakthroughs due to the difficulty of obtaining a large number of true-value references. This is partly due to the high cost of acquisition equipment, which is difficult to be applied to diverse ocean scenes by a wide range of users, and therefore sample diversity is difficult to guarantee; on the other hand, manual annotation of dense depth relationships is almost impossible to achieve. In this paper, we establish a new underwater relative depth estimation benchmark, namely SUIM-SDA, by extending the SUIM dataset with more than 6,000 manually annotated depth trendlines, 25 million pixels with paired depth-ranking labels and 14 million depth-ranked pixel pairs. Using the sparse depth relation annotation provided by SUIM-SDA and the semantic information provided by SUIM, we design a new multi-stage multi-task learning framework to predict a dense relative depth map for a single underwater image. Comprehensive comparison and ablation study on the publicly available dataset and our new benchmark demonstrate the effectiveness of the proposed weakly-supervised strategy for dense relative depth estimation. The new benchmark, source code, and trained models are available on the project home page: https://wangxy97.github.io/WsUIDNet.
Purpose: Developing general closed-form solutions for six-degrees-of-freedom (DOF) serial robots is a significant challenge. This paper thus aims to present a general solution for six-DOF robots based on the product of exponentials model, which adapts to a class of robots satisfying the Pieper criterion with two parallel or intersecting axes among its first three axes. Design/methodology/approach: The proposed solution can be represented as uniform expressions by using geometrical properties and a modified Paden–Kahan sub-problem, which mainly adopts the screw theory. Findings: A simulation and experiments validated the correctness and effectiveness of the proposed method (general resolution for six-DOF robots based on the product of exponentials model). Originality/value: The Rodrigues rotation formula is additionally used to turn the complex problem into a solvable trigonometric function and uniformly express six solutions using two formulas.
19 September 2023 in Expert Systems with Applications
Depth estimation plays a pivotal role in various applications, including autonomous driving and robot navigation. In contrast to depth estimation using multiple images, such as stereo depth perception, inferring depth relations from a monocular camera is notably more challenging yet highly valuable. Traditionally, convolutional neural networks with residual structures have been extensively employed for this task, but they inherently constrain the model’s feature extraction capabilities. Inspired by HorNet, in this paper, we propose a novel self-supervised monocular depth estimation framework based on high-order spatial interactions, referred to as the Hor-Depth. Furthermore, the Hor-Depth improves feature fusion efficiency in the depth network decoder by incorporating the attentional feature fusion module based on first-order spatial interaction, leading to more refined predicted disparity maps. To address issues of loss fluctuations and training instability, we introduce a progressive scale-weight adjustment strategy-based loss function. This strategy applies varying constraints to the model at different training stages, effectively reducing training fluctuations and mitigating outliers that significantly deviate from the predicted values. The proposed approach demonstrates exceptional performance in self-supervised monocular depth estimation, surpassing certain stereo supervised or monocular supervised methods, as evidenced by its impressive results on the KITTI Eigen split benchmark.
Depth information plays an important role in the vision‐related activities of robots and autonomous vehicles. An effective method to obtain 3D scene information is self‐supervised monocular depth estimation, which utilizes large and diverse monocular video datasets during the training process without the need for ground‐truth data. A novel multi‐task learning strategy that uses semantic information to guide the monocular depth estimation method while maintaining self‐supervision is proposed. An improved differential direct visual odometer (DDVO) combined with Pose‐Net is applied for achieving better pose prediction. Minimum reprojection loss with auto‐masking and semantic masking is used to remove the effects of low‐texture areas and moving dynamic‐class objects within scenes. Concurrently, the semantic masking is introduced into the DDVO pose predictor to filter moving objects and reduce the matching error between monocular sequence frames. In addition, PackNet is employed as the backbone of multi‐task learning to further improve the accuracy of deep prediction. The proposed method produces state‐of‐the‐art results for monocular depth estimation on the KITTI Eigen split benchmark, even outperforming supervised methods that have been trained using ground‐truth depth.