9 November 2023 in IEEE Robotics and Automation Letters
Accurately localization between multi-robots is crucial for many underwater applications, such as tracking, convoying and subsea intervention tasks. 6D pose estimation is a fundamental task that enables precise object localization in 3D space with full six degrees of freedom. However, one critical challenge is the lack of available large-scale datasets due to the unbearable cost of labelled data collection. To overcome this difficulty, we propose a benchmark dataset, ROV6D, for 6D pose estimation of remotely operated vehicles (ROVs). The training subset consists of a large number of synthetic images with 6D pose ground truth for ROVs. These synthetic images are generated using BlenderProc and further rendered with the underwater neural rendering (UWNR) strategy to enhance their realism. The testing subsets cover different real-world scenarios, including the Pool subset and Maoming subset, focusing on challenging cases that involve partial occlusion and low visibility. Diverse recent methods are evaluated on the constructed dataset. The results show that methods based on dense coordinates currently perform best, outperforming both the keypoint-based method and the refinement-based method. Our dataset will be made publicly available soon.
20 April 2022 in Optics Express
Underwater optical wireless communication (UOWC) has received increasing attention due to its distinctive characteristics such as high bandwidth and low latency. However, the UOWC link is usually vulnerable to water flow, underwater turbulence and the terminals’ own vibration. Thus, to maintain a stable transmission link, an accurate tracking method is essential for UOWC systems. In this paper, a monocular vision aided optical tracking method is proposed, where the deviation degree of the laser spot is employed to realize autonomous real-time alignment of the receiver with the transmitter. Experimental results verify that with the proposed tracking method, the bit error ratio can be ensured to be below the forward error correction (FEC) limit of 3.8×10−3 even under strong disturbance for the practical UOWC system.
25 September 2024 in arXiv
Although methods for estimating the pose of objects in indoor scenes have achieved great success, the pose estimation of underwater objects remains challenging due to difficulties brought by the complex underwater environment, such as degraded illumination, blurring, and the substantial cost of obtaining real annotations. In response, we introduce FAFA, a Frequency-Aware Flow-Aided self-supervised framework for 6D pose estimation of unmanned underwater vehicles (UUVs). Essentially, we first train a frequency-aware flow-based pose estimator on synthetic data, where an FFT-based augmentation approach is proposed to facilitate the network in capturing domain-invariant features and target domain styles from a frequency perspective. Further, we perform self-supervised training by enforcing flow-aided multi-level consistencies to adapt it to the real-world underwater environment. Our framework relies solely on the 3D model and RGB images, alleviating the need for any real pose annotations or other-modality data like depths. We evaluate the effectiveness of FAFA on common underwater object pose benchmarks and showcase significant performance improvements compared to state-of-the-art methods. Code is available at github.com/tjy0703/FAFA.
31 October 2026 in IEEE Robotics and Automation Letters