13 November 2013 in The International Journal of Robotics Research
The exploration of dangerous environments such as underwater coral reefs and shipwrecks is a difficult and potentially life-threatening task for humans, which naturally makes the use of an autonomous robotic system very appealing. This paper presents such an autonomous system, which is capable of autonomous exploration, and shows its use in a series of experiments to collect image data in challenging underwater marine environments. We present novel contributions on three fronts. First, we present an online topic-modeling-based technique to describe what is being observed using a low-dimensional semantic descriptor. This descriptor attempts to be invariant to observations of different corals belonging to the same species, or observations of similar types of rocks observed from different viewpoints. Second, we use the topic descriptor to compute the surprise score of the current observation. This is done by maintaining an online summary of observations thus far, and then computing the surprise score as the distance of the current observation from the summary in the topic space. Finally, we present a novel control strategy for an underwater robot that allows for intelligent traversal, hovering over surprising observations, and swimming quickly over previously seen corals and rocks.
26 September 2015 in Autonomous Robots
1 March 2023 in International Journal of Computer Vision
In-situ visual observations of marine organisms is crucial to developing behavioural understandings and their relations to their surrounding ecosystem. Typically, these observations are collected via divers, tags, and remotely-operated or human-piloted vehicles. Recently, however, autonomous underwater vehicles equipped with cameras and embedded computers with GPU capabilities are being developed for a variety of applications, and in particular, can be used to supplement these existing data collection mechanisms where human operation or tags are more difficult. Existing approaches have focused on using fully-supervised tracking methods, but labelled data for many underwater species are severely lacking. Semi-supervised trackers may offer alternative tracking solutions because they require less data than fully-supervised counterparts. However, because there are not existing realistic underwater tracking datasets, the performance of semi-supervised tracking algorithms in the marine domain is not well understood. To better evaluate their performance and utility, in this paper we provide (1) a novel dataset specific to marine animals located at http://warp.whoi.edu/vmat/, (2) an evaluation of state-of-the-art semi-supervised algorithms in the context of underwater animal tracking, and (3) an evaluation of real-world performance through demonstrations using a semi-supervised algorithm on-board an autonomous underwater vehicle to track marine animals in the wild.