In this article, we present a novel underwater dataset collected from several field trials within the EU FP7 project “Cognitive autonomous diving buddy (CADDY)”, where an Autonomous Underwater Vehicle (AUV) was used to interact with divers and monitor their activities. To our knowledge, this is one of the first efforts to collect a large public dataset in underwater environments with the purpose of studying and boosting object classification, segmentation and human pose estimation tasks. The first part of the dataset contains stereo camera recordings (≈10 K) of divers performing hand gestures to communicate with an AUV in different environmental conditions. The gestures can be used to test the robustness of visual detection and classification algorithms in underwater conditions, e.g., under color attenuation and light backscatter. The second part includes stereo footage (≈12.7 K) of divers free-swimming in front of the AUV, along with synchronized measurements from Inertial Measurement Units (IMU) located throughout the diver’s suit (DiverNet), which serve as ground-truth for human pose and tracking methods. In both cases, these rectified images allow the investigation of 3D representation and reasoning pipelines from low-texture targets commonly present in underwater scenarios. This work describes the recording platform, sensor calibration procedure plus the data format and the software utilities provided to use the dataset.

This paper describes an underwater acoustic sensor network consisting of a heterogeneous robotic swarm used for long-term monitoring of underwater environments. The swarm consists of a large number of underwater robots acting as sensor nodes with limited movement capabilities, and a few surface robots aiding them in accomplishing underwater monitoring scenarios. Main interactions between two types of robots include underwater sensor deployment and relocation, energy and data exchange, and acoustic localisation aiding. Hardware capabilities of each vehicle are described in detail. Inter-agent communication is split into two layers: surface and underwater communication. Surface communication utilises wireless communication using WiFi routers configured for decentralised routing. Underwater communication mainly uses acoustic communication which, when used within a large swarm, poses a challenging task because of high probability of interference and data loss. The acoustic communication protocol used to prevent these issues is presented in detail. Finally, more complex functionalities of the robotic swarm are presented, including several results from real-life experiments.

Notwithstanding intensive research and many scientific advances, diagnosing autism spectrum disorders remains a slow and tedious process. Due to the absence of any physiological tests, the outcome depends solely on the expertise of the clinician, which takes years to acquire. Complicating the matter further, research has shown that inter-rater reliability can be very low, even among experienced clinicians. As an attempt to facilitate the diagnostic process and make it more objective, this paper proposes a robot-assisted diagnostic protocol. The expected benefit of using a robot is twofold: the robot always performs its actions in a predictable and consistent way, and it can use its sensors to catch aspects of a child's behavior that a human examiner can miss. In this paper, we describe four tasks from the widely accepted ADOS protocol, that have been adapted to make them suitable for the Aldebaran Nao humanoid robot. These tasks include evaluating the child's response to being called by name, symbolic and functional imitation, joint attention and assessing the child's ability to simultaneously communicate on multiple channels. All four tasks have been implemented on the robot's onboard computer and are performed autonomously. As the main contribution of the paper, we present the results of the initial batch of four clinical trials of the proposed robot assisted diagnostic protocol, performed on a population of preschool children. The results of the robot's observations are benchmarked against the findings of experienced clinicians. Emphasis is placed on evaluating robot performance, in order to assess the feasibility of a robot eventually becoming an assistant in the diagnostic process. The obtained results indicate that the use of robots as autism diagnostic assistants is a promising approach, but much work remains to be done before they become useful diagnostic tools.

Within the EU FP7 project “Cognitive autonomous diving buddy (CADDY)”, work has been made to assist and monitor divers through Autonomous Underwater Vehicles (AUVs) during their long underwater expeditions. To achieve this goal, one milestone is to give the AUV the capability to track the diver's whereabouts at all times. Inertial sensors are mounted on the diver's body to transmit acoustically his relative position and orientation to the AUV using an Ultra-Short Baseline (USBL) system. However, the acoustic system is prone to give erroneous data depending on the surrounding geography, modems alignment and sensors calibration, plus its low transmission rate does not allow real time performance. To overcome these drawbacks and complement the acoustic set-up, this paper presents a general framework to detect and estimate the diver's body pose based on generated point clouds from a stereo camera. Our method is based on a Long Short-Term Memory Recurrent Neural Network (LSTM-RNN) that captures the temporal relations between global point cloud descriptors as they change with the diver movements. Since the analysis is made on time sequences rather than on one-shot visual information, the framework is robust against the distortions and poor quality typical in underwater while still providing real time performance. We focus on the description of the image-processing and LSTM-RNN pipeline, as well on its validation with a dataset created during several field trial experiments.