"Fast track article for IS&T International Symposium on Electronic Imaging 2019: Color Imaging XXIV: Displaying, Processing, Hardcopy, and Applications proceedings."
Monocular cameras and multibeam imaging sonars are common sensors of Unmanned Underwater Vehicles (UUV). In this paper, we propose a new method for calibrating a hybrid sonar–vision system. This method is based on motion comparisons between both images and allows us to compute the transformation matrix between the camera and the sonar and to estimate the camera’s focal length. The main advantage of our method lies in performing the calibration without any specific calibration pattern, while most other existing methods use physical targets. In this paper, we also propose a new sonar–vision dataset and use it to prove the validity of our calibration method.
The way catadioptric images are acquired implies that they present radial distortions. Therefore, classical processing may not be suitable. This statement will be illustrated by considering edge detection matter. Classical edge detectors usually consist in three steps : gradient computation, maximization and thresholding. The two lasts steps use pixels neighborhood concept. On the opposite of perspective images where pixel neighborhood is intuitive, catadioptric images present radial resolution changes. Then, the size and shape of pixel neighborhood have to be depending on pixel location. This article presents a new gradient estimation approach based on non-additive kernels. This technique is adapted to catadioptric images and also provides a natural threshold discarding the arbitrary thresholding step.
In this paper, we present a new stereo vision-based system and its efficient hardware implementation for real-time underwater environments exploration throughout 3D sparse reconstruction based on a number of feature points. The proposed underwater 3D shape reconstruction algorithm details are presented. The main concepts and advantages are discussed and comparison with existing systems is performed. In order to achieve real-time video constraints, a hardware implementation of the algorithm is performed using Xilinx System Generator. The pipelined stereo vision system has been implemented using Field Programmable Gate Arrays (FPGA) technology. Both timing constraints and mathematical operations precision have been evaluated in order to validate the proposed hardware implementation of our system. Experimental results show that the proposed system presents high accuracy and execution time performances.