The automatic detection and identification of fish from underwater videos is of great significance for fishery resource assessment and ecological environment monitoring. However, due to the poor quality of underwater images and unconstrained fish movement, traditional hand-designed feature extraction methods or convolutional neural network (CNN)-based object detection algorithms cannot meet the detection requirements in real underwater scenes. Therefore, to realize fish recognition and localization in a complex underwater environment, this paper proposes a novel composite fish detection framework based on a composite backbone and an enhanced path aggregation network called Composited FishNet. By improving the residual network (ResNet), a new composite backbone network (CBresnet) is designed to learn the scene change information (source domain style), which is caused by the differences in the image brightness, fish orientation, seabed structure, aquatic plant movement, fish species shape and texture differences. Thus, the interference of underwater environmental information on the object characteristics is reduced, and the output of the main network to the object information is strengthened. In addition, to better integrate the high and low feature information output from CBresnet, the enhanced path aggregation network (EPANet) is also designed to solve the insufficient utilization of semantic information caused by linear upsampling. The experimental results show that the average precision (AP) 0.5:0.95 , AP 50 and average recall (AR) max=10 of the proposed Composited FishNet are 75.2%, 92.8% and 81.1%, respectively. The composite backbone network enhances the characteristic information output of the detected object and improves the utilization of characteristic information. This method can be used for fish detection and identification in complex underwater environments such as oceans and aquaculture.
In intensive aquaculture, the number of fish in a shoal can provide valuable input for the development of intelligent production management systems. However, the traditional artificial sampling method is not only time consuming and laborious, but also may put pressure on the fish. To solve the above problems, this paper proposes an automatic fish counting method based on a hybrid neural network model to realize the real-time, accurate, objective, and lossless counting of fish population in far offshore salmon mariculture. A multi-column convolution neural network (MCNN) is used as the front end to capture the feature information of different receptive fields. Convolution kernels of different sizes are used to adapt to the changes in angle, shape, and size caused by the motion of fish. Simultaneously, a wider and deeper dilated convolution neural network (DCNN) is used as the back end to reduce the loss of spatial structure information during network transmission. Finally, a hybrid neural network model is constructed. The experimental results show that the counting accuracy of the proposed hybrid neural network model is up to 95.06%, and the Pearson correlation coefficient between the estimation and the ground truth is 0.99. Compared with CNN- and MCNN-based methods, the accuracy and other evaluation indices are also improved. Therefore, the proposed method can provide an essential reference for feeding and other breeding operations.
13 October 2023 in Expert Systems with Applications
Sea cucumber manual monitoring and fishing present various issues, including high expense and high risk. Meanwhile, compared to underwater bionic robots, employing autonomous underwater robots for sea cucumber monitoring and capture also has drawbacks, including low propulsion efficiency and significant noise. Therefore, this paper is concerned with the design of a robotic manta ray for sea cucumber recognition, localization, and approach. First, the developed robotic manta ray prototype and the system framework applied to real-time target search are elaborated. Second, by improved YOLOv5 object detection and binocular stereo-matching algorithms, precise recognition and localization of sea cucumbers are achieved. Thirdly, the motion controller is proposed for autonomous 3D monitoring tasks such as depth control, direction control, and target approach motion. Finally, the capabilities of the robot are validated through a series of measurements. Experimental results demonstrate that the improved YOLOv5 object detection algorithm achieves detection accuracies (mAP@0.5) of 88.4% and 94.5% on the URPC public dataset and self-collected dataset, respectively, effectively recognizing and localizing sea cucumbers. Control experiments were conducted, validating the effectiveness of the robotic manta ray’s motion toward sea cucumbers. These results highlight the robot’s capabilities in visual perception, target localization, and approach and lay the foundation to explore a novel solution for intelligent monitoring and harvesting in the aquaculture industry.