Caring for dolphins is a delicate process that requires experienced caretakers to pay close attention to their behavioral characteristics. However, caretakers may sometimes lack experience or not be able to give their full attention, which can lead to misjudgment or oversight. To address these issues, a dolphin behavior analysis system has been designed to assist caretakers in making accurate assessments. This study utilized image preprocessing techniques to reduce sunlight reflection in the pool and enhance the outline of dolphins, making it easier to analyze their movements. The dolphins were divided into 11 key points using an open-source tool called DeepLabCut, which accurately helped mark various body parts for skeletal detection. The AquaAI Dolphin Decoder (ADD) was then used to analyze six dolphin behaviors. To improve behavior recognition accuracy, the long short-term memory (LSTM) neural network was introduced. The ADD and LSTM models were integrated to form the ADD-LSTM system. Several classification models, including unidirectional and bidirectional LSTM, GRU, and SVM, were compared. The results showed that the ADD module combined with a double-layer bidirectional LSTM method achieved high accuracy in dolphin behavior analysis. The accuracy rates for each behavior exceeded 90%.
Traditional animal behavior recognition models require extensive labeled datasets and frequent retraining, limiting their adaptability across species and environments. Additionally, existing systems rely on predefined behavior categories, making it difficult for researchers to customize recognition models to specific behavioral patterns relevant to their studies. Different research fields, such as animal welfare monitoring, conservation, and behavioral ecology, often require distinct behavior classifications, yet current systems lack the flexibility to accommodate these varying needs. This study aims to develop an expandable and user-driven animal behavior recognition system utilizing DeepLabCut for pose estimation and a BiLSTM-based classification model. By integrating Dynamic Adaptive Elastic Weight Consolidation (DA-EWC), the system enables incremental learning, allowing new behaviors to be added with minimal annotation while preserving previously learned behaviors. The proposed system is trained on dolphin behavior datasets using DeepLabCut for keypoint extraction and a BiLSTM model for sequence classification. Additionally, a user-friendly interface is implemented to facilitate behavior annotation and efficient model updates. The proposed system achieves 96.5% accuracy in behavior classification, surpassing conventional models such as Faster R-CNN. Compared to standard EWC, DA-EWC maintains an average of 8.3% higher accuracy when incorporating new behaviors. Furthermore, the system reduces annotation efforts by 9.3%, enabling users to expand behavior categories efficiently. This expandable behavior recognition system significantly enhances adaptability and efficiency in animal behavior monitoring. By supporting user-driven incremental learning, it provides a scalable solution for behavior analysis across different research domains, addressing the need for customizable and evolving behavior classification.
Caring for dolphins is a delicate process that requires experienced caretakers to pay close attention to their behavioral characteristics. However, caretakers may sometimes lack experience or not be able to give their full attention, which can lead to misjudgment or oversight. To address these issues, a dolphin behavior analysis system has been designed to assist caretakers in making accurate assessments. The study utilized image preprocessing techniques to reduce sunlight reflection in the pool and enhance the outline of dolphins, making it easier to analyze their movements. The dolphins were divided into 11 keypoints using an open-source tool called DeepLabCut, which helped accurately mark various body parts for skeletal detection. The AquaAI Dolphin Decoder (ADD) was then used to analyze six dolphin behaviors. To improve behavior recognition accuracy, the Long Short-Term Memory (LSTM) neural network was introduced. The ADD and LSTM models were integrated to form the ADD-LSTM system. Several classification models, including unidirectional and bidirectional LSTM, GRU, and SVM, were compared. The results showed that the ADD module combined with a double-layer bidirectional LSTM method achieved high accuracy in dolphin behavior analysis. The accuracy rates for each behavior were over 90%.