The analysis of complex flight patterns and collective behaviors in swarming insects has emerged as a significant focus across biological and computational fields. Tracking these insects, like fruit fly, presents persistent challenges due to their rapid motion patterns and frequent occlusions in densely populated environments. To address these challenges, we propose a tracking method using particle filter framework combined with a Kolmogorov–Arnold Network (KAN)-Transformer model to extract the global features and fine-grained features of the trajectory. Additionally, manually annotated ground truth datasets are established to enable thorough assessment of tracking methods. Experimental results demonstrate the effectiveness and robustness of our proposed tracking method. Analysis of tracked trajectories revealed the Reynolds rules of flocking behavior.

The study of the intricate flight patterns and behaviors of swarm insects, such as drosophilas, has long been a subject of interest in both the biological and computational realms. Tracking drosophilas is an essential and indispensable method for researching drosophilas’ behaviors. Still, it remains a challenging task due to the highly dynamic nature of these drosophilas and their partial occlusion in multi-target environments. To address these challenges, particularly in environments where multiple targets (drosophilas) interact and overlap, we have developed a long-term Trajectory 3D Position and Orientation Tracking Method (Long 3D-POT) that combines deep learning with particle filtering. Our approach employs a detection model based on an improved Mask-RCNN to accurately detect the position and state of drosophilas from frames, even when they are partially occluded. Following detection, improved particle filtering is used to predict and update the motion of the drosophilas. To further enhance accuracy, we have introduced a prediction module based on the self-attention backbone that predicts the drosophila’s next state and updates the particles’ weights accordingly. Compared with previous methods by Ameni, Cheng, and Wang, our method has demonstrated a higher degree of accuracy and robustness in tracking the long-term trajectories of drosophilas, even those that are partially occluded. Specifically, Ameni employs the Interacting Multiple Model (IMM) combined with the Global Nearest Neighbor (GNN) assignment algorithm, primarily designed for tracking larger, more predictable targets like aircraft, which tends to perform poorly with small, fast-moving objects like drosophilas. The method by Cheng then integrates particle filtering with LSTM networks to predict particle weights, enhancing trajectory prediction under kinetic uncertainties. Wang’s approach builds on Cheng’s by incorporating an estimation of the orientation of drosophilas in order to refine tracking further. Compared with those methods, our method performs with higher accuracy on detection, which increases by more than 10% on the F1 Score, and tracks more long-term trajectories, showing stability.

The cooled mid-wave infrared biomimetic compound eye camera has wide range of applications, such as industrial inspection, military project, and security. Due to the low resolution of individual eyes and the large field view of the imaging system, existing motion target enhancement and detection algorithms cannot effectively detect all potential targets. To address this issue, we propose an improved elementary motion detector model that combines a double-layer ON_OFF channel and a cross-type computational architecture, which is able to suppress a stationary background and enhance moving targets. In order to further reduce the missed detection, we designed the spatial and temporal consistency detection methods of the compound eye structure, which further improved the accuracy and stability of the detection results. The experimental results show that our method can fully utilize the features of the image and can be applied to the enhancement and detection of moving objects in complex scenes, and the detection efficiency is significantly improved.

L-DOPA-induced dyskinesia (LID) is a common complication in the treatment of Parkinson’s disease (PD), characterized by involuntary excessive movements. The traditional Abnormal Involuntary Movement Scale (AIMs), used for quantifying abnormal involuntary movements, relies heavily on manual observation and is highly subjective. Unsupervised behavior classification typically requires joint modeling on the entire dataset, making it inflexible when dealing with new samples. Here, we propose an automated behavioral recognition framework integrating multi-view 3D motion reconstruction with a hypergraph self-attention neural network to precisely delineate LID behavioral phenotypes and evaluate pharmacological interventions. Using a synchronized four-camera setup, we collected large-scale motion data from WT, PD, and LID mice, tracking 16 key body points to reconstruct accurate 3D trajectories. By combining unsupervised clustering with manual annotation, we established a standardized behavioral database. We introduced a spatiotemporal hypergraph neural network model incorporating a self-attention mechanism, which demonstrated excellent recognition accuracy across all behaviors and effectively distinguished the behavioral profiles of WT, PD, and LID mice. Based on this, we compared the behavioral differences in treatment effects between amantadine (AMAN) and clozapine (CLZ). Overall, our automated 3D behavioral analysis framework offers a high-throughput, objective, and precise approach to behavioral quantification, presenting a powerful tool for unraveling the mechanisms underlying LID and other movement disorders, as well as for advancing pharmacological research.