Animal behavior usually has a hierarchical structure and dynamics. Therefore, to understand how the neural system coordinates with behaviors, neuroscientists need a quantitative description of the hierarchical dynamics of different behaviors. However, the recent end-to-end machine-learning-based methods for behavior analysis mostly focus on recognizing behavioral identities on a static timescale or based on limited observations. These approaches usually lose rich dynamic information on cross-scale behaviors. Here, inspired by the natural structure of animal behaviors, we address this challenge by proposing a parallel and multi-layered framework to learn the hierarchical dynamics and generate an objective metric to map the behavior into the feature space. In addition, we characterize the animal 3D kinematics with our low-cost and efficient multi-view 3D animal motion-capture system. Finally, we demonstrate that this framework can monitor spontaneous behavior and automatically identify the behavioral phenotypes of the transgenic animal disease model. The extensive experiment results suggest that our framework has a wide range of applications, including animal disease model phenotyping and the relationships modeling between the neural circuits and behavior.
The quantification of animal social behaviour is an essential step to reveal brain functions and psychiatric disorders during interaction phases. While deep learning-based approaches have enabled precise pose estimation, identification and behavioural classification of multi-animals, their application is challenged by the lack of well-annotated datasets. Here we show a computational framework, the Social Behavior Atlas (SBeA) used to overcome the problem caused by the limited datasets. SBeA uses a much smaller number of labelled frames for multi-animal three-dimensional pose estimation, achieves label-free identification recognition and successfully applies unsupervised dynamic learning to social behaviour classification. SBeA is validated to uncover previously overlooked social behaviour phenotypes of autism spectrum disorder knockout mice. Our results also demonstrate that the SBeA can achieve high performance across various species using existing customized datasets. These findings highlight the potential of SBeA for quantifying subtle social behaviours in the fields of neuroscience and ecology.
14 November 2022 in Reliability Engineering & System Safety
Designing a transcranial electrical stimulation (tES) strategy requires considering multiple objectives, such as intensity in the target area, focality, stimulation depth, and avoidance zone. These objectives are often mutually exclusive. In this paper, we propose a general framework, called multi-objective optimization via evolutionary algorithm (MOVEA), which solves the non-convex optimization problem in designing tES strategies without a predefined direction. MOVEA enables simultaneous optimization of multiple targets through Pareto optimization, generating a Pareto front after a single run without manual weight adjustment and allowing easy expansion to more targets. This Pareto front consists of optimal solutions that meet various requirements while respecting trade-off relationships between conflicting objectives such as intensity and focality. MOVEA is versatile and suitable for both transcranial alternating current stimulation (tACS) and transcranial temporal interference stimulation (tTIS) based on high definition (HD) and two-pair systems. We comprehensively compared tACS and tTIS in terms of intensity, focality, and steerability for targets at different depths. Our findings reveal that tTIS enhances focality by reducing activated volume outside the target by 60%. HD-tTIS and HD-tDCS can achieve equivalent maximum intensities, surpassing those of two-pair tTIS, such as 0.51 V/m under HD-tACS/HD-tTIS and 0.42 V/m under two-pair tTIS for the motor area as a target. Analysis of variance in eight subjects highlights individual differences in both optimal stimulation policies and outcomes for tACS and tTIS, emphasizing the need for personalized stimulation protocols. These findings provide guidance for designing appropriate stimulation strategies for tACS and tTIS. MOVEA facilitates the optimization of tES based on specific objectives and constraints, advancing tTIS and tACS-based neuromodulation in understanding the causal relationship between brain regions and cognitive functions and treating diseases. The code for MOVEA is available at https://github.com/ncclabsustech/MOVEA.