20 November 2023 in Nature Neuroscience
Recent studies in mice have shown that orofacial behaviors drive a large fraction of neural activity across the brain. To understand the nature and function of these signals, we need better computational models to characterize the behaviors and relate them to neural activity. Here we developed Facemap, a framework consisting of a keypoint tracker and a deep neural network encoder for predicting neural activity. Our algorithm for tracking mouse orofacial behaviors was more accurate than existing pose estimation tools, while the processing speed was several times faster, making it a powerful tool for real-time experimental interventions. The Facemap tracker was easy to adapt to data from new labs, requiring as few as 10 annotated frames for near-optimal performance. We used the keypoints as inputs to a deep neural network which predicts the activity of ~50,000 simultaneously-recorded neurons and, in visual cortex, we doubled the amount of explained variance compared to previous methods. Using this model, we found that the neuronal activity clusters that were well predicted from behavior were more spatially spread out across cortex. We also found that the deep behavioral features from the model had stereotypical, sequential dynamics that were not reversible in time. In summary, Facemap provides a stepping stone toward understanding the function of the brain-wide neural signals and their relation to behavior.
10 January 2023 in Nature Communications
Absence seizures are brief episodes of impaired consciousness, behavioral arrest, and unresponsiveness, with yet-unknown neuronal mechanisms. Here we report that an awake female rat model recapitulates the behavioral, electroencephalographic, and cortical functional magnetic resonance imaging characteristics of human absence seizures. Neuronally, seizures feature overall decreased but rhythmic firing of neurons in cortex and thalamus. Individual cortical and thalamic neurons express one of four distinct patterns of seizure-associated activity, one of which causes a transient initial peak in overall firing at seizure onset, and another which drives sustained decreases in overall firing. 40–60 s before seizure onset there begins a decline in low frequency electroencephalographic activity, neuronal firing, and behavior, but an increase in higher frequency electroencephalography and rhythmicity of neuronal firing. Our findings demonstrate that prolonged brain state changes precede consciousness-impairing seizures, and that during seizures distinct functional groups of cortical and thalamic neurons produce an overall transient firing increase followed by a sustained firing decrease, and increased rhythmicity.
4 November 2022 in bioRxiv
Recent studies in mice have shown that orofacial behaviors drive a large fraction of neural activity across the brain. To understand the nature and function of these signals, we need better computational models to characterize the behaviors and relate them to neural activity. Here we developed Facemap, a framework consisting of a keypoint tracking algorithm and a deep neural network encoder for predicting neural activity. We used the Facemap keypoints as input for the deep neural network to predict the activity of ∼50,000 simultaneously-recorded neurons and in visual cortex we doubled the amount of explained variance compared to previous methods. Our keypoint tracking algorithm was more accurate than existing pose estimation tools, while the inference speed was several times faster, making it a powerful tool for closed-loop behavioral experiments. The Facemap tracker was easy to adapt to data from new labs, requiring as few as 10 annotated frames for near-optimal performance. We used Facemap to find that the neuronal activity clusters which were highly driven by behaviors were more spatially spread-out across cortex. We also found that the deep keypoint features inferred by the model had time-asymmetrical state dynamics that were not apparent in the raw keypoint data. In summary, Facemap provides a stepping stone towards understanding the function of the brainwide neural signals and their relation to behavior.