Mirror neurons are neurons whose responses to the observation of a motor act resemble responses measured during production of that act. Computationally, mirror neurons have been viewed as evidence for the existence of internal inverse models. Such models, rooted within control theory, map desired sensory targets onto the motor commands required to generate those targets. To jointly explore both the formation of mirrored responses and their functional contribution to inverse models, we develop a correlation-based theory of interactions between a sensory and a motor area. We show that a simple eligibility-weighted Hebbian learning rule, operating within a sensorimotor loop during motor explorations and stabilized by heterosynaptic competition, naturally gives rise to mirror neurons as well as control theoretic inverse models encoded in the synaptic weights from sensory to motor neurons. Crucially, we find that the correlational structure or stereotypy of the neural code underlying motor explorations determines the nature of the learned inverse model: Random motor codes lead to causal inverses that map sensory activity patterns to their motor causes; such inverses are maximally useful, they allow for imitating arbitrary sensory target sequences. By contrast, stereotyped motor codes lead to less useful predictive inverses that map sensory activity to future motor actions. Our theory generalizes previous work on inverse models by showing that such models can be learned in a simple Hebbian framework without the need for error signals or backpropagation, and it makes new conceptual connections between the causal nature of inverse models, the statistical structure of motor variability, and the time-lag between sensory and motor responses of mirror neurons. Applied to bird song learning, our theory can account for puzzling aspects of the song system, including necessity of sensorimotor gating and selectivity of auditory responses to bird’s own song stimuli.
During singing, neurons in premotor nucleus RA (robust nucleus of the arcopallium) of the zebra finch produce complex temporal sequences of bursts that are recapitulated during sleep. RA receives input from nucleus HVC via the premotor pathway, and also from the lateral magnocellular nucleus of the anterior nidopallium (LMAN), part of a basal ganglia-related circuit essential for vocal learning. We explore the propagation of sleep-related spike patterns in these two pathways and their influences on RA activity. We promote sleep in head-fixed birds by injections of melatonin and make single-neuron recordings from the three major classes of neurons in HVC: RA-projecting neurons, Area X-projecting neurons, and interneurons. We also record LMAN neurons that project to RA. In paired recordings, spike trains from identified HVC neuron types are strongly coherent with spike trains in RA neurons, whereas LMAN projection neurons on average exhibit only a weak coherency with neurons in HVC and RA. We further examine the relative roles of HVC and LMAN in generating RA burst sequences with reversible inactivation. Lidocaine inactivation of HVC completely abolishes bursting in RA, whereas inactivation of LMAN has no effect on burst rates in RA. In combination, our data suggest that in adult birds, RA burst sequences in sleep are driven via the premotor pathway from HVC. We present a simple generative model of spike trains in HVC, RA, and LMAN neurons that is able to qualitatively reproduce observed coherency functions. We propose that commonly observed coherency peaks at positive and negative time lags are caused by sequentially correlated HVC activity.
To generate complex bilateral motor patterns such as those underlying birdsong, neural activity must be highly coordinated across the two cerebral hemispheres. However, it remains largely elusive how this coordination is achieved given that interhemispheric communication between song-control areas in the avian cerebrum is restricted to projections received from bilaterally connecting areas in the mid- and hindbrain. By electrically stimulating cerebral premotor areas in zebra finches, we find that behavioral effectiveness of stimulation rapidly switches between hemispheres. In time intervals in which stimulation in one hemisphere tends to distort songs, stimulation in the other hemisphere is mostly ineffective, revealing an idiosyncratic form of motor dominance that bounces back and forth between hemispheres like a virtual ping-pong ball. The intervals of lateralized effectiveness are broadly distributed and are unrelated to simple spectral and temporal song features. Such interhemispheric switching could be an important dynamical aspect of neural coordination that may have evolved from simpler pattern generator circuits. As for all vertebrates, the songbird cerebrum has two halves (or hemispheres), each of which controls mainly the muscles in one half of the body. Many motor behaviors such as singing rely on high coordination of activity in both hemispheres, yet little is known about the neural mechanisms of this coordination. By using electrical stimuli to briefly perturb the activity of neurons in the motor pathway during song production, we study their involvement in generating the different elements of a song in zebra finches. We find mostly disjoint time intervals in which stimulation of either the right or left hemisphere is effective in distorting a song. This interhemispheric switching of stimulation effectiveness is evidence of a novel form of ping-pong–like motor coordination. Because left–right alternation is the basis of many motor patterns such as swimming and walking, we speculate that interhemispheric switching in songbirds has its evolutionary roots in older circuit principles invented for locomotion.
7 April 2014 in Proceedings of the National Academy of Sciences
Significance: Auditory neural responses mirror motor activity in a songbird cortical area. The average temporal offset of mirrored responses is roughly equal to short sensorimotor loop delays. This correspondence between mirroring offsets and loop delays constitutes evidence for a causal inverse model. Causal inverse models can map a desired sensation into the required action.
While acquiring motor skills, animals transform their plastic motor sequences to match desired targets. However, because both the structure and temporal position of individual gestures are adjustable, the number of possible motor transformations increases exponentially with sequence length. Identifying the optimal transformation towards a given target is therefore a computationally intractable problem. Here we show an evolutionary workaround for reducing the computational complexity of song learning in zebra finches. We prompt juveniles to modify syllable phonology and sequence in a learned song to match a newly introduced target song. Surprisingly, juveniles match each syllable to the most spectrally similar sound in the target, regardless of its temporal position, resulting in unnecessary sequence errors, that they later try to correct. Thus, zebra finches prioritize efficient learning of syllable vocabulary, at the cost of inefficient syntax learning. This strategy provides a non-optimal but computationally manageable solution to the task of vocal sequence learning.
Many animals exhibit flexible behaviors that they can adjust to increase reward or avoid harm (learning by positive or aversive reinforcement). But what neural mechanisms allow them to restore their original behavior (motor program) after reinforcement is withdrawn? One possibility is that motor restoration relies on brain areas that have a role in memorization but no role in either motor production or in sensory processing relevant for expressing the behavior and its refinement.We investigated the role of a higher auditory brain area in the songbird for modifying and restoring the stereotyped adult song. We exposed zebra finches to aversively reinforcing white noise stimuli contingent on the pitch of one of their stereotyped song syllables. In response, birds significantly changed the pitch of that syllable to avoid the aversive reinforcer. After we withdrew reinforcement, birds recovered their original song within a few days. However, we found that large bilateral lesions in the caudal medial nidopallium (NCM, a high auditory area) impaired recovery of the original pitch even several weeks after withdrawal of the reinforcing stimuli. Because NCM lesions spared both successful noise-avoidance behavior and birds' auditory discrimination ability, our results show that NCM is not needed for directed motor changes or for auditory discriminative processing, but is implied in memorizing or recalling the memory of the recent song target.