Punishment involves learning about the relationship between behavior and its adverse consequences. Punishment is fundamental to reinforcement learning, decision-making and choice, and is disrupted in psychiatric disorders such as addiction, depression, and psychopathy. However, little is known about the brain mechanisms of punishment and much of what is known is derived from study of superficially similar, but fundamentally distinct, forms of aversive learning such as fear conditioning and avoidance learning. Here we outline the unique conditions that support punishment, the contents of its learning, and its behavioral consequences. We consider evidence implicating GABA and monoamine neurotransmitter systems, as well as corticostriatal, amygdala, and dopamine circuits in punishment. We show how maladaptive punishment processes are implicated in addictions, impulse control disorders, psychopathy, anxiety, and depression and argue that a better understanding of the cellular, circuit, and cognitive mechanisms of punishment will make important contributions to next generation therapeutic approaches.
Decision-making often involves motivational conflict because of the competing demands of approach and avoidance for a common resource: behavior. This conflict must be resolved as a necessary precursor for adaptive behavior. Here we show a role for the paraventricular thalamus (PVT) in behavioral control during motivational conflict. We used Pavlovian counterconditioning in male rats to establish a conditioned stimulus (CS) as a signal for reward (or danger) and then transformed the same CS into a signal for danger (or reward). After such training, the CS controls conflicting appetitive and aversive behaviors. To assess PVT involvement in conflict, we injected an adeno-associated virus (AAV) expressing the genetically encoded Ca2+ indicator GCaMP and used fiber photometry to record population PVT Ca2+ signals. We show distinct profiles of responsivity across the anterior–posterior axis of PVT during conflict, including an ordinal relationship between posterior PVT CS responses and behavior strength. To study the causal role of PVT in behavioral control during conflict, we injected AAV expressing the inhibitory hM4Di DREADD and determined the effects of chemogenetic PVT inhibition on behavior. We show that chemogenetic inhibition across the anterior–posterior axis of the PVT, but not anterior or posterior PVT alone, disrupts arbitration between appetitive and aversive behaviors when they are in conflict but has no effect when these behaviors are assessed in isolation. Together, our findings identify PVT as central to behavioral control during motivational conflict. SIGNIFICANCE STATEMENT Animals, including humans, approach attractive stimuli and avoid aversive ones. However, they frequently face conflict when the demands of approach and avoidance are incompatible. Resolution of this conflict is fundamental to adaptive behavior. Here we show a role for the paraventricular thalamus, a nucleus of the dorsal midline thalamus, in the arbitration of appetitive and aversive behavior during motivational conflict.
6 February 2020 in Frontiers in Molecular Neuroscience
Fiber photometry has enabled neuroscientists to easily measure targeted brain activity patterns in awake, freely behaving animal. A focus of this technique is to identify functionally-relevant changes in activity around particular environmental and/or behavioral events, i.e., event-related activity transients (ERT). A simple and popular approach to identifying ERT is to summarize peri-event signal [e.g., area under the curve (AUC), peak activity, etc.,] and perform standard analyses on this summary statistic. We highlight the various issues with this approach and overview straightforward alternatives: waveform confidence intervals (CIs) and permutation tests. We introduce the rationale behind these approaches, describe the results of Monte Carlo simulations evaluating their effectiveness at controlling Type I and Type II error rates, and offer some recommendations for selecting appropriate analysis strategies for fiber photometry experiments.
BLA neurons serve a well-accepted role in fear conditioning and fear extinction. However, the specific learning processes related to their activity at different times during learning remain poorly understood. We addressed this using behavioral tasks isolating distinct aspects of fear learning in male rats. We show that brief optogenetic inhibition of BLA neurons around moments of aversive reinforcement or nonreinforcement causes reductions in the salience of conditioned stimuli, rendering these stimuli less able to be learned about and less able to control fear or safety behaviors. This salience reduction was stimulus-specific, long-lasting, and specific to learning about, or responding to, the same aversive outcome, precisely the goals of therapeutic interventions in human anxiety disorders. Our findings identify a core learning process disrupted by brief BLA optogenetic inhibition. They show that a primary function of the unconditioned stimulus-evoked activity of BLA neurons is to maintain the salience of conditioned stimuli that precede it. This maintenance of salience is a necessary precursor for these stimuli to gain and maintain control over fear and safety behavior.SIGNIFICANCE STATEMENTThe amygdala is essential for learning to fear and learning to reduce fear. However, the specific roles served by activity of different amygdala neurons at different times during learning is poorly understood. We used behavioral tasks isolating distinct aspects of learning in rats to show that brief optogenetic inhibition of BLA neurons around moments of reinforcement or nonreinforcement disrupts maintenance of conditioned stimulus salience. This causes a stimulus-specific and long-lasting deficit in the ability of the conditioned stimulus to be learned about or control fear responses. These consequences are the precisely goals of therapeutic interventions in human anxiety disorders. Our findings identify a core learning process disrupted by brief BLA optogenetic inhibition.
Our behaviour is shaped by its consequences – we seek rewards and avoid harm. It has been reported that individuals vary markedly in their avoidance of detrimental consequences, that is in their sensitivity to punishment. The underpinnings of this variability are poorly understood; they may be driven by differences in aversion sensitivity, motivation for reward, and/or instrumental control. We examined these hypotheses by applying several analysis strategies to the behaviour of rats (n = 48; 18 female) trained in a conditioned punishment task that permitted concurrent assessment of punishment, reward-seeking, and Pavlovian fear. We show that punishment insensitivity is a unique phenotype, unrelated to differences in reward-seeking and Pavlovian fear, and due to a failure of instrumental control. Subjects insensitive to punishment are afraid of aversive events, they are simply unable to change their behaviour to avoid them.