In the current theory of learning, the reward prediction error (RPE), the difference between expected and received reward, is thought to be a key factor in reward-based learning, working as a teaching signal. The activity of dopamine neurons is known to code RPE, and the release of dopamine is known to modify the strength of synaptic connectivity in the target neurons. A fundamental interest in current neuroscience concerns the origin of RPE signals in the brain. Here, we show that a group of rat striatal neurons show a clear parametric RPE coding similar to that of dopamine neurons when tested under probabilistic pavlovian conditioning. Together with the fact that striatum and dopamine neurons have strong direct and indirect fiber connections, the result suggests that the striatum plays an important role in coding RPE signal by cooperating with dopamine neurons.
To investigate how the striatum integrates sensory information with reward information for behavioral guidance, we recorded single-unit activity in the dorsal striatum of head-fixed rats participating in a probabilistic Pavlovian conditioning task with auditory conditioned stimuli (CSs) in which reward probability was fixed for each CS but parametrically varied across CSs. We found that the activity of many neurons was linearly correlated with the reward probability indicated by the CSs. The recorded neurons could be classified according to their firing patterns into functional subtypes coding reward probability in different forms such as stimulus value, reward expectation, and reward prediction error. These results suggest that several functional subgroups of dorsal striatal neurons represent different kinds of information formed through extensive prior exposure to CS-reward contingencies.
Processing incentive and drive is essential for control of goal-directed behavior. The limbic part of the basal ganglia has been emphasized in these processes, yet the exact neuronal mechanism has remained elusive. In this study, we examined the neuronal activity of the ventral pallidum (VP) and its upstream area, the rostromedial caudate (rmCD), while two male macaque monkeys performed an instrumental lever release task in which a visual cue indicated the forthcoming reward size. We found that the activity of some neurons in VP and rmCD reflected the expected reward size transiently following the cue. Reward size coding appeared earlier and stronger in VP than in rmCD. We also found that the activity in these areas was modulated by the satiation level of monkeys, which also occurred more frequently in VP than in rmCD. The information regarding reward size and satiation level was independently signaled in the neuronal populations of these areas. The data thus highlighted the neuronal coding of key variables for goal-directed behavior in VP. Furthermore, pharmacological inactivation of VP induced more severe deficit of goal-directed behavior than inactivation of rmCD, which was indicated by abnormal error repetition and diminished satiation effect on the performance. These results suggest that VP encodes incentive value and internal drive and plays a pivotal role in the control of motivation to promote goal-directed behavior.SIGNIFICANCE STATEMENTThe limbic part of the basal ganglia has been implicated in the motivational control of goal-directed action. Here, we investigated how the ventral pallidum (VP) and the rostromedial caudate (rmCD) encode incentive value and internal drive and control goal-directed behavior. Neuronal recording and subsequent pharmacological inactivation revealed that VP had stronger coding of reward size and satiation level than rmCD. Reward size and satiation level were independently encoded in the neuronal population of these areas. Furthermore, VP inactivation impaired goal-directed behavior more severely than rmCD inactivation. These results highlight the central role of VP in the motivational control of goal-directed action.
16 December 2016 in Frontiers in Systems Neuroscience
Neural mechanisms of working memory, particularly its visuospatial aspect, have long been studied in non-human primates. On the other hand, rodents are becoming more important in systems neuroscience, as many of the innovative research methods have become available for them. There has been a question on whether primates and rodents have similar neural backgrounds for working memory. In this paper, we carried out a comparative overview of the neural mechanisms of visuospatial working memory in monkeys and rats. In monkeys, a number of lesion studies indicate that the brain region most responsible for visuospatial working memory is the ventral dorsolateral prefrontal cortex (vDLPFC), as the standard tests for visuospatial working memory, such as delayed response and delayed alternation tasks, are impaired by lesions in this region. Single-unit studies revealed a characteristic firing pattern in neurons in this area, a sustained delay activity. Further studies indicated that the information maintained in the working memory, such as cue location and response direction in a delayed response, is coded in the sustained delay activity. In rats, an area comparable to the monkey vDLPFC was found to be the dorsal part of the medial prefrontal cortex (mPFC), as the delayed alternation in a T-maze is impaired by its lesion. Recently, the delay sustained activity similar to that found in monkeys has been found in the dorsal mPFC of rats performing the delayed response task. Furthermore, anatomical studies indicate that the vDLPFC in monkeys and the dorsal mPFC in rats have much in common, such as that they are both the major targets of parieto-frontal projections. Thus lines of evidence indicate that in both monkeys and rodents, the prefrontal cortex plays a critical role in working memory.
Primates must adapt to changing environments by optimizing their behavior to make beneficial choices. At the core of adaptive behavior is the orbitofrontal cortex (OFC) of the brain, which updates choice value through direct experience or knowledge-based inference. Here, we identify distinct neural circuitry underlying these two separate abilities. We designed two behavioral tasks in which two male macaque monkeys updated the values of certain items, either by directly experiencing changes in stimulus-reward associations, or by inferring the value of unexperienced items based on the task’s rules. Chemogenetic silencing of bilateral OFC combined with mathematical model-fitting analysis revealed that monkey OFC is involved in updating item value based on both experience and inference. In vivo imaging of chemogenetic receptors by positron emission tomography allowed us to map projections from the OFC to the rostromedial caudate nucleus (rmCD) and the medial part of the mediodorsal thalamus (MDm). Chemogenetic silencing of the OFC-rmCD pathway impaired experience-based value updating, while silencing the OFC-MDm pathway impaired inference-based value updating. Our results thus demonstrate dissociable contributions of distinct OFC projections to different behavioral strategies, and provide new insights into the neural basis of value-based adaptive decision-making in primates.