13 May 2024 in Nature Neuroscience
Dopamine neurons in the ventral tegmental area support intracranial self-stimulation (ICSS), yet the cognitive representations underlying this phenomenon remain unclear. Here, 20-Hz stimulation of dopamine neurons, which approximates a physiologically relevant prediction error, was not sufficient to support ICSS beyond a continuously reinforced schedule and did not endow cues with a general or specific value. However, 50-Hz stimulation of dopamine neurons was sufficient to drive robust ICSS and was represented as a specific reward to motivate behavior. The frequency dependence of this effect is due to the rate (not the number) of action potentials produced by dopamine neurons, which differently modulates dopamine release downstream.
5 July 2024 in Journal of Neuroscience
Dopamine release in the nucleus accumbens core (NAcC) is generally considered to be a proxy for phasic firing of the ventral tegmental area dopamine (VTADA) neurons. Thus, dopamine release in NAcC is hypothesized to reflect a unitary role in reward prediction error signaling. However, recent studies reveal more diverse roles of dopamine neurons, which support an emerging idea that dopamine regulates learning differently in distinct circuits. To understand whether the NAcC might regulate a unique component of learning, we recorded dopamine release in NAcC while male rats performed a backward conditioning task where a reward is followed by a neutral cue. We used this task because we can delineate different components of learning, which include sensory-specific inhibitory and general excitatory components. Furthermore, we have shown that VTADAneurons are necessary for both the specific and general components of backward associations. Here, we found that dopamine release in NAcC increased to the reward across learning while reducing to the cue that followed as it became more expected. This mirrors the dopamine prediction error signal seen during forward conditioning and cannot be accounted for temporal-difference reinforcement learning. Subsequent tests allowed us to dissociate these learning components and revealed that dopamine release in NAcC reflects the general excitatory component of backward associations, but not their sensory-specific component. These results emphasize the importance of examining distinct functions of different dopamine projections in reinforcement learning.
5 December 2024 in Current Opinion in Behavioral Sciences
Model-based learning involves building mental representations of predictive relationships between events. Although there is growing evidence clarifying the role of dopamine in model-based learning, we know less about how serotonin contributes to these processes. Here, we present evidence examining the role of serotonin neurons in the dorsal raphe nucleus (DRN) in regulating model-based learning. We contrast this to the role of ventral tegmental area (VTA) dopamine neurons. We further propose a new framework suggesting how dopamine and serotonin could influence model-based learning in unique but complementary ways. Specifically, we know that the phasic firing of dopamine neurons acts as teaching signals to drive model-based learning. In contrast, we argue that the sustained activity seen in DRN serotonin neurons during waiting for rewards, or during presentation of reward-predictive cues reflects a precise expectation of future rewards across multiple dimensions. These two systems allow us to refine our cognitive maps by interplexing different types of information.
25 September 2024 in Frontiers in Neuroscience
SOShiho Okitsu-Sakurayama
+5
Serotonin is an essential neuromodulator that affects behavioral and cognitive functions. Previous studies have shown that activation of serotonergic neurons in the dorsal raphe nucleus (DRN) promotes patience to wait for future rewards. However, it is still unclear whether serotonergic neurons also regulate persistence to act for future rewards. Here we used optogenetic activation and inhibition of DRN serotonergic neurons to examine their effects on sustained motor actions for future rewards. We trained mice to perform waiting and repeated lever-pressing tasks with variable reward delays and tested effects of optogenetic activation and inhibition of DRN serotonergic neurons on task performance. Interestingly, in the lever-pressing task, mice tolerated longer delays as they repeatedly pressed a lever than in the waiting task, suggesting that lever-pressing actions may not simply be costly, but may also be subjectively rewarding. Optogenetic activation of DRN serotonergic neurons prolonged waiting duration in the waiting task, consistent with previous studies. However, its effect on lever presses was nuanced, and was detected only by focusing on the period before premature reward check and by subtracting the trends within and across sessions using generalized linear model. While optogenetic inhibition decreased waiting, it did not affect lever pressing time or numbers. These results revealed that the necessity of motor actions may increase motivation for delayed rewards and that DRN serotonergic neurons more significantly promote waiting rather than persistent motor actions for future rewards.