Dopamine is synonymous with reward in mammals but associated with aversive reinforcement in insects, where reward seems to be signalled by octopamine; here it is shown that flies have discrete populations of dopamine neurons representing positive or negative values that are coordinately regulated by octopamine. The neurotransmitter dopamine has been synonymous with reward in mammals, but is associated with aversive reinforcement in insects. In insects, it was thought, reward was signalled by octopamine. Now Scott Waddell and colleagues show that flies have discrete 'negative' and 'positive' populations of dopamine neurons, which are coordinately regulated by octopamine. This work reconciles previous findings with octopamine and dopamine, and suggests that reinforcement systems in flies are more like those in mammals than previously thought. Dopamine is synonymous with reward and motivation in mammals1,2. However, only recently has dopamine been linked to motivated behaviour and rewarding reinforcement in fruitflies3,4. Instead, octopamine has historically been considered to be the signal for reward in insects5,6,7. Here we show, using temporal control of neural function in Drosophila, that only short-term appetitive memory is reinforced by octopamine. Moreover, octopamine-dependent memory formation requires signalling through dopamine neurons. Part of the octopamine signal requires the α-adrenergic-like OAMB receptor in an identified subset of mushroom-body-targeted dopamine neurons. Octopamine triggers an increase in intracellular calcium in these dopamine neurons, and their direct activation can substitute for sugar to form appetitive memory, even in flies lacking octopamine. Analysis of the β-adrenergic-like OCTβ2R receptor reveals that octopamine-dependent reinforcement also requires an interaction with dopamine neurons that control appetitive motivation. These data indicate that sweet taste engages a distributed octopamine signal that reinforces memory through discrete subsets of mushroom-body-targeted dopamine neurons. In addition, they reconcile previous findings with octopamine and dopamine and suggest that reinforcement systems in flies are more similar to mammals than previously thought.

During olfactory learning in fruit flies, dopaminergic neurons assign value to odor representations in the mushroom body Kenyon cells. Here we identify a class of downstream glutamatergic mushroom body output neurons (MBONs) called M4/6, or MBON-β2β'2a, MBON-β'2mp, and MBON-γ5β'2a, whose dendritic fields overlap with dopaminergic neuron projections in the tips of the β, β', and γ lobes. This anatomy and their odor tuning suggests that M4/6 neurons pool odor-driven Kenyon cell synaptic outputs. Like that of mushroom body neurons, M4/6 output is required for expression of appetitive and aversive memory performance. Moreover, appetitive and aversive olfactory conditioning bidirectionally alters the relative odor-drive of M4β' neurons (MBON-β'2mp). Direct block of M4/6 neurons in naive flies mimics appetitive conditioning, being sufficient to convert odor-driven avoidance into approach, while optogenetically activating these neurons induces avoidance behavior. We therefore propose that drive to the M4/6 neurons reflects odor-directed behavioral choice.

Dopaminergic neurons provide reward learning signals in mammals and insects [1-4]. Recent work in Drosophila has demonstrated that water-reinforcing dopaminergic neurons are different to those for nutritious sugars [5]. Here, we tested whether the sweet taste and nutrient properties of sugar reinforcement further subdivide the fly reward system. We found that dopaminergic neurons expressing the OAMB octopamine receptor [6] specifically convey the short-term reinforcing effects of sweet taste [4]. These dopaminergic neurons project to the β'2 and γ4 regions of the mushroom body lobes. In contrast, nutrient-dependent long-term memory requires different dopaminergic neurons that project to the γ5b regions, and it can be artificially reinforced by those projecting to the β lobe and adjacent α1 region. Surprisingly, whereas artificial implantation and expression of short-term memory occur in satiated flies, formation and expression of artificial long-term memory require flies to be hungry. These studies suggest that short-term and long-term sugar memories have different physiological constraints. They also demonstrate further functional heterogeneity within the rewarding dopaminergic neuron population.

Using the Drosophila system, this study shows that rewarding and motivational properties of water are mediated by different subsets of dopaminergic neurons. The study also shows a satiety state–dependent effect in which thirst can change water avoidance behavior into water-seeking behavior and demonstrates that water wanting versus liking versus learning are separable at the level of behavior and the underlying neural circuit. Drinking water is innately rewarding to thirsty animals. In addition, the consumed value can be assigned to behavioral actions and predictive sensory cues by associative learning. Here we show that thirst converts water avoidance into water-seeking in naive Drosophila melanogaster. Thirst also permitted flies to learn olfactory cues paired with water reward. Water learning required water taste and <40 water-responsive dopaminergic neurons that innervate a restricted zone of the mushroom body γ lobe. These water learning neurons are different from those that are critical for conveying the reinforcing effects of sugar. Naive water-seeking behavior in thirsty flies did not require water taste but relied on another subset of water-responsive dopaminergic neurons that target the mushroom body β′ lobe. Furthermore, these naive water-approach neurons were not required for learned water-seeking. Our results therefore demonstrate that naive water-seeking, learned water-seeking and water learning use separable neural circuitry in the brain of thirsty flies.

In Drosophila, negatively reinforcing dopaminergic neurons also provide the inhibitory control of satiety over appetitive memory expression. Here we show that aversive learning causes a persistent depression of the conditioned odor drive to two downstream feed-forward inhibitory GABAergic interneurons of the mushroom body, called MVP2, or mushroom body output neuron (MBON)-γ1pedc>α/β. However, MVP2 neuron output is only essential for expression of short-term aversive memory. Stimulating MVP2 neurons preferentially inhibits the odor-evoked activity of avoidance-directing MBONs and odor-driven avoidance behavior, whereas their inhibition enhances odor avoidance. In contrast, odor-evoked activity of MVP2 neurons is elevated in hungry flies, and their feed-forward inhibition is required for expression of appetitive memory at all times. Moreover, imposing MVP2 activity promotes inappropriate appetitive memory expression in food-satiated flies. Aversive learning and appetitive motivation therefore toggle alternate modes of a common feed-forward inhibitory MVP2 pathway to promote conditioned odor avoidance or approach.