The computational framework of reinforcement learning has been used to forward our understanding of the neural mechanisms underlying reward learning and decision-making behavior. It is known that humans vary widely in their performance in decision-making tasks. Here, we used a simple four-armed bandit task in which subjects are almost evenly split into two groups on the basis of their performance: those who do learn to favor choice of the optimal action and those who do not. Using models of reinforcement learning we sought to determine the neural basis of these intrinsic differences in performance by scanning both groups with functional magnetic resonance imaging. We scanned 29 subjects while they performed the reward-based decision-making task. Our results suggest that these two groups differ markedly in the degree to which reinforcement learning signals in the striatum are engaged during task performance. While the learners showed robust prediction error signals in both the ventral and dorsal striatum during learning, the nonlearner group showed a marked absence of such signals. Moreover, the magnitude of prediction error signals in a region of dorsal striatum correlated significantly with a measure of behavioral performance across all subjects. These findings support a crucial role of prediction error signals, likely originating from dopaminergic midbrain neurons, in enabling learning of action selection preferences on the basis of obtained rewards. Thus, spontaneously observed individual differences in decision making performance demonstrate the suggested dependence of this type of learning on the functional integrity of the dopaminergic striatal system in humans.

Neuroimaging research has largely focused on the identification of associations between brain activation and specific mental functions. Here we show that data mining techniques applied to a large database of neuroimaging results can be used to identify the conceptual structure of mental functions and their mapping to brain systems. This analysis confirms many current ideas regarding the neural organization of cognition, but also provides some new insights into the roles of particular brain systems in mental function. We further show that the same methods can be used to identify the relations between mental disorders. Finally, we show that these two approaches can be combined to empirically identify novel relations between mental disorders and mental functions via their common involvement of particular brain networks. This approach has the potential to discover novel endophenotypes for neuropsychiatric disorders and to better characterize the structure of these disorders and the relations between them. One of the major challenges of neuroscience research is to integrate the results of the large number of published research studies in order to better understand how psychological functions are mapped onto brain systems. In this research, we take advantage of a large database of neuroimaging studies, along with text mining methods, to extract information about the topics that are found in the brain imaging literature and their mapping onto reported brain activation data. We also show that this method can be used to identify new relations between psychological functions and mental disorders, through their shared brain activity patterns. This work provides a new way to discover the underlying structure that relates brain function and mental processes.

Functional imaging studies examining the neural correlates of risk have mainly relied on paradigms involving exposure to simple chance gambles and an economic definition of risk as variance in the probability distribution over possible outcomes. However, there is little evidence that choices made during gambling tasks predict naturalistic risk-taking behaviors such as drug use, extreme sports, or even equity investing. To better understand the neural basis of naturalistic risk-taking, we scanned participants using fMRI while they completed the Balloon Analog Risk Task, an experimental measure that includes an active decision/choice component and that has been found to correlate with a number of naturalistic risk-taking behaviors. In the task, as in many naturalistic settings, escalating risk-taking occurs under uncertainty and might be experienced either as the accumulation of greater potential rewards, or as exposure to increasing possible losses (and decreasing expected value). We found that areas previously linked to risk and risk-taking (bilateral anterior insula, anterior cingulate cortex, and right dorsolateral prefrontal cortex) were activated as participants continued to inflate balloons. Interestingly, we found that ventromedial prefrontal cortex (vmPFC) activity decreased as participants further expanded balloons. In light of previous findings implicating the vmPFC in value calculation, this result suggests that escalating risk-taking in the task might be perceived as exposure to increasing possible losses (and decreasing expected value) rather than the increasing potential total reward relative to the starting point of the trial. A better understanding of how neural activity changes with risk-taking behavior in the task offers insight into the potential neural mechanisms driving naturalistic risk-taking.