Yael Niv

Yael Niv

Auto-generated profile, based on publicly available information

Yael Niv

Princeton University

Research Focus & Metrics

Academic Career Length

20Years (2007-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
27 May 2015 in The Journal of Neuroscience
Verified
Journal Article
Open access
PDF file
YNYael Niv
Yael Niv
RDReka Daniel-Weiner
Reka Daniel-Weiner
AGAndra Geana
Andra Geana
SGSamuel J. Gershman
Samuel J. Gershman
YLYuan Chang Leong
Yuan Chang Leong
RWRobert C. Wilson
Robert C. Wilson
In recent years, ideas from the computational field of reinforcement learning have revolutionized the study of learning in the brain, famously providing new, precise theories of how dopamine affects learning in the basal ganglia. However, reinforcement learning algorithms are notorious for not scaling well to multidimensional environments, as is required for real-world learning. We hypothesized that the brain naturally reduces the dimensionality of real-world problems to only those dimensions that are relevant to predicting reward, and conducted an experiment to assess by what algorithms and with what neural mechanisms this “representation learning” process is realized in humans. Our results suggest that a bilateral attentional control network comprising the intraparietal sulcus, precuneus, and dorsolateral prefrontal cortex is involved in selecting what dimensions are relevant to the task at hand, effectively updating the task representation through trial and error. In this way, cortical attention mechanisms interact with learning in the basal ganglia to solve the “curse of dimensionality” in reinforcement learning.

1 April 2010 in Current Opinion in Neurobiology
Verified
Journal Article
Closed access
SGSamuel J Gershman
Samuel J Gershman
YNYael Niv
Yael Niv

11 January 2012 in Journal of Neuroscience
Verified
Journal Article
Open access
PDF file
YNYael Niv
Yael Niv
JEJeffrey A. Edlund
Jeffrey A. Edlund
PDPeter Dayan
Peter Dayan
JOJohn P. O'DOherty
John P. O'DOherty
Humans and animals are exquisitely, though idiosyncratically, sensitive to risk or variance in the outcomes of their actions. Economic, psychological, and neural aspects of this are well studied when information about risk is provided explicitly. However, we must normally learn about outcomes from experience, through trial and error. Traditional models of such reinforcement learning focus on learning about the mean reward value of cues and ignore higher order moments such as variance. We used fMRI to test whether the neural correlates of human reinforcement learning are sensitive to experienced risk. Our analysis focused on anatomically delineated regions of a priori interest in the nucleus accumbens, where blood oxygenation level-dependent (BOLD) signals have been suggested as correlating with quantities derived from reinforcement learning. We first provide unbiased evidence that the raw BOLD signal in these regions corresponds closely to a reward prediction error. We then derive from this signal the learned values of cues that predict rewards of equal mean but different variance and show that these values are indeed modulated by experienced risk. Moreover, a close neurometric–psychometric coupling exists between the fluctuations of the experience-based evaluations of risky options that we measured neurally and the fluctuations in behavioral risk aversion. This suggests that risk sensitivity is integral to human learning, illuminating economic models of choice, neuroscientific models of affective learning, and the workings of the underlying neural mechanisms.

24 September 2019 in Nature Neuroscience
Verified
Journal Article
Closed access
PDF file
YNYael Niv
Yael Niv

1 July 2008 in Trends in Cognitive Sciences
Verified
Journal Article
Closed access
YNYael Niv
Yael Niv
GSGeoffrey Schoenbaum
Geoffrey Schoenbaum

3 April 2017 in Nature Neuroscience
Verified
Journal Article
Open access
PDF file
MSMelissa J Sharpe
Melissa J Sharpe
CCChun Yun Chang
Chun Yun Chang
MLMelissa A Liu
Melissa A Liu
HBHannah M Batchelor
Hannah M Batchelor
LMLauren E Mueller
Lauren E Mueller
GSGeoffrey Schoenbaum
Geoffrey Schoenbaum
Learning to predict reward is thought to be driven by dopaminergic prediction errors, which reflect discrepancies between actual and expected value. Here the authors show that learning to predict neutral events is also driven by prediction errors and that such value-neutral associative learning is also likely mediated by dopaminergic error signals. Associative learning is driven by prediction errors. Dopamine transients correlate with these errors, which current interpretations limit to endowing cues with a scalar quantity reflecting the value of future rewards. We tested whether dopamine might act more broadly to support learning of an associative model of the environment. Using sensory preconditioning, we show that prediction errors underlying stimulus–stimulus learning can be blocked behaviorally and reinstated by optogenetically activating dopamine neurons. We further show that suppressing the firing of these neurons across the transition prevents normal stimulus–stimulus learning. These results establish that the acquisition of model-based information about transitions between nonrewarding events is also driven by prediction errors and that, contrary to existing canon, dopamine transients are both sufficient and necessary to support this type of learning. Our findings open new possibilities for how these biological signals might support associative learning in the mammalian brain in these and other contexts.