The DOI matches its Crossref record; 107 of the 107 references it cites were found in a registry or an index.
Generalization of value in reinforcement learning by humans
Open accessAbstract
Research in decision‐making has focused on the role of dopamine and its striatal targets in guiding choices via learned stimulus–reward or stimulus–response associations, behavior that is well described by reinforcement learning theories. However, basic reinforcement learning is relatively limited in scope and does not explain how learning about stimulus regularities or relations may guide decision‐making. A candidate mechanism for this type of learning comes from the domain of memory, which has highlighted a role for the hippocampus in learning of stimulus–stimulus relations, typically dissociated from the role of the striatum in stimulus–response learning. Here, we used functional magnetic resonance imaging and computational model‐based analyses to examine the joint contributions of these mechanisms to reinforcement learning. Humans performed a reinforcement learning task with added relational structure, modeled after tasks used to isolate hippocampal contributions to memory. On each trial participants chose one of four options, but the reward probabilities for pairs of options were correlated across trials. This (uninstructed) relationship between pairs of options potentially enabled an observer to learn about option values based on experience with the other options and to generalize across them. We observed blood oxygen level‐dependent (BOLD) activity related to learning in the striatum and also in the hippocampus. By comparing a basic reinforcement learning model to one augmented to allow feedback to generalize between correlated options, we tested whether choice behavior and BOLD activity were influenced by the opportunity to generalize across correlated options. Although such generalization goes beyond standard computational accounts of reinforcement learning and striatal BOLD, both choices and striatal BOLD activity were better explained by the augmented model. Consistent with the hypothesized role for the hippocampus in this generalization, functional connectivity between the ventral striatum and hippocampus was modulated, across participants, by the ability of the augmented model to capture participants’ choice. Our results thus point toward an interactive model in which striatal reinforcement learning systems may employ relational representations typically associated with the hippocampus.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“As expected, in contradistinction to the main study, appetitive PEs to monetary rewards were tracked by activity in the VS. (t(20) = 5.77, p < 0.001), but not the PAG (PAG–appetitive: t(20) = 1.54, p = 0.14; see Supplementary Fig. 2).”
From Representation of aversive prediction errors in the human periaqueductal gray (2014) · cites this paper as [23]
In the citing paper
“As expected, in contradistinction to the main study, appetitive PEs to monetary rewards were tracked by activity in the VS. (t(20) = 5.77, p < 0.001), but not the PAG (PAG–appetitive: t(20) = 1.54, p = 0.14; see Supplementary Fig. 2).”
From Representation of aversive prediction errors in the human periaqueductal gray (2014) · cites this paper as [23]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A new look at the statistical model identification
Akaike, H. (1974) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1974.1100705 · Cited by 51,879
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Brainard, D. H. (1997) · Spatial Vision · doi:10.1163/156856897x00357 · Cited by 20,012
Tzourio-Mazoyer, N., Landeau, B., Papathanassiou, D., Crivello, F., Etard, O., Delcroix, N., Mazoyer, B., & Joliot, M. (2002) · NeuroImage · doi:10.1006/nimg.2001.0978 · Cited by 16,319
Kass, R. E., & Raftery, A. E. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476572 · Cited by 12,558
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Cragg, J. G., & Zarembka, P. (1975) · Canadian Journal of Economics/Revue canadienne d économique · doi:10.2307/134075 · Cited by 8,477
Memory and the hippocampus: A synthesis from findings with rats, monkeys, and humans.
Squire, L. R. (1992) · Psychological Review · doi:10.1037/0033-295x.99.2.195 · Cited by 5,376
Neural systems of reinforcement for drug addiction: from actions to habits to compulsion
Everitt, B. J., & Robbins, T. W. (2005) · Nature Neuroscience · doi:10.1038/nn1579 · Cited by 3,785
Psychophysiological and Modulatory Interactions in Neuroimaging
Friston, K. J., Buechel, C., Fink, G. R., Morris, J., Rolls, E., & Dolan, R. J. (1997) · NeuroImage · doi:10.1006/nimg.1997.0291 · Cited by 3,097
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533
Self-citationAnticipation of Increasing Monetary Reward Selectively Recruits Nucleus Accumbens
Knutson, B., Adams, C. M., Fong, G. W., & Hommer, D. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-16-j0002.2001 · Cited by 2,244
Cortical substrates for exploratory decisions in humans
Daw, N. D., O'Doherty, J. P., Dayan, P., Seymour, B., & Dolan, R. J. (2006) · Nature · doi:10.1038/nature04766 · Cited by 2,224
Self-citationA framework for studying the neurobiology of value-based decision making
Rangel, A., Camerer, C., & Montague, P. R. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2357 · Cited by 2,184
By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism
Frank, M. J., Seeberger, L. C., & O'Reilly, R. C. (2004) · Science · doi:10.1126/science.1102941 · Cited by 1,964
Assessing the significance of focal activations using their spatial extent
Friston, K. J., Worsley, K. J., Frackowiak, R. S. J., Mazziotta, J. C., & Evans, A. C. (1994) · Human Brain Mapping · doi:10.1002/hbm.460010306 · Cited by 1,907
Valid conjunction inference with the minimum statistic
Nichols, T. E., Brett, M., Andersson, J., Wager, T. D., & Poline, J. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2004.12.005 · Cited by 1,854
Model-based influences on humans’ choices and striatal prediction errors
Daw, N. D., Gershman, S. J., Seymour, B., Dayan, P., & Dolan, R. J. (2011) · Neuron · doi:10.1016/j.neuron.2011.02.027 · Cited by 1,779
Self-citationA neostriatal habit learning system in humans
Knowlton, B. J., Mangels, J. A., & Squire, L. R. (1996) · Science · doi:10.1126/science.273.5280.1399 · Cited by 1,777
Neural correlates of decision variables in parietal cortex
Platt, M. L., & Glimcher, P. W. (1999) · Nature · doi:10.1038/22268 · Cited by 1,721
Swanson, L. W. (1982) · Brain Research Bulletin · doi:10.1016/0361-9230(82)90145-9 · Cited by 1,718 · cited 1×
“Conversely, value information in the hippocampus may arrive via significant projections from midbrain dopaminergic neurons of the ventral tegmental area (Dahlström & Fuxe, 1964; Swanson, 1982; Frey et al., 1990; Gasbarri et al., 1994; Huang & Kandel, 1995; Otmakhova & Lisman, 1996).”
BackgroundBehavioral Theories and the Neurophysiology of Reward
Schultz, W. (2006) · Annual Review of Psychology · doi:10.1146/annurev.psych.56.091103.070229 · Cited by 1,637
Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans
Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J., & Frith, C. D. (2006) · Nature · doi:10.1038/nature05051 · Cited by 1,584
Memory, amnesia, and the hippocampal system
(1994) · Choice Reviews Online · doi:10.5860/choice.31-5148 · Cited by 1,533
Temporal difference models and reward-related learning in the human brain
O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003) · Neuron · doi:10.1016/s0896-6273(03)00169-7 · Cited by 1,522
Experience-weighted Attraction Learning in Normal Form Games
Camerer, C. F., & Ho, T. (1999) · Econometrica · doi:10.1111/1468-0262.00054 · Cited by 1,442
Bayesian model selection for group studies
Stephan, K. E., Penny, W. D., Daunizeau, J., Moran, R. J., & Friston, K. J. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.03.025 · Cited by 1,423
Models of Information Processing in the Basal Ganglia
(1994) · doi:10.7551/mitpress/4708.001.0001 · Cited by 1,190
Item, context and relational episodic encoding in humans
Davachi, L. (2006) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2006.10.012 · Cited by 1,138
Interactive memory systems in the human brain
Poldrack, R. A., Clark, J., Paré-Blagoev, E. J., Shohamy, D., Creso Moyano, J., Myers, C., & Gluck, M. A. (2001) · Nature · doi:10.1038/35107080 · Cited by 1,132
Matching Behavior and the Representation of Value in the Parietal Cortex
Sugrue, L. P., Corrado, G. S., & Newsome, W. T. (2004) · Science · doi:10.1126/science.1094765 · Cited by 1,030
Reward-motivated learning: mesolimbic activation precedes memory formation
Adcock, R. A., Thangavel, A., Whitfield-Gabrieli, S., Knutson, B., & Gabrieli, J. D. E. (2006) · Neuron · doi:10.1016/j.neuron.2006.03.036 · Cited by 977
Temporal Prediction Errors in a Passive Learning Task Activate Human Striatum
McClure, S. M., Berns, G. S., & Montague, P. R. (2003) · Neuron · doi:10.1016/s0896-6273(03)00154-5 · Cited by 917
Generalisability, Random Effects & Population Inference
Holmes, A. P., & Friston, K. J. (1998) · NeuroImage · doi:10.1016/s1053-8119(18)31587-8 · Cited by 886
Orbitofrontal Cortex Encodes Willingness to Pay in Everyday Economic Transactions
Plassmann, H., O'Doherty, J., & Rangel, A. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2131-07.2007 · Cited by 855
Optimized EPI for fMRI studies of the orbitofrontal cortex
Deichmann, R., Gottfried, J. A., Hutton, C., & Turner, R. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00073-9 · Cited by 821
COGNITIVE NEUROSCIENCE OF HUMAN MEMORY
Gabrieli, J. D. E. (1998) · Annual Review of Psychology · doi:10.1146/annurev.psych.49.1.87 · Cited by 808
Hare, T. A., O'Doherty, J., Camerer, C. F., Schultz, W., & Rangel, A. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.1309-08.2008 · Cited by 792
What are the computations of the cerebellum, the basal ganglia and the cerebral cortex?
Doya, K. (1999) · Neural Networks · doi:10.1016/s0893-6080(99)00046-5 · Cited by 757
Localization of monoamines in the lower brain stem
Dahlström, A. B., & Fuxé, K. (1964) · Cellular and Molecular Life Sciences · doi:10.1007/bf02147990 · Cited by 749
Kelley, A. E., & Domesick, V. B. (1982) · Neuroscience · doi:10.1016/0306-4522(82)90198-1 · Cited by 746
Shohamy, D., & Adcock, R. A. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.08.002 · Cited by 736
Neuroeconomics: Decision Making and the Brain
Rushworth, M. F. S., & Walton, M. E. (2009) · Neuron · doi:10.1016/j.neuron.2009.07.005 · Cited by 669
The discovery of structural form
Kemp, C., & Tenenbaum, J. B. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0802631105 · Cited by 666
Boorman, E. D., Behrens, T. E. J., Woolrich, M. W., & Rushworth, M. F. S. (2009) · Neuron · doi:10.1016/j.neuron.2009.05.014 · Cited by 665
Nonlinear event‐related responses in fMRI
Friston, K. J., Josephs, O., Rees, G. E., & Turner, R. (1998) · Magnetic Resonance in Medicine · doi:10.1002/mrm.1910390109 · Cited by 629
Structure and strength in causal induction☆
Griffiths, T. L., & Tenenbaum, J. B. (2005) · Cognitive Psychology · doi:10.1016/j.cogpsych.2005.05.004 · Cited by 626
Modulation of competing memory systems by distraction
Foerde, K., Knowlton, B. J., & Poldrack, R. A. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0602659103 · Cited by 625
The hippocampus and memory for orderly stimulus relations
Dusek, J. A., & Eichenbaum, H. (1997) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.94.13.7109 · Cited by 615
Huang, Y.-Y., & Kandel, E. R. (1995) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.92.7.2446 · Cited by 544
Model‐Based fMRI and Its Application to Reward Learning and Decision Making
O’Doherty, J. P., Hampton, A. N., & Kim, H. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.022 · Cited by 525
Integrating Memories in the Human Brain: Hippocampal-Midbrain Encoding of Overlapping Events
Daphna Shohamy, A., & Wagner, A. D. (2008) · Neuron · doi:10.1016/j.neuron.2008.09.023 · Cited by 525
Neural correlates of mentalizing-related computations during strategic interactions in humans
Hampton, A. N., Bossaerts, P. L., & O’Doherty, J. P. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0711099105 · Cited by 522
Hippocampal mediation of stimulus representation: A computational theory
Gluck, M. A., & Myers, C. E. (1993) · Hippocampus · doi:10.1002/hipo.450030410 · Cited by 502
A unified framework for addiction: Vulnerabilities in the decision process
Redish, A. D., Jensen, S., & Johnson, A. (2008) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0800472x · Cited by 501
Hampton, A. N., Bossaerts, P., & O’Doherty, J. P. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.1010-06.2006 · Cited by 498
Schott, B. H., Minuzzi, L., Krebs, R. M., Elmenhorst, D., Lang, M., Winz, O. H., Seidenbecher, C. I., Coenen, H. H., Heinze, H.-J., Zilles, K., et al. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.2058-08.2008 · Cited by 496
The computational neurobiology of learning and reward
Daw, N. D., & Doya, K. (2006) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2006.03.006 · Cited by 492
Self-citationDYNAMIC RESPONSE-BY-RESPONSE MODELS OF MATCHING BEHAVIOR IN RHESUS MONKEYS
Lau, B., & Glimcher, P. W. (2005) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.2005.110-04 · Cited by 485
Trial-by-trial data analysis using computational models
Daw, N. D. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199600434.003.0001 · Cited by 475
Self-citationKim, H., Shimojo, S., & O’Doherty, J. P. (2006) · PLoS Biology · doi:10.1371/journal.pbio.0040233 · Cited by 470
Bayesian theories of conditioning in a changing world
Courville, A. C., Daw, N. D., & Touretzky, D. S. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.05.004 · Cited by 457
Self-citationAn automatic valuation system in the human brain: Evidence from functional neuroimaging
Lebreton, M., Jorge, S., Michel, V., Thirion, B., & Pessiglione, M. (2009) · Neuron · doi:10.1016/j.neuron.2009.09.040 · Cited by 455
Activity in human ventral striatum locked to errors of reward prediction
Pagnoni, G., Zink, C. F., Montague, P. R., & Berns, G. S. (2002) · Nature Neuroscience · doi:10.1038/nn802 · Cited by 451
Dorris, M. C., & Glimcher, P. W. (2004) · Neuron · doi:10.1016/j.neuron.2004.09.009 · Cited by 440
The Role of the Hippocampus in Prediction and Imagination
Buckner, R. L. (2010) · Annual Review of Psychology · doi:10.1146/annurev.psych.60.110707.163508 · Cited by 419
SCHACTER, D. L. (1990) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.1990.tb48909.x · Cited by 418
Schönberg, T., Daw, N. D., Joel, D., & O'Doherty, J. P. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2496-07.2007 · Cited by 390
Self-citationOtmakhova, N. A., & Lisman, J. E. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-23-07478.1996 · Cited by 377
The Eyes Have It: Hippocampal Activity Predicts Expression of Memory in Eye Movements
Hannula, D. E., & Ranganath, C. (2009) · Neuron · doi:10.1016/j.neuron.2009.08.025 · Cited by 352
An fMRI study of reward-related probability learning
Delgado, M. R., Miller, M. M., Inati, S., & Phelps, E. A. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.10.002 · Cited by 337
Linking nucleus accumbens dopamine and blood oxygenation
Knutson, B., & Gibbs, S. E. B. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0686-7 · Cited by 337
Frey, U., Schroeder, H., & Matthies, H. (1990) · Brain Research · doi:10.1016/0006-8993(90)91578-5 · Cited by 333
Connectivity-based segregation of the human striatum predicts personality characteristics
Cohen, M. X., Schoene-Bake, J.-C., Elger, C., & Weber, B. (2009) · Nature Neuroscience · doi:10.1038/nn.2228 · Cited by 303
Gasbarri, A., Verney, C., Innocenzi, R., Campana, E., & Pacitti, C. (1994) · Brain Research · doi:10.1016/0006-8993(94)90512-6 · Cited by 302
Distinct Value Signals in Anterior and Posterior Ventromedial Prefrontal Cortex
Smith, D. V., Hayden, B. Y., Truong, T.-K., Song, A. W., Platt, M. L., & Huettel, S. A. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.3319-09.2010 · Cited by 300
Hippocampal contribution to the novel use of relational information in declarative memory
Preston, A. R., Shrager, Y., Dudukovic, N. M., & Gabrieli, J. D. E. (2004) · Hippocampus · doi:10.1002/hipo.20009 · Cited by 296
Striatal activity underlies novelty-based choice in humans
Wittmann, B. C., Daw, N. D., Seymour, B., & Dolan, R. J. (2008) · Neuron · doi:10.1016/j.neuron.2008.04.027 · Cited by 277
Self-citationNeural signature of fictive learning signals in a sequential investment task
Lohrenz, T. M., McCabe, K., Camerer, C. F., & Montague, P. R. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0608842104 · Cited by 276
Mind the Gap: Binding Experiences across Space and Time in the Human Hippocampus
Staresina, B. P., & Davachi, L. (2009) · Neuron · doi:10.1016/j.neuron.2009.06.024 · Cited by 273
Integrating hippocampus and striatum in decision-making
Johnson, A. C., van der Meer, M. A. A., & Redish, A. D. (2007) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2008.01.003 · Cited by 265
Tracking the emergence of conceptual knowledge during human decision making
Kumaran, D., Summerfield, J. J., Hassabis, D., & Maguire, E. A. (2009) · Neuron · doi:10.1016/j.neuron.2009.07.030 · Cited by 260
Zeithamová, D., & Preston, A. R. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.3250-10.2010 · Cited by 246
Dissociating Hippocampal versus Basal Ganglia Contributions to Learning and Transfer
Myers, C. E., Shohamy, D., Gluck, M. A., Grossman, S., Kluger, A., Ferris, S., Golomb, J., Schnirman, G., & Schwartz, R. (2003) · Journal of Cognitive Neuroscience · doi:10.1162/089892903321208123 · Cited by 243
Basal ganglia and dopamine contributions to probabilistic category learning
Shohamy, D., Myers, C. E., Kalanithi, J., & Gluck, M. A. (2007) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2007.07.008 · Cited by 227
van der Meer, M. A. A., Johnson, A. C., Schmitzer-Torbert, N. C., & Redish, A. D. (2010) · Neuron · doi:10.1016/j.neuron.2010.06.023 · Cited by 225
Resistance to forgetting associated with hippocampus-mediated reactivation during new learning
Kuhl, B. A., Shah, A. T., DuBrow, S., & Wagner, A. D. (2010) · Nature Neuroscience · doi:10.1038/nn.2498 · Cited by 225
LINEAR-NONLINEAR-POISSON MODELS OF PRIMATE CHOICE DYNAMICS
Corrado, G. S., Sugrue, L. P., Seung, H. S., & Newsome, W. T. (2005) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.2005.23-05 · Cited by 206
Neural Correlates of Forward Planning in a Spatial Decision Task in Humans
Simon, D. A., & Daw, N. D. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.4647-10.2011 · Cited by 186
Self-citationA Pallidus-Habenula-Dopamine Pathway Signals Inferred Stimulus Values
Bromberg-Martin, E. S., Matsumoto, M., Hong, S., & Hikosaka, O. (2010) · Journal of Neurophysiology · doi:10.1152/jn.00158.2010 · Cited by 186
Signals in Human Striatum Are Appropriate for Policy Update Rather than Value Prediction
Li, J., & Daw, N. D. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.6316-10.2011 · Cited by 159
Self-citationl-dopa impairs learning, but spares generalization, in Parkinson's disease
Daphna Shohamy, A., Myers, C. E., Geghman, K. D., Sage, J., & Gluck, M. A. (2005) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2005.07.013 · Cited by 152
Acquired equivalence and distinctiveness of cues.
Honey, R. C., & Hall, G. (1989) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037//0097-7403.15.4.338 · Cited by 151
An fMRI Analysis of the Human Hippocampus: Inference, Context, and Task Awareness
Greene, A. J., Gross, W. L., Elsinger, C. L., & Rao, S. M. (2006) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2006.18.7.1156 · Cited by 124
Dissociating hippocampal and striatal contributions to sequential prediction learning
Bornstein, A. M., & Daw, N. D. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2011.07920.x · Cited by 123
Self-citationGershman, S. J., Pesaran, B., & Daw, N. D. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.2469-09.2009 · Cited by 118
Self-citationAcquired equivalence and distinctiveness of cues.
Honey, R. C., & Hall, G. (1989) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.15.4.338 · Cited by 111
The Cognitive Neuroscience of Motivation and Learning
Daw, N. D., & Shohamy, D. (2008) · Social Cognition · doi:10.1521/soco.2008.26.5.593 · Cited by 108
Self-citationBrain Hemispheres Selectively Track the Expected Value of Contralateral Options
Palminteri, S., Boraud, T., Lafargue, G., Dubois, B., & Pessiglione, M. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.1500-09.2009 · Cited by 99
Parallel contributions of distinct human memory systems during probabilistic learning
Dickerson, K. C., Li, J., & Delgado, M. R. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.10.080 · Cited by 95
Complementary memory systems: competition, cooperation and compensation
Hartley, T., & Burgess, N. (2005) · Trends in Neurosciences · doi:10.1016/j.tins.2005.02.004 · Cited by 95
Acquired equivalence and distinctiveness of cues.
Honey, R. C., & Hall, G. (1989) · PubMed · Cited by 88
Schönberg, T., O’Doherty, J. P., Joel, D., Inzelberg, R., Segev, Y., & Daw, N. D. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.08.011 · Cited by 83
Self-citationAcquired equivalence and distinctiveness of cues: II. Neural manipulations and their implications.
Coutureau, É., Killcross, S., Good, M. A., Marshall, V. J., Ward-Robinson, J., & Honey, R. C. (2002) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.28.4.388 · Cited by 65
Moustafa, A. A., Myers, C. E., & Gluck, M. A. (2009) · Brain Research · doi:10.1016/j.brainres.2009.04.020 · Cited by 56
Striatal and Medial Temporal Lobe Functional Interactions during Visuomotor Associative Learning
Mattfeld, A. T., & Stark, C. E. L. (2010) · Cerebral Cortex · doi:10.1093/cercor/bhq144 · Cited by 49
ON THE CELLULAR LOCALIZATION OF CATECHOL AMINES IN THE BRAIN
FALCK, B., & Hillarp, N. (2008) · Acta Anatomica · doi:10.1159/000141530 · Cited by 40
Research works printed but not linked: 2
- Eichenbaum H., 2001, From Conditioning to Conscious Recollection: Memory Systems of the Brain
- Thorndike E.L., 1911, Animal Intelligence
Cited by
Sorted by citations
Informatic parcellation of the network involved in the computation of subjective value
Clithero, J. A., & Rangel, A. (2014) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nst106 · Cited by 706
The ubiquity of model-based reinforcement learning
Doll, B. B., Simon, D. A., & Daw, N. D. (2012) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.08.003 · Cited by 380
Self-citationProcess Account of Curiosity and Interest: A Reward-Learning Perspective
Murayama, K., FitzGibbon, L., & Sakaki, M. (2019) · Educational Psychology Review · doi:10.1007/s10648-019-09499-9 · Cited by 334
Miller, K. J., Shenhav, A., & Ludvig, E. A. (2019) · Psychological Review · doi:10.1037/rev0000120 · Cited by 280
Representation of aversive prediction errors in the human periaqueductal gray
Roy, M., Shohamy, D., Daw, N., Jepma, M., Wimmer, G. E., & Wager, T. D. (2014) · Nature Neuroscience · doi:10.1038/nn.3832 · Cited by 246
Self-citation
Metadata
- Authors
- Wimmer, G. E., Daw, N. D., & Shohamy, D.
- Affiliations
- Columbia University (US)
- New York University (US)
- Venue
- European Journal of Neuroscience
- Publisher
- Wiley
- Published
- 2012-04
- Volume
- 35
- Issue
- 7
- Pages
- 1092-1104
- ISSN
- 0953-816X (ISSN-L)
- 1460-9568
- PMC
- PMC3404618
- OpenAlex
- W1535087671
- Cited by
- 111
- References
- 107
- Citations by year
- 2026: 6 · 2025: 4 · 2024: 7 · 2023: 8 · 2022: 9 · 2021: 9 · 2020: 8 · 2019: 11 · 2018: 9 · 2017: 1 · 2016: 14 · 2015: 5 · 2014: 9 · 2013: 6 · 2012: 5
- FWCI
- 4.09
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- European Journal of Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institutes of Health (1r03da026957-01)
- National Institute on Drug Abuse (R03-DA026957)
- National Institute of Neurological Disorders and Stroke (R01NS078784)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Keywords
- reinforcement learning, hippocampus, ventral striatum, relational learning, functional connectivity, computational modeling, choice behavior, reward probability, dopamine
- MeSH terms
- Adolescent, Adult, Basal Ganglia, Female, Generalization, Psychological, Humans, Learning, Male, Photic Stimulation, Psychomotor Performance, Reinforcement, Psychology, Reward, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
