The DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
Dialogues on prediction errors
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Rescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 7,342
Neurophysiological investigation of the basis of the fMRI signal
Logothetis, N. K., Pauls, J., Augath, M., Trinath, T., & Oeltermann, A. (2001) · Nature · doi:10.1038/35084005 · Cited by 6,551
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148
Classical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533
Self-citationThe debate over dopamine’s role in reward: the case for incentive salience
Berridge, K. C. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0578-x · Cited by 2,347
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088
Discrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066
Punishment and aversive behavior
Campbell, B. A., & Church, R. M. (1969) · Appleton-Century-Crofts eBooks · Cited by 1,989
Logothetis, N. K., & Wandell, B. A. (2004) · Annual Review of Physiology · doi:10.1146/annurev.physiol.66.082602.092845 · Cited by 1,568
Temporal difference models and reward-related learning in the human brain
O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003) · Neuron · doi:10.1016/s0896-6273(03)00169-7 · Cited by 1,522
Neuronal Coding of Prediction Errors
Schultz, W., & Dickinson, A. (2000) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.23.1.473 · Cited by 1,427
Lateral habenula as a source of negative reward signals in dopamine neurons
Matsumoto, M., & Hikosaka, O. (2007) · Nature · doi:10.1038/nature05860 · Cited by 1,292
Models of Information Processing in the Basal Ganglia
(1994) · doi:10.7551/mitpress/4708.001.0001 · Cited by 1,190
Neuroeconomics: decision making and the brain
(2014) · Choice Reviews Online · doi:10.5860/choice.51-5702 · Cited by 1,009
Motivational control of goal-directed action
Dickinson, A., & Balleine, B. (1994) · Animal Learning & Behavior · doi:10.3758/bf03199951 · Cited by 995
Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events
Horvitz, J. C. (2000) · Neuroscience · doi:10.1016/s0306-4522(00)00019-1 · Cited by 967
The neural basis of functional brain imaging signals
Attwell, D., & Iadecola, C. (2002) · Trends in Neurosciences · doi:10.1016/s0166-2236(02)02264-6 · Cited by 957
Reward, Motivation, and Reinforcement Learning
Dayan, P., & Balleine, B. W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00963-7 · Cited by 855
Opponent interactions between serotonin and dopamine
Daw, N. D., Kakade, S., & Dayan, P. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00052-7 · Cited by 844
Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli
Mirenowicz, J., & Schultz, W. (1996) · Nature · doi:10.1038/379449a0 · Cited by 829
Uniform Inhibition of Dopamine Neurons in the Ventral Tegmental Area by Aversive Stimuli
Ungless, M. A., Magill, P. J., & Bolam, J. P. (2004) · Science · doi:10.1126/science.1093360 · Cited by 782
Conditioned Reflexes and Neuron Organization.
(1949) · Annals of Internal Medicine · doi:10.7326/0003-4819-31-6-1133_1 · Cited by 688
Neuroeconomics: Decision Making and the Brain
Rushworth, M. F. S., & Walton, M. E. (2009) · Neuron · doi:10.1016/j.neuron.2009.07.005 · Cited by 658
Temporal difference models describe higher-order learning in humans
Seymour, B., O'Doherty, J. P., Dayan, P., Koltzenburg, M., Jones, A. K., Dolan, R. J., Friston, K. J., & Frackowiak, R. S. (2004) · Nature · doi:10.1038/nature02581 · Cited by 605
Roesch, M. R., Calu, D. J., & Schoenbaum, G. (2007) · Nature Neuroscience · doi:10.1038/nn2013 · Cited by 597
Self-citationA Model of How the Basal Ganglia Generate and Use Neural Signals That Predict Reinforcement
Houk, J. C., Adams, J. L., & Barto, A. G. (1994) · Models of Information Processing in the Basal Ganglia · doi:10.7551/mitpress/4708.003.0020 · Cited by 541
Learning and Computational Neuroscience: Foundations of Adaptive Networks
Gabriel, M., & Moore, J. (1990) · Cited by 518
Is the short-latency dopamine response too short to signal reward error?
Redgrave, P., Prescott, T. J., & Gurney, K. (1999) · Trends in Neurosciences · doi:10.1016/s0166-2236(98)01373-3 · Cited by 506
Midbrain dopamine neurons encode decisions for future action
Morris, G., Nevet, A., Arkadir, D., Vaadia, E., & Bergman, H. (2006) · Nature Neuroscience · doi:10.1038/nn1743 · Cited by 503
Actor–critic models of the basal ganglia: new anatomical and computational perspectives
Joel, D., Niv, Y., & Ruppin, E. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00047-3 · Cited by 500
Self-citationTime-Derivative Models of Pavlovian Reinforcement
Sutton, R. S., & Barto, A. G. (1990) · Cited by 499
Roitman, M. F., Wheeler, R. A., & Carelli, R. M. (2005) · Neuron · doi:10.1016/j.neuron.2004.12.055 · Cited by 453
Adaptive Critics and the Basal Ganglia
Barto, A. G. (1994) · Models of Information Processing in the Basal Ganglia · doi:10.7551/mitpress/4708.003.0018 · Cited by 446
Medial prefrontal cell activity signaling prediction errors of action values
Matsumoto, M., Matsumoto, K., Abe, H., & Tanaka, K. (2007) · Nature Neuroscience · doi:10.1038/nn1890 · Cited by 437
Christoph, G., Leonzio, R., & Wilcox, K. (1986) · The Journal of Neuroscience · doi:10.1523/jneurosci.06-03-00613.1986 · Cited by 418
Ji, H., & Shepard, P. D. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.0958-07.2007 · Cited by 388
Gallagher, M., Graham, P., & Holland, P. (1990) · The Journal of Neuroscience · doi:10.1523/jneurosci.10-06-01906.1990 · Cited by 359
Expectation modulates neural responses to pleasant and aversive stimuli in primate amygdala
Belova, M. A., Paton, J. J., Morrison, S. E., & Salzman, C. D. (2007) · Neuron · doi:10.1016/j.neuron.2007.08.004 · Cited by 349
Dopaminergic regulation of cerebral cortical microcirculation
Krimer, L. S., Muly, E. C., Williams, G. V., & Goldman-Rakic, P. S. (1998) · Nature Neuroscience · doi:10.1038/1099 · Cited by 327
Inhibition of avoidance behavior.
Rescorla, R. A., & Lolordo, V. M. (1965) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0022060 · Cited by 323
Coding of Predicted Reward Omission by Dopamine Neurons in a Conditioned Inhibition Paradigm
Tobler, P. N., Dickinson, A., & Schultz, W. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-32-10402.2003 · Cited by 300
Reynolds, G. S. (1961) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1961.4-203 · Cited by 294
Reward-Related Neuronal Activity During Go-Nogo Task Performance in Primate Orbitofrontal Cortex
Tremblay, L., & Schultz, W. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.83.4.1864 · Cited by 285
Costa, R. M., Lin, S.-C., Sotnikova, T. D., Cyr, M., Gainetdinov, R. R., Caron, M. G., & Nicolelis, M. A. L. (2006) · Neuron · doi:10.1016/j.neuron.2006.07.030 · Cited by 284
Representation of Spatial Goals in Rat Orbitofrontal Cortex
Feierstein, C. E., Quirk, M. C., Uchida, N., Sosulski, D. L., & Mainen, Z. F. (2006) · Neuron · doi:10.1016/j.neuron.2006.06.032 · Cited by 252
Orbitofrontal cortex is activated during breaches of expectation in tasks of visual attention
Nobre, A. C., Coull, J. T., Frith, C. D., & Mesulam, M. M. (1999) · Nature Neuroscience · doi:10.1038/4513 · Cited by 249
Neural Encoding in Ventral Striatum during Olfactory Discrimination Learning
Setlow, B., Schoenbaum, G., & Gallagher, M. (2003) · Neuron · doi:10.1016/s0896-6273(03)00264-2 · Cited by 224
Self-citationHuman neural learning depends on reward prediction errors in the blocking paradigm.
Tobler, P. N., O’Doherty, J. P., Dolan, R. J., & Schultz, W. (2006) · Journal of Neurophysiology · doi:10.1152/jn.00762.2005 · Cited by 209
Nicola, S. M., Yun, I. A., Wakabayashi, K. T., & Fields, H. L. (2004) · Journal of Neurophysiology · doi:10.1152/jn.00657.2003 · Cited by 196
Statistics of Midbrain Dopamine Neuron Spike Trains in the Awake Primate
Bayer, H. M., Lau, B., & Glimcher, P. W. (2007) · Journal of Neurophysiology · doi:10.1152/jn.01140.2006 · Cited by 187
Nucleus accumbens cell firing during goal-directed behaviors for cocaine vs. ‘natural’ reinforcement
Carelli, R. M. (2002) · Physiology & Behavior · doi:10.1016/s0031-9384(02)00760-6 · Cited by 185
Separate brain regions code for salience vs. valence during reward prediction in humans
Jensen, J., Smith, A. J., Willeit, M., Crawley, A. P., Mikulis, D. J., Vitcu, I., & Kapur, S. (2007) · Human Brain Mapping · doi:10.1002/hbm.20274 · Cited by 178
Holland, P. C., & Gallagher, M. (1993) · Behavioral Neuroscience · doi:10.1037//0735-7044.107.2.246 · Cited by 160
The Role of an Amygdalo-Nigrostriatal Pathway in Associative Learning
Han, J., McMahan, R. W., Holland, P. C., & Gallagher, M. (1997) · Journal of Neuroscience · doi:10.1523/jneurosci.17-10-03913.1997 · Cited by 156
Menon, M., Jensen, J., Vitcu, I., Graff‐Guerrero, A., Crawley, A. P., Smith, M. A., & Kapur, S. (2007) · Biological Psychiatry · doi:10.1016/j.biopsych.2006.10.020 · Cited by 148
Reduction in the effectiveness of reinforcement after prior excitatory conditioning
Rescorla, R. A. (1970) · Learning and Motivation · doi:10.1016/0023-9690(70)90101-3 · Cited by 147
The Rescorla-Wagner model: Losses in associative strength in compound conditioned stimuli.
Kremer, E. F. (1978) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037//0097-7403.4.1.22 · Cited by 126
Neural Correlates of Olfactory Recognition Memory in the Rat Orbitofrontal Cortex
Ramus, S. J., & Eichenbaum, H. (2000) · Journal of Neuroscience · doi:10.1523/jneurosci.20-21-08199.2000 · Cited by 120
Coizet, V., Dommett, E. J., Redgrave, P., & Overton, P. G. (2006) · Neuroscience · doi:10.1016/j.neuroscience.2006.01.030 · Cited by 92
Carelli, R. M., & Wondolowski, J. (2003) · Journal of Neuroscience · doi:10.1523/jneurosci.23-35-11214.2003 · Cited by 86
Reward Prediction Error Computation in the Pedunculopontine Tegmental Nucleus Neurons
Kobayashi, Y., & Okada, K. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.003 · Cited by 79
Theoretical and Empirical Studies of Learning
Niv, Y., & Montague, P. R. (2009) · Elsevier eBooks · doi:10.1016/b978-0-12-374176-9.00022-1 · Cited by 68
Self-citation
Cited by
Why do humans reason? Arguments for an argumentative theory
Mercier, H., & Sperber, D. (2011) · Behavioral and Brain Sciences · doi:10.1017/s0140525x10000968 · Cited by 2,254
Sescousse, G., Caldú, X., Segura, B., & Dreher, J.-C. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.02.002 · Cited by 782
Reinforcement learning in the brain
Niv, Y. (2009) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2008.12.005 · Cited by 717
Self-citationFrom prediction error to incentive salience: mesolimbic computation of reward motivation.
Berridge, K. C. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.07990.x · Cited by 700
Superior Colliculus and Visual Spatial Attention
Krauzlis, R. J., Lovejoy, L. P., & Zénon, A. (2013) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-062012-170249 · Cited by 660
Metadata
- Authors
- Niv, Y., & Schoenbaum, G.
- Venue
- Trends in Cognitive Sciences
- Publisher
- Elsevier BV
- Published
- 2008-07
- Volume
- 12
- Issue
- 7
- Pages
- 265-272
- ISSN
- 1364-6613 (ISSN-L)
- OpenAlex
- W2117277172
- Cited by
- 344
- References
- 67
- FWCI
- 1.01
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.