The DOI matches its Crossref record; 58 of the 58 references it cites were found in a registry or an index.
The misbehavior of value and the discipline of the will
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1978) · UA Campus Repository (The University of Arizona) · Cited by 8,010
Cognitive maps in rats and men
Tolman, E. C. (1948) · Psychological Review · doi:10.1037/h0061626 · Cited by 6,641
Golden eggs and hyperbolic discounting
Laibson, D. (1997) · The Quarterly Journal of Economics · doi:10.1162/003355397555253 · Cited by 6,122
Watkins, C. (1989) · OpenGrey (Institut de l'Information Scientifique et Technique) · doi:10.17863/cam.132164 · Cited by 5,297
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148
The hippocampus as a cognitive map
Passingham, R. E. (1979) · Neuroscience · doi:10.1016/0306-4522(79)90015-0 · Cited by 5,128
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
Classical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449
Neuronlike adaptive elements that can solve difficult learning control problems
Barto, A. G., Sutton, R. S., & Anderson, C. W. (1983) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1983.6313077 · Cited by 3,233
Separate neural systems value immediate and delayed monetary rewards
McClure, S. M., Laibson, D. I., Loewenstein, G., & Cohen, J. D. (2004) · Science · doi:10.1126/science.1100907 · Cited by 3,089
Barto, A. G. (1998) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)38315-5 · Cited by 2,976
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533
Self-citationPfanzagl, J., & Luce, R. D. (1962) · Econometrica · doi:10.2307/1911299 · Cited by 2,469
The Psychology of Animal Learning
Hill, W. F., & Mackintosh, N. J. (1976) · The American Journal of Psychology · doi:10.2307/1421765 · Cited by 2,388
Anomalies in Intertemporal Choice: Evidence and an Interpretation
Loewenstein, G., & Prelec, D. (1992) · The Quarterly Journal of Economics · doi:10.2307/2118482 · Cited by 2,305
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088
Self-citationA framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066
Self-citationThe psychology of animal learning
Lea, S. E. G. (1975) · Animal Behaviour · doi:10.1016/0003-3472(75)90150-5 · Cited by 2,056
(2020) · Machine Learning and Visual Perception · doi:10.1515/9783110595567-011 · Cited by 1,930
Learning and Memory Functions of the Basal Ganglia
Packard, M. G., & Knowlton, B. J. (2002) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.25.112701.142937 · Cited by 1,717
Köhler, W. (1948) · Readings in the history of psychology. · doi:10.1037/11304-054 · Cited by 1,582
Goal-directed instrumental action: contingency and incentive learning and their cortical substrates
Balleine, B. W., & Dickinson, A. (1998) · Neuropharmacology · doi:10.1016/s0028-3908(98)00033-1 · Cited by 1,541
AUTO‐SHAPING OF THE PIGEON'S KEY‐PECK1
Brown, P. L., & Jenkins, H. M. (1968) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1968.11-1 · Cited by 1,537
Reward representations and reward-related learning in the human brain: Insights from neuroimaging
O’Doherty, J. P. (2004) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2004.10.016 · Cited by 1,426
Conditioning and Associative Learning
Hill, W. F., & Mackintosh, N. J. (1984) · The American Journal of Psychology · doi:10.2307/1422540 · Cited by 1,302
Actions and habits: The development of behavioural autonomy
Dickinson, A. (1985) · Philosophical Transactions of the Royal Society of London. B, Biological Sciences · doi:10.1098/rstb.1985.0010 · Cited by 1,217
Models of Information Processing in the Basal Ganglia
(1994) · doi:10.7551/mitpress/4708.001.0001 · Cited by 1,190
Putting a spin on the dorsal-ventral divide of the striatum
Voorn, P., Vanderschuren, L. J. M. J., Groenewegen, H. J., Robbins, T. W., & Pennartz, C. M. A. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.06.006 · Cited by 1,188
Breland, K., & Breland, M. (1961) · American Psychologist · doi:10.1037/h0040090 · Cited by 1,181
(1947) · Harvard Educational Review · Cited by 967
Ainslie, G. (2001) · Cambridge University Press eBooks · doi:10.1017/cbo9781139164191 · Cited by 955
Reward, Motivation, and Reinforcement Learning
Dayan, P., & Balleine, B. W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00963-7 · Cited by 855
Self-citationDISCOUNTING OF DELAYED REWARDS: MODELS OF INDIVIDUAL CHOICE
Myerson, J., & Green, L. (1995) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1995.64-263 · Cited by 841
Parallel neural networks for learning sequential procedures
Hikosaka, O., Nakahara, H., Rand, M. K., Sakai, K., Lu, X., Nakamura, K., Miyachi, S., & Doya, K. (1999) · Trends in Neurosciences · doi:10.1016/s0166-2236(99)01439-3 · Cited by 799
Coordination of Actions and Habits in the Medial Prefrontal Cortex of Rats
Killcross, S. (2003) · Cerebral Cortex · doi:10.1093/cercor/13.4.400 · Cited by 748
What are the computations of the cerebellum, the basal ganglia and the cerebral cortex?
Doya, K. (1999) · Neural Networks · doi:10.1016/s0893-6080(99)00046-5 · Cited by 747
AUTO‐MAINTENANCE IN THE PIGEON: SUSTAINED PECKING DESPITE CONTINGENT NON‐REINFORCEMENT2
Williams, D. R., & Williams, H. (1969) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1969.12-511 · Cited by 712
A Model of How the Basal Ganglia Generate and Use Neural Signals That Predict Reinforcement
Houk, J. C., Adams, J. L., & Barto, A. G. (1994) · Models of Information Processing in the Basal Ganglia · doi:10.7551/mitpress/4708.003.0020 · Cited by 541
Learning and Computational Neuroscience: Foundations of Adaptive Networks
Gabriel, M., & Moore, J. (1990) · Cited by 518
Learning and selective attention
Dayan, P., Kakade, S., & Montague, P. R. (2000) · Nature Neuroscience · doi:10.1038/81504 · Cited by 495
Self-citationRelations between Pavlovian-instrumental transfer and reinforcer devaluation
Holland, P. C. (2004) · Journal of Experimental Psychology: Animal Behavior Processes · doi:10.1037/0097-7403.30.2.104 · Cited by 388
Animal Spirits: Affective and Deliberative Processes in Economic Behavior
Loewenstein, G. F., & O'Donoghue, T. (2004) · SSRN Electronic Journal · doi:10.2139/ssrn.539843 · Cited by 388
Learning and Sequential Decision Making
Barto, A. G., Sutton, R. S., & Watkins, C. (1989) · Cited by 357
Coutureau, E., & Killcross, S. (2003) · Behavioural Brain Research · doi:10.1016/j.bbr.2003.09.025 · Cited by 342
A model of hippocampally dependent navigation, using the temporal difference learning rule
Foster, D. J., Morris, R. G. M., & Dayan, P. (2000) · Hippocampus · doi:10.1002/(sici)1098-1063(2000)10:1<1::aid-hipo1>3.0.co;2-1 · Cited by 290
Self-citationOwen, A. M. (1997) · Progress in Neurobiology · doi:10.1016/s0301-0082(97)00042-7 · Cited by 251
Learning of sequential movements by neural network model with dopamine-like reinforcement signal
Suri, R. E., & Schultz, W. (1998) · Experimental Brain Research · doi:10.1007/s002210050467 · Cited by 197
An approach through the looking-glass
Hershberger, W. A. (1986) · Animal Learning & Behavior · doi:10.3758/bf03200092 · Cited by 156
The effects of termination of the CS and avoidance of the US on avoidance learning.
Kamin, L. J. (1956) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0088011 · Cited by 149
A theory of pavlovian conditioning: The effectiveness of reinforcement and non-reinforcement
Rescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 108
Does CS termination reinforce avoidance behavior?
Bolles, R. C., Stokes, L. W., & Younger, M. S. (1966) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0023678 · Cited by 103
Cropper, M., Aydede, S. K., & Portney, P. R. (1991) · American Journal of Agricultural Economics · doi:10.2307/1242393 · Cited by 103
Learning, motivation, and emotion
Stevens, S. S., & Gallistel, C. R. (2002) · Wiley eBooks · Cited by 71
Modulation of Elicited Behavior by a Fixed-Interval Schedule of Electric Shock Presentation
Morse, W. H., Mead, R. N., & Kelleher, R. T. (1967) · Science · doi:10.1126/science.157.3785.215 · Cited by 69
Baird, I., & Leemon, C. (1993) · Defense Technical Information Center (DTIC) · doi:10.21236/ada280862 · Cited by 61
Coleman, S. R. (1975) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0076413 · Cited by 50
Lee, N. (2024) · Encyclopedia of Computer Graphics and Games · doi:10.1007/978-3-031-23161-2_301006 · Cited by 39
A computational inquiry into navigation, with particular reference to the hippocampus
Foster, D. J. (1999) · ERA · Cited by 1
Cited by
A framework for studying the neurobiology of value-based decision making
Rangel, A., Camerer, C., & Montague, P. R. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2357 · Cited by 2,184
Dolan, R. J., & Dayan, P. (2013) · Neuron · doi:10.1016/j.neuron.2013.09.007 · Cited by 977
Self-citationFrom reinforcement learning models to psychiatric and neurological disorders
Maia, T. V., & Frank, M. J. (2011) · Nature Neuroscience · doi:10.1038/nn.2723 · Cited by 722
Reinforcement learning in the brain
Niv, Y. (2009) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2008.12.005 · Cited by 717
Self-citationReinforcement learning: The Good, The Bad and The Ugly
Dayan, P., & Niv, Y. (2008) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2008.08.003 · Cited by 704
Self-citation
Metadata
- Authors
- Dayan, P., Niv, Y., Seymour, B., & D. Daw, N.
- Venue
- Neural Networks
- Publisher
- Elsevier BV
- Published
- 2006-10
- Volume
- 19
- Issue
- 8
- Pages
- 1153-1160
- ISSN
- 0893-6080 (ISSN-L)
- OpenAlex
- W2100660722
- Cited by
- 388
- References
- 58
- FWCI
- 12.63
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.