The DOI matches its Crossref record.
Contemporary Animal Learning Theory
Abstract
Foreword Jeffrey Gray Preface 1. Introduction 2. Conditions of learning 3. Associative representations 4. Mechanisms of learning References Index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
Gray, J. A. (1982) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00013066 · Cited by 4,477
Getting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574
Shortcut learning in deep neural networks
Geirhos, R., Jacobsen, J.-H., Michaelis, C., Zemel, R., Brendel, W., Bethge, M., & Wichmann, F. A. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-00257-z · Cited by 2,224
Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex
Cardinal, R. N., Parkinson, J. A., Hall, J., & Everitt, B. J. (2002) · Neuroscience & Biobehavioral Reviews · doi:10.1016/s0149-7634(02)00007-6 · Cited by 2,129
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066
The prefontral cortex and cognitive control
Miller, E. K. (2000) · Nature Reviews Neuroscience · doi:10.1038/35036228 · Cited by 2,016
Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans
Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J., & Frith, C. D. (2006) · Nature · doi:10.1038/nature05051 · Cited by 1,584
Behavioral Theories and the Neurophysiology of Reward
Schultz, W. (2006) · Annual Review of Psychology · doi:10.1146/annurev.psych.56.091103.070229 · Cited by 1,637
Goal-directed instrumental action: contingency and incentive learning and their cortical substrates
Balleine, B. W., & Dickinson, A. (1998) · Neuropharmacology · doi:10.1016/s0028-3908(98)00033-1 · Cited by 1,541
Self-citationBrain Systems that Mediate both Emotion and Cognition
Gray, J. A. (1990) · Cognition & Emotion · doi:10.1080/02699939008410799 · Cited by 1,400
Prefrontal executive and cognitive functions in rodents: neural and neurochemical substrates
Dalley, J. W., Cardinal, R. N., & Robbins, T. W. (2004) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2004.09.006 · Cited by 1,329
Hippocampal synaptic enhancement and information storage within a distributed memory system
McNaughton, B. L., & Morris, R. G. M. (1987) · Trends in Neurosciences · doi:10.1016/0166-2236(87)90011-7 · Cited by 1,304
Actions and habits: The development of behavioural autonomy
Dickinson, A. (1985) · Philosophical Transactions of the Royal Society of London. B, Biological Sciences · doi:10.1098/rstb.1985.0010 · Cited by 1,217
Self-citationNeuronal Reward and Decision Signals: From Theories to Data
Schultz, W. (2015) · Physiological Reviews · doi:10.1152/physrev.00023.2014 · Cited by 1,126
Human volition: towards a neuroscience of will
Haggard, P. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2497 · Cited by 1,134
Dopamine neurons report an error in the temporal prediction of reward during learning
Hollerman, J. R., & Schultz, W. (1998) · Nature Neuroscience · doi:10.1038/1124 · Cited by 1,117
Dopamine responses comply with basic assumptions of formal learning theory
Waelti, P., Dickinson, A., & Schultz, W. (2001) · Nature · doi:10.1038/35083500 · Cited by 1,018
Self-citationFrom an animal's point of view: Motivation, fitness, and animal welfare
Dawkins, M. S. (1990) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00077104 · Cited by 1,014
SOCIAL LEARNING IN ANIMALS: CATEGORIES AND MECHANISMS
HEYES, C. M. (1994) · Biological Reviews · doi:10.1111/j.1469-185x.1994.tb01506.x · Cited by 1,010
Toward a general psychobiological theory of emotions
Panksepp, J. (1982) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00012759 · Cited by 999
Motivational control of goal-directed action
Dickinson, A., & Balleine, B. (1994) · Animal Learning & Behavior · doi:10.3758/bf03199951 · Cited by 995
Self-citationResponses of monkey dopamine neurons during learning of behavioral reactions
Ljungberg, T., Apicella, P., & Schultz, W. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.67.1.145 · Cited by 987
Spatial memory and hippocampal function
Olton, D. S., & Paras, B. C. (1979) · Neuropsychologia · doi:10.1016/0028-3932(79)90042-3 · Cited by 936
Temporal Prediction Errors in a Passive Learning Task Activate Human Striatum
McClure, S. M., Berns, G. S., & Montague, P. R. (2003) · Neuron · doi:10.1016/s0896-6273(03)00154-5 · Cited by 917
Biology and the Future of Psychoanalysis: A New Intellectual Framework for Psychiatry Revisited
Kandel, E. R. (1999) · American Journal of Psychiatry · doi:10.1176/ajp.156.4.505 · Cited by 861
Tactical deception in primates
Whiten, A., & Byrne, R. W. (1988) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00049682 · Cited by 860
Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli
Mirenowicz, J., & Schultz, W. (1996) · Nature · doi:10.1038/379449a0 · Cited by 829
Theory of mind in nonhuman primates
Heyes, C. M. (1998) · Behavioral and Brain Sciences · doi:10.1017/s0140525x98000703 · Cited by 777
Dopamine neurons and their role in reward mechanisms
Schultz, W. (1997) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(97)80007-4 · Cited by 766
The propositional nature of human associative learning
Mitchell, C. J., De Houwer, J., & Lovibond, P. F. (2009) · Behavioral and Brain Sciences · doi:10.1017/s0140525x09000855 · Cited by 753
Neuronal activity in monkey ventral striatum related to the expectation of reward
Schultz, W., Apicella, P., Scarnati, E., & Ljungberg, T. (1992) · The Journal of Neuroscience · doi:10.1523/jneurosci.12-12-04595.1992 · Cited by 741
Conservation of hippocampal memory function in rats and humans
Bunsey, M., & Eichenbaum, H. (1996) · Nature · doi:10.1038/379255a0 · Cited by 733
Behavioral studies of Pavlovian conditioning
Rescorla, R. A. (1988) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.11.030188.001553 · Cited by 715
The role of awareness in Pavlovian conditioning: Empirical evidence and theoretical implications.
Lovibond, P. F., & Shanks, D. R. (2002) · Journal of Experimental Psychology: Animal Behavior Processes · doi:10.1037//0097-7403.28.1.3 · Cited by 698
Comparison between the behavioural effects of septal and hippocampal lesions: A review
Gray, J. A., & McNaughton, N. (1983) · Neuroscience & Biobehavioral Reviews · doi:10.1016/0149-7634(83)90014-3 · Cited by 658
Frith, C. D. (1987) · Psychological Medicine · doi:10.1017/s0033291700025873 · Cited by 655
Acetylcholine: a neurotransmitter for learning and memory?
Blokland, A. (1995) · Brain Research Reviews · doi:10.1016/0165-0173(95)00016-x · Cited by 613
Spatial Cognition and the Brain
Burgess, N. (2008) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1440.002 · Cited by 614
Variations in the Sensitivity of Instrumental Responding to Reinforcer Devaluation
Adams, C. D. (1982) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/14640748208400878 · Cited by 609
Temporal difference models describe higher-order learning in humans
Seymour, B., O'Doherty, J. P., Dayan, P., Koltzenburg, M., Jones, A. K., Dolan, R. J., Friston, K. J., & Frackowiak, R. S. (2004) · Nature · doi:10.1038/nature02581 · Cited by 605
Sense and nonsense: evolutionary perspectives on human behaviour
(2003) · Choice Reviews Online · doi:10.5860/choice.40-3388 · Cited by 602
Risky Theories—The Effects of Variance on Foraging Decisions
KACELNIK, A., & BATESON, M. (1996) · American Zoologist · doi:10.1093/icb/36.4.402 · Cited by 569
Markou, A., Weiss, F., Gold, L. H., Caine, S. B., Schulteis, G., & Koob, G. F. (1993) · Psychopharmacology · doi:10.1007/bf02244907 · Cited by 559
Signalers and Receivers in Animal Communication
Seyfarth, R. M., & Cheney, D. L. (2003) · Annual Review of Psychology · doi:10.1146/annurev.psych.54.101601.145121 · Cited by 546
Synthetic grammar learning: Implicit rule abstraction or explicit fragmentary knowledge?
Perruchet, P., & Pacteau, C. (1990) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.119.3.264 · Cited by 526
Contrasting roles for cingulate and orbitofrontal cortex in decisions and social behaviour
Rushworth, M. F. S., Behrens, T. E. J., Rudebeck, P. H., & Walton, M. E. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.01.004 · Cited by 507
Is the short-latency dopamine response too short to signal reward error?
Redgrave, P., Prescott, T. J., & Gurney, K. (1999) · Trends in Neurosciences · doi:10.1016/s0166-2236(98)01373-3 · Cited by 506
Learning and selective attention
Dayan, P., Kakade, S., & Montague, P. R. (2000) · Nature Neuroscience · doi:10.1038/81504 · Cited by 495
Startle reactivity and anxiety disorders: aversive conditioning, context, and neurobiology
Grillon, C. (2002) · Biological Psychiatry · doi:10.1016/s0006-3223(02)01665-7 · Cited by 494
Knowledge-based causal attribution: The abnormal conditions focus model.
Hilton, D. J., & Slugoski, B. R. (1986) · Psychological Review · doi:10.1037/0033-295x.93.1.75 · Cited by 503
What's social about social learning?
Heyes, C. (2012) · Journal of Comparative Psychology · doi:10.1037/a0025180 · Cited by 454
Schenk, F., & Morris, R. G. M. (1985) · Experimental Brain Research · doi:10.1007/bf00238949 · Cited by 418
Impulsivity: a discussion of clinical and experimental findings
Evenden, J. (1999) · Journal of Psychopharmacology · doi:10.1177/026988119901300211 · Cited by 417
Disentangling the Roles of Approach, Activation and Valence in Instrumental and Pavlovian Responding
Huys, Q. J. M., Cools, R., Gölzer, M., Friedel, E., Heinz, A., Dolan, R. J., & Dayan, P. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002028 · Cited by 416
The prefrontal cortex: categories, concepts and cognition
Miller, E. K., Freedman, D. J., & Wallis, J. D. (2002) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.2002.1099 · Cited by 414
What is learning? On the nature and merits of a functional definition of learning
De Houwer, J., Barnes-Holmes, D., & Moors, A. (2013) · Psychonomic Bulletin & Review · doi:10.3758/s13423-013-0386-3 · Cited by 404
Judgement of Act-Outcome Contingency: The Role of Selective Attribution
Dickinson, A., Shanks, D., & Evenden, J. (1984) · The Quarterly Journal of Experimental Psychology Section A · doi:10.1080/14640748408401502 · Cited by 398
Self-citationPrécis of The brain and emotion
Rolls, E. T. (2000) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00002429 · Cited by 397
Serotonin in Affective Control
Dayan, P., & Huys, Q. J. M. (2009) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.051508.135607 · Cited by 381
Influence of Reward Expectation on Behavior-Related Neuronal Activity in Primate Striatum
Hollerman, J. R., Tremblay, L., & Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.2.947 · Cited by 380
Bateson, P. (1991) · Animal Behaviour · doi:10.1016/s0003-3472(05)80127-7 · Cited by 376
Avoidance learning: a review of theoretical models and recent developments
Krypotos, A.-M. (2015) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2015.00189 · Cited by 375
Öhman, A., & Soares, J. J. (1993) · Journal of Abnormal Psychology · doi:10.1037//0021-843x.102.1.121 · Cited by 375
The comparative psychology of intelligence
Macphail, E. M. (1987) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00054984 · Cited by 372
DECLARATIVE MEMORY: Insights from Cognitive Neurobiology
Eichenbaum, H. (1997) · Annual Review of Psychology · doi:10.1146/annurev.psych.48.1.547 · Cited by 371
Altered awareness of action in schizophrenia: a specific deficit in predicting action consequences
Voss, M., Moore, J., Hauser, M., Gallinat, J., Heinz, A., & Haggard, P. (2010) · Brain · doi:10.1093/brain/awq152 · Cited by 366
Morris, R. G. M., & Frey, U. (1997) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.1997.0136 · Cited by 364
De Houwer, J. (2009) · Learning & Behavior · doi:10.3758/lb.37.1.1 · Cited by 362
Pavlovian Conditioning: A Functional Perspective
Domjan, M. (2005) · Annual Review of Psychology · doi:10.1146/annurev.psych.55.090902.141409 · Cited by 360
A cognitive action theory of post-traumatic stress disorder
Chemtob, C., Roitblat, H. L., Hamada, R. S., Carlson, J. G., & Twentyman, C. T. (1988) · Journal of Anxiety Disorders · doi:10.1016/0887-6185(88)90006-0 · Cited by 355
Sources of relapse after extinction in Pavlovian and instrumental learning
Bouton, M. E., & Swartzentruber, D. (1991) · Clinical Psychology Review · doi:10.1016/0272-7358(91)90091-8 · Cited by 349
A learning theory perspective on lapse, relapse, and the maintenance of behavior change.
Bouton, M. E. (2000) · Health Psychology · doi:10.1037/0278-6133.19.suppl1.57 · Cited by 341
Cardinal, R. N., Robbins, T. W., & Everitt, B. J. (2000) · Psychopharmacology · doi:10.1007/s002130000536 · Cited by 338
Attention and associative learning in humans: An integrative review.
Le Pelley, M. E., Mitchell, C. J., Beesley, T., George, D. N., & Wills, A. J. (2016) · Psychological Bulletin · doi:10.1037/bul0000064 · Cited by 329
Emotion, decision making, and the amygdala.
Seymour, B., & Dolan, R. (2008) · Neuron · doi:10.1016/j.neuron.2008.05.020 · Cited by 324
Reward prediction in primate basal ganglia and frontal cortex
Schultz, W., Tremblay, L., & Hollerman, J. R. (1998) · Neuropharmacology · doi:10.1016/s0028-3908(98)00071-9 · Cited by 318
Mechanisms involved in the observational conditioning of fear.
Mineka, S., & Cook, M. (1993) · Journal of Experimental Psychology: General · doi:10.1037//0096-3445.122.1.23 · Cited by 317
The cognitive basis of model-based reasoning in science
Nersessian, N. J. (2002) · The Cognitive Basis of Science · doi:10.1017/cbo9780511613517.008 · Cited by 313
Toward a Unified Model of Attention in Associative Learning
Kruschke, J. K. (2001) · Journal of Mathematical Psychology · doi:10.1006/jmps.2000.1354 · Cited by 309
Pathways of the Past: the Imprint of Memory
Horn, G. (2004) · Nature reviews. Neuroscience · doi:10.1038/nrn1324 · Cited by 308
Neuroscience and approach/avoidance personality traits: A two stage (valuation–motivation) approach
Corr, P. J., & McNaughton, N. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2012.09.013 · Cited by 308
Correlated Coding of Motivation and Outcome of Decision by Dopamine Neurons
Satoh, T., Nakai, S., Sato, T., & Kimura, M. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-30-09913.2003 · Cited by 298
Experience modulates automatic imitation
Heyes, C., Bird, G., Johnson, H., & Haggard, P. (2005) · Cognitive Brain Research · doi:10.1016/j.cogbrainres.2004.09.009 · Cited by 290
Suri, R. E., & Schultz, W. (1999) · Neuroscience · doi:10.1016/s0306-4522(98)00697-6 · Cited by 294
Reward-Related Neuronal Activity During Go-Nogo Task Performance in Primate Orbitofrontal Cortex
Tremblay, L., & Schultz, W. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.83.4.1864 · Cited by 285
Distinct error-correcting and incidental learning of location relative to landmarks and boundaries
Doeller, C. F., & Burgess, N. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0711433105 · Cited by 283
Alcohol seeking by rats: action or habit?
Dickinson, A., Wood, N., & Smith, J. W. (2002) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/0272499024400016 · Cited by 268
Self-citationActivation of the human brain by monetary reward
Thut, G., Schultz, W., Roelcke, U., Nienhusmeier, M., Missimer, J., Maguire, R. P., & Leenders, K. L. (1997) · NeuroReport · doi:10.1097/00001756-199703240-00033 · Cited by 272
Modifications of Reward Expectation-Related Neuronal Activity During Learning in Primate Striatum
Tremblay, L., Hollerman, J. R., & Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.2.964 · Cited by 268
Human contingency judgments: Rule based or associative?
Allan, L. G. (1993) · Psychological Bulletin · doi:10.1037//0033-2909.114.3.435 · Cited by 267
Limbic Corticostriatal Systems and Delayed Reinforcement
CARDINAL, R. N., WINSTANLEY, C. A., ROBBINS, T. W., & EVERITT, B. J. (2004) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1308.004 · Cited by 265
Learning: From Association to Cognition
Shanks, D. R. (2010) · Annual Review of Psychology · doi:10.1146/annurev.psych.093008.100519 · Cited by 262
Effects of mnemonic strategy manipulation in a Von Restorff paradigm
Fabiani, M., Karis, D., & Donchin, E. (1990) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(90)90149-e · Cited by 253
Neural systems implicated in delayed and probabilistic reinforcement
Cardinal, R. N. (2006) · Neural Networks · doi:10.1016/j.neunet.2006.03.004 · Cited by 248
Darwin in Mind: New Opportunities for Evolutionary Psychology
Bolhuis, J. J., Brown, G. R., Richardson, R. C., & Laland, K. N. (2011) · PLoS Biology · doi:10.1371/journal.pbio.1001109 · Cited by 242
Davey, G. C. L. (1992) · Advances in Behaviour Research and Therapy · doi:10.1016/0146-6402(92)90010-l · Cited by 240
The neurobiology of punishment
Seymour, B., Singer, T., & Dolan, R. (2007) · Nature Reviews Neuroscience · doi:10.1038/nrn2119 · Cited by 240
Depression: a decision-theoretic analysis
Huys, Q. J. M., Daw, N. D., & Dayan, P. (2015) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-071714-033928 · Cited by 221
Metadata
- Authors
- LoLordo, V. M., & Dickinson, A.
- Venue
- The American Journal of Psychology
- Publisher
- University of Illinois Press
- Published
- 1982
- Volume
- 95
- Issue
- 1
- Pages
- 170
- ISSN
- 0002-9556 (ISSN-L)
- OpenAlex
- W2011309507
- Cited by
- 888
- References
- 0
- FWCI
- 33.65
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.