A model for Pavlovian learning: Variations in the effectiveness of conditioned but not of unconditioned stimuli.
Abstract
Several formal models of excitatory classical conditioning are reviewed. It is suggested that a central problem for all of them is the explanation of cases in which learning does not occur in spite of the fact that the conditioned stimulus is a signal for the reinforcer. We propose a new model that deals with this problem by specifying that certain procedures cause a conditioned stimulus (CS) to lose effectiveness; in particular, we argue that a CS will lose associability when its consequences are accurately predicted. In contrast to other current models, the effectiveness of the reinforcer remains constant throughout conditioning. The second part of the article presents a reformulation of the nature of the learning produced by inhibitory-conditioning procedures and a discussion of the way in which such learning can be accommodated within the model outlined for excitatory learning. A recent review of classical conditioning (Dickinson & Mackintosh, 1978) suggests that the underlying associative process is "responsible for organisms learning about the relationships between events, enabling them to build up an associative representation of the causal structure of their environment" (p. 588). According to this view the occurrence of a conditioned response (CR) as a result of the pairing of a conditioned stimulus (CS) and an unconditioned stimulus (US) is regarded as being merely an index of the formation of some internal representation of the relationship between CS and US. The first task of a theory of classical conditioning becomes that of This work was supported by grants from the United Kingdom Science and Medical Research Councils. We have made free use of many suggestions, especially concerning inhibitory learning, made by A. Dickinson. We thank him and also C. Adams, P. Bailey, S. Channel!, N. Mackintosh, and E. Macphail for their comments on earlier versions of this article. Requests for reprints should be sent to John Pearce,
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
According to the Pearce-Hall model, attention to cues that predict a reinforcer should decline as the reinforcer becomes better predicted during extended conditioning.
“according to at least one venerable theory of associative learning, the Pearce-Hall model of Pavlovian learning (Pearce & Hall, 1980), attention paid to cues that predict a reinforcer should decline as the reinforcer becomes better and better predicted during extended conditioning.”
From Context, attention, and the switch between habit and goal-direction in behavior (2021) · cites this paper as Pearce & Hall, 1980
The attention explanation is based on Pearce and Hall's (1980) theory of attention and its role in Pavlovian learning.
“The attention explanation given above is based on a well-known theory of attention and its role in Pavlovian learning (Pearce & Hall, 1980).”
From Context, attention, and the switch between habit and goal-direction in behavior (2021) · cites this paper as Pearce & Hall, 1980
Cites
Shiffrin, R. M., & Schneider, W. (1977) · Psychological Review · doi:10.1037/0033-295x.84.2.127 · Cited by 7,335 · see citing works
Rescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 7,268 · see citing works
Controlled and automatic human information processing: I. Detection, search, and attention.
Schneider, W., & Shiffrin, R. M. (1977) · Psychological Review · doi:10.1037/0033-295x.84.1.1 · Cited by 5,902 · see citing works
Lane, S. D. (2016) · Routledge eBooks · doi:10.4324/9781315506173-8 · Cited by 4,707 · see citing works
Classical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449 · see citing works
A theory of attention: Variations in the associability of stimuli with reinforcement
Mackintosh, N. J. (1975) · Psychological Review · doi:10.1037/h0076778 · Cited by 2,733 · see citing works
The Psychology of Animal Learning
Hill, W. F., & Mackintosh, N. J. (1976) · The American Journal of Psychology · doi:10.2307/1421765 · Cited by 2,397 · see citing works
Controlled and automatic human information processing: I
Schneider, W. E., & Shiffrin, R. M. (1977) · Cited by 2,228 · see citing works
Punishment and aversive behavior
Campbell, B. A., & Church, R. M. (1969) · Appleton-Century-Crofts eBooks · Cited by 1,989 · see citing works
Predictability, surprise, attention, and conditioning
Kamin, L. J. (1967) · NASA Technical Reports Server (NASA) · Cited by 1,483 · see citing works
Integrative activity of the brain
Konorski, J. (1967) · Cited by 1,372 · see citing works
The role of frustrative nonreward in noncontinuous reward situations.
Amsel, A. (1958) · Psychological Bulletin · doi:10.1037/h0043125 · Cited by 1,305 · see citing works
Cognitive Processes in Animal Behavior
(2018) · Routledge eBooks · doi:10.4324/9780203710029 · Cited by 1,116 · see citing works
Frey, P. W., Boakes, R. A., & Halliday, M. S. (1973) · The American Journal of Psychology · doi:10.2307/1422092 · Cited by 1,099 · see citing works
Pavlovian conditioned inhibition
Rescorla, R. (1969) · Psychological Bulletin · doi:10.1037/h0027760 · Cited by 868 · see citing works
Aversive Conditioning and Learning
(1971) · Elsevier eBooks · doi:10.1016/c2013-0-10435-7 · Cited by 761 · see citing works
Latent inhibition and conditioned attention theory.
Lubow, R. E., Schnur, P., & Rifkin, B. (1976) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.2.2.163 · Cited by 733 · see citing works
Conditioned Reflexes and Neuron Organization.
(1949) · Annals of Internal Medicine · doi:10.7326/0003-4819-31-6-1133_1 · Cited by 688 · see citing works
Habituation: Perspectives from child development, animal behavior, and neurophysiology
Tighe, T. J., & Leaton, R. N. (1976) · Cited by 569 · see citing works
Stimulus selection: Learning to ignore stimuli that predict no change in reinforcement.
Mackintosh, N. J. (1973) · Cited by 336 · see citing works
Overshadowing and stimulus intensity
Mackintosh, N. J. (1976) · Animal Learning & Behavior · doi:10.3758/bf03214033 · Cited by 317 · see citing works
Pavlovian appetitive contingencies and approach versus withdrawal to conditioned stimuli in pigeons.
Wasserman, E. A., Franklin, S. R., & Hearst, E. S. (1974) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0036171 · Cited by 240 · see citing works
Rescorla, R. A. (1971) · Learning and Motivation · doi:10.1016/0023-9690(71)90002-6 · Cited by 231 · see citing works
Lubow, R. E., Rifkin, B., & Alek, M. (1976) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.2.1.38 · Cited by 183 · see citing works
Surprise and the attenuation of blocking.
Dickinson, A., Hall, G., & Mackintosh, N. J. (1976) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.2.4.313 · Cited by 176 · see citing works
Self-citationRelaxation Theory and Experiments
Denny, M. R. (1971) · Elsevier eBooks · doi:10.1016/b978-0-12-137950-6.50009-2 · Cited by 176 · see citing works
Classical Conditioning in Animals
Dickinson, A., & Mackintosh, N. J. (1978) · Annual Review of Psychology · doi:10.1146/annurev.ps.29.020178.003103 · Cited by 173 · see citing works
Latent inhibition of a CS during CS–US pairings.
Hall, G., & Pearce, J. M. (1979) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.5.1.31 · Cited by 173 · see citing works
Self-citationFrey, P. W., & Sears, R. J. (1978) · Psychological Review · doi:10.1037/0033-295x.85.4.321 · Cited by 157 · see citing works
Stimulus similarity as a determinant of Pavlovian conditioning.
Rescorla, R. A., & Furrow, D. R. (1977) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037//0097-7403.3.3.203 · Cited by 147 · see citing works
Reduction in the effectiveness of reinforcement after prior excitatory conditioning
Rescorla, R. A. (1970) · Learning and Motivation · doi:10.1016/0023-9690(70)90101-3 · Cited by 144 · see citing works
Hearst, E. S., & Franklin, S. R. (1977) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.3.1.37 · Cited by 143 · see citing works
An Analysis of Overshadowing and Blocking
Mackintosh, N. J. (1971) · Quarterly Journal of Experimental Psychology · doi:10.1080/00335557143000121 · Cited by 136 · see citing works
Spatial contiguity facilitates Pavlovian second-order conditioning.
Rescorla, R. A., & Cunningham, C. L. (1979) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.5.2.152 · Cited by 123 · see citing works
Testa, T. J. (1975) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037//0097-7403.1.2.114 · Cited by 116 · see citing works
The Rescorla-Wagner model: Losses in associative strength in compound conditioned stimuli.
Kremer, E. F. (1978) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037//0097-7403.4.1.22 · Cited by 113 · see citing works
Blocking of conditioned suppression: Role of the first compound trial.
Mackintosh, N. J. (1975) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037//0097-7403.1.4.335 · Cited by 87 · see citing works
Mahoney, W. J., & Ayres, J. J. B. (1976) · Animal Learning & Behavior · doi:10.3758/bf03214421 · Cited by 82 · see citing works
Mackintosh, N. J., & Reese, B. (1979) · Quarterly Journal of Experimental Psychology · doi:10.1080/14640747908400743 · Cited by 76 · see citing works
Locus of the Effect of a Surprising Reinforcer in the Attenuation of Blocking
Mackintosh, N. J., Bygrave, D. J., & Picton, B. M. B. (1977) · Quarterly Journal of Experimental Psychology · doi:10.1080/14640747708400608 · Cited by 68 · see citing works
Lantz, A. E. (1973) · Animal Learning & Behavior · doi:10.3758/bf03199250 · Cited by 64 · see citing works
Reinforcer specificity in the enhancement of conditioning by posttrial surprise.
Dickinson, A., & Mackintosh, N. J. (1979) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037//0097-7403.5.2.162 · Cited by 61 · see citing works
Role of contextual discrimination in fear conditioning.
Dexter, W. R., & Merrill, H. K. (1969) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0028210 · Cited by 31 · see citing works
Blocking of inhibitory Pavlovian conditioning in the conditioned emotional response procedure.
Suiter, R. D., & LoLordo, V. M. (1971) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0031057 · Cited by 29 · see citing works
Effect of posttrial episodes on conditioning in compound conditioned stimuli.
Kremer, E. F. (1979) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037//0097-7403.5.2.130 · Cited by 17 · see citing works
Loss of associability by a compound stimulus comprising excitatory and inhibitory elements.
Pearce, J. M., & Hall, G. (1979) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037//0097-7403.5.1.19 · Cited by 17 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Whatever next? Predictive brains, situated agents, and the future of cognitive science
Clark, A. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12000477 · Cited by 5,924 · see citing works
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564 · see citing works
Frontal theta as a mechanism for cognitive control
Cavanagh, J. F., & Frank, M. J. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.04.012 · Cited by 2,726 · see citing works
Getting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574 · see citing works
Dopamine in motivational control: rewarding, aversive, and alerting
Bromberg-Martin, E. S., Matsumoto, M., & Hikosaka, O. (2010) · Neuron · doi:10.1016/j.neuron.2010.11.022 · Cited by 2,396 · see citing works
Maximizing exposure therapy: An inhibitory learning approach
Craske, M. G., Treanor, M., Conway, C. C., Zbozinek, T., & Vervliet, B. (2014) · Behaviour Research and Therapy · doi:10.1016/j.brat.2014.04.006 · Cited by 2,339 · see citing works
“Errorcorrection models (e.g., Rescorla & Wagner, 1972) posit an important role for the salience of the CS such that any change in associative strength (e.g., extinction learning) will be directed to the cue that is most salient (Mackintosh, 1975; Pearce & Hall, 1980).”
Discrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085 · see citing works
Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex
Cardinal, R. N., Parkinson, J. A., Hall, J., & Everitt, B. J. (2002) · Neuroscience & Biobehavioral Reviews · doi:10.1016/s0149-7634(02)00007-6 · Cited by 2,129 · see citing works
Uncertainty and anticipation in anxiety: an integrated neurobiological and psychological perspective
Grupe, D. W., & Nitschke, J. B. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3524 · Cited by 2,007 · see citing works
Learning the value of information in an uncertain world
Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S. (2007) · Nature Neuroscience · doi:10.1038/nn1954 · Cited by 2,053 · see citing works
Uncertainty, Neuromodulation, and Attention
Yu, A. J., & Dayan, P. (2005) · Neuron · doi:10.1016/j.neuron.2005.04.026 · Cited by 1,774 · see citing works
Context, time, and memory retrieval in the interference paradigms of Pavlovian learning
Bouton, M. E. (1993) · Psychological Bulletin · doi:10.1037/0033-2909.114.1.80 · Cited by 1,896 · see citing works
Context and Behavioral Processes in Extinction: Table 1.
Bouton, M. E. (2004) · Learning & Memory · doi:10.1101/lm.78804 · Cited by 1,808 · see citing works
Context, ambiguity, and unlearning: sources of relapse after behavioral extinction
Bouton, M. E. (2002) · Biological Psychiatry · doi:10.1016/s0006-3223(02)01546-9 · Cited by 1,662 · see citing works
Behavioral Theories and the Neurophysiology of Reward
Schultz, W. (2006) · Annual Review of Psychology · doi:10.1146/annurev.psych.56.091103.070229 · Cited by 1,637 · see citing works
Goal-directed instrumental action: contingency and incentive learning and their cortical substrates
Balleine, B. W., & Dickinson, A. (1998) · Neuropharmacology · doi:10.1016/s0028-3908(98)00033-1 · Cited by 1,541 · see citing works
Perceiving is believing: a Bayesian approach to explaining the positive symptoms of schizophrenia
Fletcher, P. C., & Frith, C. D. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2536 · Cited by 1,462 · see citing works
Temporal difference models and reward-related learning in the human brain
O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003) · Neuron · doi:10.1016/s0896-6273(03)00169-7 · Cited by 1,522 · see citing works
Neuronal Coding of Prediction Errors
Schultz, W., & Dickinson, A. (2000) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.23.1.473 · Cited by 1,427 · see citing works
Multiple dopamine functions at different time courses
Schultz, W. (2007) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.28.061604.135722 · Cited by 1,415 · see citing works
The Journal of Experimental Biology
(2014) · Journal of Experimental Biology · doi:10.1242/1477-9145 · Cited by 1,381 · see citing works
The neuropsychology of schizophrenia
Gray, J. A., Feldon, J., Rawlins, J. N. P., Hemsley, D. R., & Smith, A. D. (1991) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00065055 · Cited by 1,350 · see citing works
Multiple reward signals in the brain
Schultz, W. (2000) · Nature Reviews Neuroscience · doi:10.1038/35044563 · Cited by 1,303 · see citing works
The neural bases of emotion regulation
Etkin, A., Büchel, C., & Gross, J. J. (2015) · Nature Reviews Neuroscience · doi:10.1038/nrn4044 · Cited by 1,244 · see citing works
Neuronal Reward and Decision Signals: From Theories to Data
Schultz, W. (2015) · Physiological Reviews · doi:10.1152/physrev.00023.2014 · Cited by 1,126 · see citing works
Gläscher, J., Daw, N., Dayan, P., & O'Doherty, J. P. (2010) · Neuron · doi:10.1016/j.neuron.2010.04.016 · Cited by 1,166 · see citing works
Myers, K. M., & Davis, M. (2007) · Molecular Psychiatry · doi:10.1038/sj.mp.4001939 · Cited by 1,277 · see citing works
Gallistel, C. R., & Gibbon, J. (2000) · Psychological Review · doi:10.1037/0033-295x.107.2.289 · Cited by 1,122 · see citing works
Dopamine neurons report an error in the temporal prediction of reward during learning
Hollerman, J. R., & Schultz, W. (1998) · Nature Neuroscience · doi:10.1038/1124 · Cited by 1,103 · see citing works
Dopamine responses comply with basic assumptions of formal learning theory
Waelti, P., Dickinson, A., & Schultz, W. (2001) · Nature · doi:10.1038/35083500 · Cited by 1,018 · see citing works
Medial prefrontal cortex as an action-outcome predictor
Alexander, W. H., & Brown, J. W. (2011) · Nature Neuroscience · doi:10.1038/nn.2921 · Cited by 1,000 · see citing works
Dopamine reward prediction-error signalling: A two-component response
Schultz, W. (2016) · Nature Reviews Neuroscience · doi:10.1038/nrn.2015.26 · Cited by 1,036 · see citing works
A model for stimulus generalization in Pavlovian conditioning.
Pearce, J. M. (1987) · Psychological Review · doi:10.1037/0033-295x.94.1.61 · Cited by 1,046 · see citing works
Self-citationExpectation (and attention) in visual cognition
Summerfield, C., & Egner, T. (2009) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2009.06.003 · Cited by 950 · see citing works
A modern learning theory perspective on the etiology of panic disorder.
Bouton, M. E., Mineka, S., & Barlow, D. H. (2001) · Psychological Review · doi:10.1037/0033-295x.108.1.4 · Cited by 1,017 · see citing works
Imaging how attention modulates pain in humans using functional MRI
Bantick, S. J., Wise, R. G., Ploghaus, A., Clare, S., Smith, S. M., & Tracey, I. (2002) · Brain · doi:10.1093/brain/awf022 · Cited by 888 · see citing works
Cortico-striatal circuits and interval timing: coincidence detection of oscillatory processes
Matell, M. S., & Meck, W. H. (2004) · Cognitive Brain Research · doi:10.1016/j.cogbrainres.2004.06.012 · Cited by 877 · see citing works
Lonsdorf, T. B., Menz, M. M., Andreatta, M., Fullana, M. A., Golkar, A., Haaker, J., Heitland, I., Hermann, A., Kuhn, M., Kruse, O., et al. (2017) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2017.02.026 · Cited by 837 · see citing works
Dopamine neurons and their role in reward mechanisms
Schultz, W. (1997) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(97)80007-4 · Cited by 769 · see citing works
The propositional nature of human associative learning
Mitchell, C. J., Houwer, J. D., & Lovibond, P. F. (2009) · Behavioral and Brain Sciences · doi:10.1017/s0140525x09000855 · Cited by 749 · see citing works
Similarity and discrimination: A selective review and a connectionist model.
Pearce, J. M. S. (1994) · Psychological Review · doi:10.1037/0033-295x.101.4.587 · Cited by 750 · see citing works
Self-citationHow unrealistic optimism is maintained in the face of reality
Sharot, T., Korn, C. W., & Dolan, R. J. (2011) · Nature Neuroscience · doi:10.1038/nn.2949 · Cited by 729 · see citing works
Behavioral studies of Pavlovian conditioning
Rescorla, R. A. (1988) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.11.030188.001553 · Cited by 715 · see citing works
Neural computations underlying arbitration between model-based and model-free learning
Lee, S. W., Shimojo, S., & O’Doherty, J. P. (2014) · Neuron · doi:10.1016/j.neuron.2013.11.028 · Cited by 642 · see citing works
Contextual and temporal modulation of extinction: behavioral and biological mechanisms
Bouton, M. E., Westbrook, R. F., Corcoran, K. A., & Maren, S. (2006) · Biological Psychiatry · doi:10.1016/j.biopsych.2005.12.015 · Cited by 671 · see citing works
Dopamine signals for reward value and risk: basic and recent data
Schultz, W. (2010) · Behavioral and Brain Functions · doi:10.1186/1744-9081-6-24 · Cited by 653 · see citing works
Observing the unexpected enhances infants’ learning and exploration
Stahl, A. E., & Feigenson, L. (2015) · Science · doi:10.1126/science.aaa3799 · Cited by 617 · see citing works
Alloy, L. B., & Kayne, N. T. (1984) · Psychological Review · doi:10.1037/0033-295x.91.1.112 · Cited by 609 · see citing works
Amygdala circuitry in attentional and representational processes.
Holland, P., & Gallagher, M. (1999) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(98)01271-6 · Cited by 613 · see citing works
Emotion, Cognition, and Mental State Representation in Amygdala and Prefrontal Cortex
Salzman, C. D., & Fusi, S. (2010) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.051508.135256 · Cited by 599 · see citing works
Intentional binding and the sense of agency: A review
Moore, J. W., & Obhi, S. S. (2012) · Consciousness and Cognition · doi:10.1016/j.concog.2011.12.002 · Cited by 567 · see citing works
How prediction errors shape perception, attention, and motivation
den Ouden, H. E. M., Kok, P., & de Lange, F. P. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00548 · Cited by 512 · see citing works
What the orbitofrontal cortex does not do
Stalnaker, T. A., Cooch, N. K., & Schoenbaum, G. (2015) · Nature Neuroscience · doi:10.1038/nn.3982 · Cited by 531 · see citing works
Pupil dilation signals surprise: evidence for noradrenaline’s role in decision making
Preuschoff, K. (2011) · Frontiers in Neuroscience · doi:10.3389/fnins.2011.00115 · Cited by 538 · see citing works
The ecology of human fear: survival optimization and the nervous system
Mobbs, D., Hagan, C. C., Dalgleish, T., Silston, B., & Prévost, C. (2015) · Frontiers in Neuroscience · doi:10.3389/fnins.2015.00055 · Cited by 498 · see citing works
The Comparator Hypothesis: A Response Rule for The Expression of Associations
Miller, R. R., & Matzel, L. D. (1988) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/s0079-7421(08)60038-9 · Cited by 518 · see citing works
Schultz, W. (2004) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2004.03.017 · Cited by 517 · see citing works
Learning and selective attention
Dayan, P., Kakade, S., & Montague, P. R. (2000) · Nature Neuroscience · doi:10.1038/81504 · Cited by 495 · see citing works
Hippocampal mediation of stimulus representation: A computational theory
Gluck, M. A., & Myers, C. E. (1993) · Hippocampus · doi:10.1002/hipo.450030410 · Cited by 496 · see citing works
Time-Derivative Models of Pavlovian Reinforcement
Sutton, R. S., & Barto, A. G. (1990) · Cited by 496 · see citing works
Kalisch, R., Korenfeld, E., Stephan, K. E., Weiskopf, N., Seymour, B., & Dolan, R. J. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.2021-06.2006 · Cited by 493 · see citing works
Theories of Associative Learning in Animals
Pearce, J. M., & Bouton, M. E. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.111 · Cited by 493 · see citing works
Self-citationNeuronal circuits of fear extinction
Herry, C., Ferraguti, F., Singewald, N., Letzkus, J. J., Ehrlich, I., & Lüthi, A. (2010) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2010.07101.x · Cited by 484 · see citing works
Contemporary Learning Theories: Pavlovian Conditioning and the Status of Traditional Learning Theory
Kehoe, E. J., Klein, S. B., & Mowrer, R. R. (1991) · The American Journal of Psychology · doi:10.2307/1423162 · Cited by 483 · see citing works
Disrupted prediction-error signal in psychosis: Evidence for an associative account of delusions
Corlett, P. R., Murray, G. K., Honey, G. D., Aitken, M. R. F., Shanks, D. R., Robbins, T. W., Bullmore, E. T., Dickinson, A., & Fletcher, P. C. (2007) · Brain · doi:10.1093/brain/awm173 · Cited by 460 · see citing works
Encoding of fear learning and memory in distributed neuronal circuits
Herry, C., & Johansen, J. P. (2014) · Nature Neuroscience · doi:10.1038/nn.3869 · Cited by 474 · see citing works
Animal models of anxiety disorders and stress
Campos, A. C., Fogaça, M. V., de Aguiar, D. C., & Guimarães, F. S. (2013) · Brazilian Journal of Psychiatry · doi:10.1590/1516-4446-2013-1139 · Cited by 473 · see citing works
Bayesian theories of conditioning in a changing world
Courville, A. C., Daw, N. D., & Touretzky, D. S. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.05.004 · Cited by 457 · see citing works
Kim, H., Shimojo, S., & O’Doherty, J. P. (2006) · PLoS Biology · doi:10.1371/journal.pbio.0040233 · Cited by 447 · see citing works
Prediction error in reinforcement learning: A meta-analysis of neuroimaging studies
Garrison, J. R., Erdeniz, B., & Done, J. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.03.023 · Cited by 430 · see citing works
Two different lateral amygdala cell populations contribute to the initiation and storage of memory
Repa, J. C., Muller, J., Apergis, J., Desrochers, T. M., Zhou, Y., & LeDoux, J. E. (2001) · Nature Neuroscience · doi:10.1038/89512 · Cited by 440 · see citing works
An elemental model of associative learning: I. Latent inhibition and perceptual learning
McLaren, I., & Mackintosh, N. (2000) · Animal Learning & Behavior · doi:10.3758/bf03200258 · Cited by 438 · see citing works
Hauser, T. U., Iannaccone, R., Stämpfli, P., Drechsler, R., Brandeis, D., Walitza, S., & Brem, S. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.08.028 · Cited by 423 · see citing works
Assessment of the Rescorla-Wagner model.
Miller, R. R., Barnet, R. C., & Grahame, N. J. (1995) · Psychological Bulletin · doi:10.1037/0033-2909.117.3.363 · Cited by 429 · see citing works
Neural and cellular mechanisms of fear and extinction memory formation
Orsini, C. A., & Maren, S. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2011.12.014 · Cited by 429 · see citing works
Within Compound Associations Mediate the Retrospective Revaluation of Causality Judgements
Dickinson, A., & Burke, J. (1996) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/713932614 · Cited by 417 · see citing works
The importance of proving the null
Gallistel, C. R. (2009) · Psychological Review · doi:10.1037/a0015251 · Cited by 392 · see citing works
Hayden, B. Y., Heilbronner, S. R., Pearson, J. M., & Platt, M. L. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.4652-10.2011 · Cited by 379 · see citing works
Toward a neurobiology of delusions
Corlett, P. R., Taylor, J. R., Wang, X.-J., Fletcher, P. C., & Krystal, J. H. (2010) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2010.06.007 · Cited by 394 · see citing works
Judgement of Act-Outcome Contingency: The Role of Selective Attribution
Dickinson, A., Shanks, D. R., & Evenden, J. L. (1984) · The Quarterly Journal of Experimental Psychology Section A · doi:10.1080/14640748408401502 · Cited by 403 · see citing works
Behavioral and neurobiological mechanisms of pavlovian and instrumental extinction learning
Bouton, M. E., Maren, S., & McNally, G. P. (2020) · Physiological Reviews · doi:10.1152/physrev.00016.2020 · Cited by 399 · see citing works
Barto, A., Mirolli, M., & Baldassarre, G. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00907 · Cited by 397 · see citing works
“This Bayesian account of increases in the rate of animal learning observed in certain experiments (Rescorla, 1971) accomplishes what the Pearce-Hall model (Pearce and Hall, 1980) does via its use of an explicit measure of surprise as the magnitude of a prediction error.”
Weiner, I. (2003) · Psychopharmacology · doi:10.1007/s00213-002-1313-x · Cited by 387 · see citing works
From drugs to deprivation: A Bayesian framework for understanding models of psychosis
Corlett, P. R., Frith, C. D., & Fletcher, P. C. (2009) · Psychopharmacology · doi:10.1007/s00213-009-1561-0 · Cited by 367 · see citing works
“One possibility is that lower levels in the hierarchy are more concerned with the signal-to-noise ratio, while higher levels are more concerned with the overall confidence in the signals.”
BackgroundAmygdala–frontal interactions and reward expectancy
Holland, P. C., & Gallagher, M. (2004) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2004.03.007 · Cited by 390 · see citing works
Selection history: How reward modulates selectivity of visual attention.
Failing, M., & Theeuwes, J. (2018) · Psychonomic Bulletin & Review · doi:10.3758/s13423-017-1380-y · Cited by 345 · see citing works
“This led to theories on how rewards motivate behavior as well as internal states (e.g., Berridge & Robinson, 1998; Mackintosh, 1975; Pearce & Hall, 1980).”
BackgroundHippocampus and context in classical conditioning
Holland, P. C., & Bouton, M. E. (1999) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(99)80027-0 · Cited by 377 · see citing works
Statistical learning of visual transitions in monkey inferotemporal cortex
Meyer, T., & Olson, C. R. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1112895108 · Cited by 325 · see citing works
The comparative psychology of intelligence
Macphail, E. M. (1987) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00054984 · Cited by 371 · see citing works
Neural mechanisms of observational learning
Burke, C. J., Tobler, P. N., Baddeley, M. C., & Schultz, W. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1003111107 · Cited by 356 · see citing works
Grossberg, S. (1982) · Psychological Review · doi:10.1037/0033-295x.89.5.529 · Cited by 373 · see citing works
Knowing how much you don't know: a neural organization of uncertainty estimates
Bach, D. R., & Dolan, R. J. (2012) · Nature Reviews Neuroscience · doi:10.1038/nrn3289 · Cited by 339 · see citing works
Le Pelley, M. E. (2004) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/02724990344000141 · Cited by 360 · see citing works
Latent inhibition in humans: data, theory, and implications for schizophrenia.
Lubow, R., & Gewirtz, J. C. (1995) · Psychological bulletin · doi:10.1037/0033-2909.117.1.87 · Cited by 373 · see citing works
Houwer, J. D. (2009) · Animal Learning & Behavior · doi:10.3758/lb.37.1.1 · Cited by 362 · see citing works
Over the river, through the woods: cognitive maps in the hippocampus and orbitofrontal cortex
Wikenheiser, A. M., & Schoenbaum, G. M. (2016) · Nature reviews. Neuroscience · doi:10.1038/nrn.2016.56 · Cited by 353 · see citing works
Adaptation by binding: a learning account of cognitive control
Verguts, T., & Notebaert, W. (2009) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2009.02.007 · Cited by 359 · see citing works
Differential roles of human striatum and amygdala in associative learning
Li, J., Schiller, D., Schoenbaum, G. M., Phelps, E. A., & Daw, N. D. (2011) · Nature Neuroscience · doi:10.1038/nn.2904 · Cited by 364 · see citing works
Forward and Backward Blocking in Human Contingency Judgement
Shanks, D. R. (1985) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/14640748508402082 · Cited by 361 · see citing works
Gottfried, J. A., & Dolan, R. J. (2004) · Nature Neuroscience · doi:10.1038/nn1314 · Cited by 353 · see citing works
- Authors
- Pearce, J. M., & Hall, G.
- Affiliations
- University of Wales (GB)
- ORCID
- Hall, Geoffrey
- Venue
- Psychological Review
- Published
- 1980
- Volume
- 87
- Issue
- 6
- Pages
- 532-552
- ISSN
- 0033-295X (ISSN-L)
- 1939-1471
- OpenAlex
- W2090144013
- Cited by
- 3,023
- References
- 46
- Citations by year
- 2026: 64 · 2025: 81 · 2024: 88 · 2023: 84 · 2022: 97 · 2021: 97 · 2020: 142 · 2019: 110 · 2018: 104 · 2017: 141 · 2016: 108 · 2015: 95 · 2014: 103 · 2013: 109 · 2012: 102
- FWCI
- 12.96
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Review (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Keywords
- Pavlovian learning, classical conditioning, excitatory conditioning, inhibitory conditioning, unconditioned stimulus, reinforcer effectiveness, associative learning
- MeSH terms
- Animals, Association Learning, Conditioning, Classical, Humans, Models, Psychological
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review