The Origins and Organization of Vertebrate Pavlovian Conditioning
Open accessThe DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Abstract
Pavlovian conditioning is the process by which we learn relationships between stimuli and thus constitutes a basic building block for how the brain constructs representations of the world. We first review the major concepts of Pavlovian conditioning and point out many of the pervasive misunderstandings about just what conditioning is. This brings us to a modern redefinition of conditioning as the process whereby experience with a conditional relationship between stimuli bestows these stimuli with the ability to promote adaptive behavior patterns that did not occur before the experience. Working from this framework, we provide an in-depth analysis of two examples, fear conditioning and food-based appetitive conditioning, which include a description of the only partially overlapping neural circuitry of each. We also describe how these circuits promote the basic characteristics that define Pavlovian conditioning, such as error-correction-driven regulation of learning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The neural basis of drug craving: An incentive-sensitization theory of addiction
Robinson, T. (1993) · Brain Research Reviews · doi:10.1016/0165-0173(93)90013-p · Cited by 7,346
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148
Pearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023 · cited 4×
“Thus, there is considerable power and generality in models of this process such as those of Rescorla and Wagner (1972) and Pearce and Hall (1980).”
BackgroundMethodInfluentialA theory of attention: Variations in the associability of stimuli with reinforcement
Mackintosh, N. J. (1975) · Psychological Review · doi:10.1037/h0076778 · Cited by 2,733 · cited 1×
“The idea that this learning rate parameter changes over the course of learning is central to attentional models proposed by Mackintosh (1975) and Pearce and Hall (1980).”
BackgroundGetting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574
The debate over dopamine’s role in reward: the case for incentive salience
Berridge, K. C. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0578-x · Cited by 2,347
Conditioned emotional reactions.
Watson, J. B., & Rayner, R. (1920) · Journal of Experimental Psychology · doi:10.1037/h0069608 · Cited by 2,005 · cited 2×
“…fear conditioning began with Watson and Rayner’s famous “Little Albert” demonstration in which a young child 14 Cite this article as Cold Spring Harb Perspect Biol 2016;8:a021717 learned to fear an initially attractive white rat that was paired with a disturbing loud noise (Watson and Rayner 1920).”
BackgroundContext, time, and memory retrieval in the interference paradigms of Pavlovian learning
Bouton, M. E. (1993) · Psychological Bulletin · doi:10.1037/0033-2909.114.1.80 · Cited by 1,896
Berridge, K. C., & Robinson, T. E. (2003) · Trends in Neurosciences · doi:10.1016/s0166-2236(03)00233-9 · Cited by 1,869
Pavlovian conditioning: it's not what you think it is
Rescorla, R. A. (1988) · American Psychologist · doi:10.1037/0003-066x.43.3.151 · Cited by 1,542 · cited 1×
“Perhaps Rescorla (1988) said it best when he stated, “Pavlovian conditioning, it is not what you think.””
Two-process learning theory: Relationships between Pavlovian conditioning and instrumental learning.
Rescorla, R. A., & Solomon, R. L. (1967) · Psychological Review · doi:10.1037/h0024475 · Cited by 1,487 · cited 3×
“The idea that a Pavlovian CS provides a motivational influence over instrumental action is referred to as incentive motivation (Bolles and Zeigler 1967; Rescorla and Solomon 1967).”
BackgroundNeuron-type-specific signals for reward and punishment in the ventral tegmental area
Cohen, J. Y., Haesler, S., Vong, L., Lowell, B. B., & Uchida, N. (2012) · Nature · doi:10.1038/nature10754 · Cited by 1,318
Lateral habenula as a source of negative reward signals in dopamine neurons
Matsumoto, M., & Hikosaka, O. (2007) · Nature · doi:10.1038/nature05860 · Cited by 1,292 · cited 2×
“Interestingly, LHb neurons show a firing pattern opposite to a reward-prediction error signal (Matsumoto and Hikosaka 2007), suggesting a potential inhibitory influence over dopaminemediated reward-prediction error signals.”
BackgroundSurmeier, D. J., Ding, J., Day, M., Wang, Z., & Shen, W. (2007) · Trends in Neurosciences · doi:10.1016/j.tins.2007.03.008 · Cited by 1,203 · cited 1×
“These direct pathway SPNs selectively express the D1, but not D2, dopamine receptors (Surmeier et al. 2007) that have a high affinity for phasic (rather than tonic) dopamine release (Corbit and Janak 2010).”
BackgroundEncoding Predictive Reward Value in Human Amygdala and Orbitofrontal Cortex
Gottfried, J. A., O'Doherty, J., & Dolan, R. J. (2003) · Science · doi:10.1126/science.1087919 · Cited by 1,165
The neuroanatomical and neurochemical basis of conditioned fear
Fendt, M., & Fanselow, M. S. (1999) · Neuroscience & Biobehavioral Reviews · doi:10.1016/s0149-7634(99)00016-0 · Cited by 1,092
Self-citationProbability of shock in the presence and absence of cs in fear conditioning.
Rescorla, R. A. (1968) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0025984 · Cited by 1,067 · cited 1×
“Rescorla (1968) put this question to an empirical test.”
BackgroundDopamine responses comply with basic assumptions of formal learning theory
Waelti, P., Dickinson, A., & Schultz, W. (2001) · Nature · doi:10.1038/35083500 · Cited by 1,018 · cited 3×
“Although the negative feedback circuit has not been fully identified in appetitive conditioning, groups of dopaminergic cells that behave as if they carry the error-correction signal (i.e., l 2 VS) have been described (Waelti et al. 2001) (see section on dopamine and reward prediction error).”
BackgroundInfluentialNeural organization of the defensive behavior system responsible for fear
Fanselow, M. S. (1994) · Psychonomic Bulletin & Review · doi:10.3758/bf03210947 · Cited by 1,000
Self-citationThe habenula: from stress evasion to value-based decision-making
Hikosaka, O. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2866 · Cited by 955
Switching on and off fear by distinct neuronal circuits
Herry, C., Ciocchi, S., Senn, V., Demmou, L., Müller, C., & Lüthi, A. (2008) · Nature · doi:10.1038/nature07166 · Cited by 950 · cited 1×
“Finally, the BLA contains neurons whose increased activity during extinction coincides with the reduction of activity in neurons that were potentiated by fear acquisition (Herry et al. 2008).”
BackgroundNew Vistas on Amygdala Networks in Conditioned Fear
Paré, D., Quirk, G. J., & Ledoux, J. E. (2004) · Journal of Neurophysiology · doi:10.1152/jn.00153.2004 · Cited by 841 · cited 4×
“One consists of projections to the nearby striatal-like central nucleus (CeN) and another is to clusters of GABAergic cells lying in the capsule between the BLA and CeN (Paré et al. 2004).”
BackgroundInfluentialGenetic dissection of an amygdala microcircuit that gates conditioned fear
Haubensak, W., Kunwar, P. S., Cai, H., Ciocchi, S., Wall, N. R., Ponnusamy, R., Biag, J., Dong, H.-W., Deisseroth, K., Callaway, E. M., et al. (2010) · Nature · doi:10.1038/nature09553 · Cited by 840 · cited 1×
“GABAergic circuitry within the CeN regulates this output (Haubensak et al. 2010).”
BackgroundSelf-citationMiserendino, M. J. D., Sananes, C. B., Melia, K. R., & Davis, M. (1990) · Nature · doi:10.1038/345716a0 · Cited by 824 · cited 2×
“1993) promoting N-methylD-aspartate receptor (NMDA)-dependent synaptic plasticity (Miserendino et al. 1990; Fanselow and Kim 1994; Maren and Fanselow 1995).”
BackgroundUniform Inhibition of Dopamine Neurons in the Ventral Tegmental Area by Aversive Stimuli
Ungless, M. A., Magill, P. J., & Bolam, J. P. (2004) · Science · doi:10.1126/science.1093360 · Cited by 782
Wyvell, C. L., & Berridge, K. C. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-21-08122.2000 · Cited by 764
Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens
Day, J. J., Roitman, M. F., Wightman, R. M., & Carelli, R. M. (2007) · Nature Neuroscience · doi:10.1038/nn1923 · Cited by 710
Extinction of fear-potentiated startle: blockade by infusion of an NMDA antagonist into the amygdala
Falls, W., Miserendino, M., & Davis, M. (1992) · The Journal of Neuroscience · doi:10.1523/jneurosci.12-03-00854.1992 · Cited by 673 · cited 1×
“The model requires that extinction promotes LTP of these neurons, and extinction is, indeed, blocked by intra-amygdala application of NMDA-antagonists (Falls et al. 1992).”
BackgroundEvidence from rats that morphine tolerance is a learned response
Siegel, S. (1975) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0077058 · Cited by 657 · cited 3×
“For example, morphine elicits an analgesic UR, but a morphine-predictive CS can actually elicit hyperalgesia (Siegel 1975a), a finding not easily reconciled by an S–”
BackgroundParallel incentive processing: an integrated view of amygdala function
Balleine, B. W., & Killcross, S. (2006) · Trends in Neurosciences · doi:10.1016/j.tins.2006.03.002 · Cited by 622 · cited 1×
“However, the CeN and BLA each possess independent input and output that allow them to also act in parallel (Balleine and Killcross 2006).”
BackgroundCorbit, L. H., & Balleine, B. W. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.4507-04.2005 · Cited by 589
Ventral pallidum roles in reward and motivation
Smith, K. S., Tindell, A. J., Aldridge, J. W., & Berridge, K. C. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.09.038 · Cited by 548
Miller, N. E. (1948) · Journal of Experimental Psychology · doi:10.1037/h0058455 · Cited by 537 · cited 1×
“During much of the last century, fear conditioning was used as a way to examine learned motivation in rats (e.g., Miller 1948).”
BackgroundChristoph, G., Leonzio, R., & Wilcox, K. (1986) · The Journal of Neuroscience · doi:10.1523/jneurosci.06-03-00613.1986 · Cited by 418
Ji, H., & Shepard, P. D. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.0958-07.2007 · Cited by 388 · cited 1×
“The LHb projects to both the VTA and SNc (Herkenham and Nauta 1979), and stimulation of this structure inhibits the activity of dopamine neurons in these regions (Christoph et al. 1986; Ji and Shepard 2007; Matsumoto and Hikosaka 2007).”
BackgroundRelations between Pavlovian-instrumental transfer and reinforcer devaluation
Holland, P. C. (2004) · Journal of Experimental Psychology: Animal Behavior Processes · doi:10.1037/0097-7403.30.2.104 · Cited by 388
Orbitofrontal Cortex Mediates Outcome Encoding in Pavlovian But Not Instrumental Conditioning
Ostlund, S. B., & Balleine, B. W. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.5443-06.2007 · Cited by 379
Model-based and model-free Pavlovian reward learning: Revaluation, revision, and revelation
Dayan, P., & Berridge, K. C. (2014) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-014-0277-8 · Cited by 357
Hall, J., Parkinson, J. A., Connor, T. M., Dickinson, A., & Everitt, B. J. (2001) · European Journal of Neuroscience · doi:10.1046/j.0953-816x.2001.01577.x · Cited by 355
Fanselow, M. S. (1986) · Learning and Motivation · doi:10.1016/0023-9690(86)90018-4 · Cited by 326 · cited 2×
“Additionally, pharmacological antagonism of endogenous opioids prevents error correction (Fanselow 1986a).”
BackgroundSelf-citationOrsini, C. A., Kim, J. H., Knapska, E., & Maren, S. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.4095-11.2011 · Cited by 315 · cited 1×
“Such conjunctive information is communicated to the BLA as connections between the BLA, prefrontal cortex (extinction processing), and hippocampus (context processing) are necessary for renewal (Orsini et al. 2011).”
BackgroundNeural substrates for expectation-modulated fear learning in the amygdala and periaqueductal gray
Johansen, J. P., Tarpley, J. W., LeDoux, J. E., & Blair, H. T. (2010) · Nature Neuroscience · doi:10.1038/nn.2594 · Cited by 312 · cited 2×
“In strong support of this notion, there are neurons in both the vPAG and BLA that respond as if they encode the critical error signal (i.e., DV ) (Johansen et al. 2010).”
BackgroundCoding of Predicted Reward Omission by Dopamine Neurons in a Conditioned Inhibition Paradigm
Tobler, P. N., Dickinson, A., & Schultz, W. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-32-10402.2003 · Cited by 300 · cited 1×
“Both omission of an expected reward or presentation of an aversive event will induce a phasic pause in tonic dopamine cell activity (Tobler et al. 2003; Ungless et al. 2004).”
BackgroundMurray, E. A., O'Doherty, J. P., & Schoenbaum, G. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.1556-07.2007 · Cited by 238
FANSELOW, M. S. (1986) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.1986.tb14617.x · Cited by 238
Self-citationCorbit, L. H., Janak, P. H., & Balleine, B. W. (2007) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2007.05934.x · Cited by 231
From contextual fear to a dynamic view of memory systems
Fanselow, M. S. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2009.10.008 · Cited by 227 · cited 3×
“These unique aspects of context conditioning are reviewed elsewhere (see Fanselow 2010).”
BackgroundInfluentialPeciña, S., & Berridge, K. C. (2013) · European Journal of Neuroscience · doi:10.1111/ejn.12174 · Cited by 216 · cited 1×
“Moreover, enhancing the activity of dopamine release specifically in the NAc will enhance both PIT (Wyvell and Berridge 2000) and sign tracking (Peciña and Berridge 2013).”
BackgroundOstlund, S. B., & Balleine, B. W. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.5472-07.2008 · Cited by 198
Waddell, J., Morris, R. W., & Bouton, M. E. (2006) · Behavioral Neuroscience · doi:10.1037/0735-7044.120.2.324 · Cited by 183 · cited 21×
“GABAergic circuitry within the CeN regulates this output (Haubensak et al. 2010).”
BackgroundInfluentialDistinct opioid circuits determine the palatability and the desirability of rewarding events
Wassum, K. M., Ostlund, S. B., Maidment, N. T., & Balleine, B. W. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0905874106 · Cited by 182
Self-citationSingh, T. (2010) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2010.00126 · Cited by 40 · cited 1×
“Both the NAc core and shell are required for Pavlovian CRs to be sensitive to outcome devaluation (Singh et al. 2010).”
Background
Cited by
The basolateral amygdala in reward learning and addiction
Wassum, K. M., & Izquierdo, A. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.08.017 · Cited by 306
Self-citationBasolateral amygdala to orbitofrontal cortex projections enable cue-triggered reward expectations
Lichtenberg, N. T., Pennington, Z. T., Holley, S. M., Greenfield, V. Y., Cepeda, C., Levine, M. S., & Wassum, K. M. (2017) · The Journal of Neuroscience · doi:10.1523/jneurosci.0486-17.2017 · Cited by 171
“…outcome relationships permits recollection of the detailed reward memories that facilitate the outcome expectations that influence conditional responses, reward seeking, and decision making (Balleine and Dickinson, 1998; Delamater and Oakeshott, 2007; Delamater, 2012; Fanselow and Wassum, 2015).”
Self-citationNeurobiology of opioid dependence in creating addiction vulnerability
Evans, C. J., & Cahill, C. M. (2016) · F1000Research · doi:10.12688/f1000research.8369.1 · Cited by 146
Fear conditioning and the basolateral amygdala
Sun, Y., Gooch, H., & Sah, P. (2020) · F1000Research · doi:10.12688/f1000research.21201.1 · Cited by 104
Rickenbacher, E., Perry, R. E., Sullivan, R. M., & Moita, M. A. (2017) · eLife · doi:10.7554/elife.24080 · Cited by 81
“…(PVN) project to the centro-lateral nucleus of the amyg- dala (CeL) (Knobloch et al., 2012), a brain region that regulates conditioned threat responses (Fanselow and Wassum, 2015; Haubensak et al., 2010; Ciocchi et al., 2010; Wilensky et al., 2006; Li et al., 2013; Ciocchi et al., 2010).”
Background
Metadata
- Authors
- Fanselow, M. S., & Wassum, K. M.
- Venue
- Cold Spring Harbor Perspectives in Biology
- Publisher
- Cold Spring Harbor Laboratory
- Published
- 2015-11-09
- Volume
- 8
- Issue
- 1
- Pages
- a021717
- ISSN
- 1943-0264 (ISSN-L)
- OpenAlex
- W2230210885
- Cited by
- 124
- References
- 52
- Type
- posted content
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.