Learning about Multiple Attributes of Reward in Pavlovian Conditioning
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
The nature of the reward representation in Pavlovian conditioning has been of perennial interest to students of associative learning theory. We consider the view that it consists of a range of different attributes, each of which may be governed by different learning rules. We investigated this issue through a series of experiments using a time‐sensitive Pavlovian‐to‐instrumental transfer procedure, aiming to dissociate learning about temporal and specific sensory features of a reward. Our results successfully demonstrated that learning about these different features appears to be dissociable, with learning about the specific sensory features of a Pavlovian unconditioned stimulus (US) occurring very rapidly across a wide range of experimental procedures, while learning about the temporal features of the US occurred slightly less quickly and was more sensitive to parametric disruption. These results are discussed with regard to the potential independence or interdependence of the relevant learning processes, and to some recent neurophysiological recording and brain lesion work, which provide additional means to investigate these dissociations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Pearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023
A theory of attention: Variations in the associability of stimuli with reinforcement
Mackintosh, N. J. (1975) · Psychological Review · doi:10.1037/h0076778 · Cited by 2,733 · cited 1×
“This conclusion follows from our findings that (1) although sensory and temporal learning both develop rapidly, sensory learning seems to occur earlier, (2) training with a long CS–US interval, or with a trace interval between CS and US, results in sensory learning in the apparent absence of US timing, and (3) learnin…”
ResultThe debate over dopamine’s role in reward: the case for incentive salience
Berridge, K. C. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0578-x · Cited by 2,347
Wyvell, C. L., & Berridge, K. C. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-21-08122.2000 · Cited by 764
Nader, K. (2003) · Trends in Neurosciences · doi:10.1016/s0166-2236(02)00042-5 · Cited by 763
Corbit, L. H., & Balleine, B. W. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.4507-04.2005 · Cited by 589
Orbitofrontal cortex, associative learning and expectancies
Schoenbaum, G., & Roesch, M. (2005) · Neuron · doi:10.1016/j.neuron.2005.07.018 · Cited by 404
Relations between Pavlovian-instrumental transfer and reinforcer devaluation
Holland, P. C. (2004) · Journal of Experimental Psychology: Animal Behavior Processes · doi:10.1037/0097-7403.30.2.104 · Cited by 388
Encoding of Time-Discounted Rewards in Orbitofrontal Cortex Is Independent of Value Representation
Roesch, M. R., Taylor, A. R., & Schoenbaum, G. (2006) · Neuron · doi:10.1016/j.neuron.2006.06.027 · Cited by 297
Event representation in Pavlovian conditioning: Image and action
Holland, P. C. (1990) · Cognition · doi:10.1016/0010-0277(90)90020-k · Cited by 229
Extended habit training reduces dopamine mediation of appetitive response expression
Choi, W. Y., Balsam, P. D., & Horvitz, J. C. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.1498-05.2005 · Cited by 122
Cited by
Pavlovian to instrumental transfer: A neurobehavioural perspective
Holmes, N. M., Marchand, A. R., & Coutureau, E. (2010) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2010.03.007 · Cited by 334
Morrison, S. E., & Salzman, C. D. (2010) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2010.02.007 · Cited by 331
Appetitive Pavlovian-instrumental Transfer: A review
Cartoni, E., Balleine, B., & Baldassarre, G. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.09.020 · Cited by 317
The basolateral amygdala in reward learning and addiction
Wassum, K. M., & Izquierdo, A. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.08.017 · Cited by 306
Basolateral amygdala to orbitofrontal cortex projections enable cue-triggered reward expectations
Lichtenberg, N. T., Pennington, Z. T., Holley, S. M., Greenfield, V. Y., Cepeda, C., Levine, M. S., & Wassum, K. M. (2017) · The Journal of Neuroscience · doi:10.1523/jneurosci.0486-17.2017 · Cited by 171
“…outcome relationships permits recollection of the detailed reward memories that facilitate the outcome expectations that influence conditional responses, reward seeking, and decision making (Balleine and Dickinson, 1998; Delamater and Oakeshott, 2007; Delamater, 2012; Fanselow and Wassum, 2015).”
Metadata
- Authors
- DELAMATER, A. R., & OAKESHOTT, S.
- Venue
- Annals of the New York Academy of Sciences
- Publisher
- Wiley
- Published
- 2007-05
- Volume
- 1104
- Issue
- 1
- Pages
- 1-20
- ISSN
- 0077-8923 (ISSN-L)
- 1749-6632
- OpenAlex
- W2029733730
- Cited by
- 95
- References
- 11
- FWCI
- 1.86
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.