Mini-review: Prediction errors, attention and associative learning
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
Most modern theories of associative learning emphasize a critical role for prediction error (PE, the difference between received and expected events). One class of theories, exemplified by the Rescorla-Wagner (1972) model, asserts that PE determines the effectiveness of the reinforcer or unconditioned stimulus (US): surprising reinforcers are more effective than expected ones. A second class, represented by the Pearce-Hall (1980) model, argues that PE determines the associability of conditioned stimuli (CSs), the rate at which they may enter into new learning: the surprising delivery or omission of a reinforcer enhances subsequent processing of the CSs that were present when PE was induced. In this mini-review we describe evidence, mostly from our laboratory, for PE-induced changes in the associability of both CSs and USs, and the brain systems involved in the coding, storage and retrieval of these altered associability values. This evidence favors a number of modifications to behavioral models of how PE influences event processing, and suggests the involvement of widespread brain systems in animals’ responses to PE.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Memory - A century of consolidation
McGaugh, J. L. (2000) · Science · doi:10.1126/science.287.5451.248 · Cited by 4,250
The attention system of the human brain: 20 years after
Petersen, S. E., & Posner, M. I. (2012) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-062111-150525 · Cited by 3,439 · cited 1×
“…representation of altered associability values in PPC is consistent with prior identification of PPC as a critical component of attention networks (Petersen & Posner, 2012; Reep & Corwin, 2009), which may supply visuospatial priority maps to direct the deployment of attention (Bisley & Goldberg,…”
ResultPearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023 · cited 2×
“One class of models asserts that PE determi- nes the effectiveness of USs (e.g., Rescorla & Wagner, 1972; Sutton & Barto, 1981) and another suggests that PE determines eligibility of CSs (e.g., Mackintosh, 1975; Pearce & Hall, 1980).”
BackgroundMethodA theory of attention: Variations in the associability of stimuli with reinforcement
Mackintosh, N. J. (1975) · Psychological Review · doi:10.1037/h0076778 · Cited by 2,733 · cited 5×
“Although intuition and much data tell us that animals should attend more to reliable predictors of important events (Anderson, Laurent, & Yantis, 2011; Mackintosh, 1975), within PH reliable predictors of important events are attended to less than unreliable predictors.”
BackgroundInfluentialToward a modern theory of adaptive networks: Expectation and prediction.
Sutton, R. S., & Barto, A. G. (1981) · Psychological Review · doi:10.1037/0033-295x.88.2.135 · Cited by 1,450 · cited 1×
“One class of models asserts that PE determi- nes the effectiveness of USs (e.g., Rescorla & Wagner, 1972; Sutton & Barto, 1981) and another suggests that PE determines eligibility of CSs (e.g., Mackintosh, 1975; Pearce & Hall, 1980).”
BackgroundNeuronal Coding of Prediction Errors
Schultz, W., & Dickinson, A. (2000) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.23.1.473 · Cited by 1,427 · cited 2×
“For example, Schultz and Dickinson (2000) noted: Prediction errors can be used in postsynaptic structures for the immediate selection of behavior or for synaptic changes underlying behavioral learning.”
BackgroundMethodValue-driven attentional capture
Anderson, B. A., Laurent, P. A., & Yantis, S. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1104047108 · Cited by 1,098
Attention, intention, and priority in the parietal lobe
Bisley, J. W., & Goldberg, M. E. (2010) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-060909-152823 · Cited by 1,043 · cited 1×
“…PPC is consistent with prior identification of PPC as a critical component of attention networks (Petersen & Posner, 2012; Reep & Corwin, 2009), which may supply visuospatial priority maps to direct the deployment of attention (Bisley & Goldberg, 2010; Gottlieb, Hayhoe, Hikosaka, & Rangel, 2014).”
MethodLe Pelley, M. E. (2004) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/02724990344000141 · Cited by 360
Chiba, A., Bucci, D., Holland, P., & Gallagher, M. (1995) · The Journal of Neuroscience · doi:10.1523/jneurosci.15-11-07315.1995 · Cited by 257
Self-citation
Cited by
A model for learning based on the joint estimation of stochasticity and volatility
Piray, P., & Daw, N. D. (2021) · Nature Communications · doi:10.1038/s41467-021-26731-9 · Cited by 153
Prediction error, ketamine and psychosis: An updated model
Corlett, P. R., Honey, G. D., & Fletcher, P. C. (2016) · Journal of Psychopharmacology · doi:10.1177/0269881116650087 · Cited by 142
“In rodents, lesions of medial prefrontal cortex and parietal cortex doubly dissociate reliability-based from uncertainty-based attention (Holland and Schiffino, 2016).”
BackgroundComputational processes of simultaneous learning of stochasticity and volatility in humans
Piray, P., & Daw, N. D. (2024) · Nature Communications · doi:10.1038/s41467-024-53459-z · Cited by 45
The Functions of Dopamine in Operant Conditioned Reflexes
Maiorov, V. I. (2019) · Neuroscience and Behavioral Physiology · doi:10.1007/s11055-019-00815-y · Cited by 10
Metadata
- Authors
- Holland, P. C., & Schiffino, F. L.
- Venue
- Neurobiology of Learning and Memory
- Publisher
- Elsevier BV
- Published
- 2016-05
- Volume
- 131
- Pages
- 207-215
- ISSN
- 1074-7427 (ISSN-L)
- OpenAlex
- W2290015139
- Cited by
- 77
- References
- 12
- FWCI
- 1.07
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Mini-review: Prediction errors, attention and associative learning. https://app.cochat.ai/papers/10.1016/j.nlm.2016.02.014
- The paper
- Holland, P. C., & Schiffino, F. L. (2016). Mini-review: Prediction errors, attention and associative learning. Neurobiology of Learning and Memory. https://doi.org/10.1016/j.nlm.2016.02.014
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.