CoChat

A Dual Role for Prediction Error in Associative Learning

Open access
den Ouden, Hanneke E.M., Friston, Karl J., Daw, Nathaniel D., McIntosh, Anthony R., Stephan, Klaas E. · 2009 · Cerebral Cortex

The DOI matches its Crossref record; 68 of the 69 references it cites were found in a registry or an index.

Abstract

Confronted with a rich sensory environment, the brain must learn statistical regularities across sensory domains to construct causal models of the world. Here, we used functional magnetic resonance imaging and dynamic causal modeling (DCM) to furnish neurophysiological evidence that statistical associations are learnt, even when task-irrelevant. Subjects performed an audio-visual target-detection task while being exposed to distractor stimuli. Unknown to them, auditory distractors predicted the presence or absence of subsequent visual distractors. We modeled incidental learning of these associations using a Rescorla-Wagner (RW) model. Activity in primary visual cortex and putamen reflected learning-dependent surprise: these areas responded progressively more to unpredicted, and progressively less to predicted visual stimuli. Critically, this prediction-error response was observed even when the absence of a visual stimulus was surprising. We investigated the underlying mechanism by embedding the RW model into a DCM to show that auditory to visual connectivity changed significantly over time as a function of prediction error. Thus, consistent with predictive coding models of perception, associative learning is mediated by prediction-error dependent changes in connectivity. These results posit a dual role for prediction-error in encoding surprise and driving associative plasticity.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1093/cercor/bhn161

Cites

68 of 68 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1. Experimental design. (A) stimuli presented during the experiment. The “distractor” stimuli, whose associations are being learned incidentally, comprised 2 auditory CS corresponding to high- and low-frequency tones and one visual US consisting of 3 concentric squares. The target stimuli, to which the subjects responded, comprised a white noise burst and a circle. (B) Temporal sequence of a single trial. The CS and US could be either presented or omitted. The average trial duration was 2 s. The TO cue was a small central dot (100 ms); the auditory CS was presented for 500 ms, starting 400 ms after TO. The visual stimulus was presented 750 ms after TO, also for 500 ms. The intertrial interval (ITI) was jittered, ranging from 350–1350 ms, and target stimuli were inserted only in the longest ITIs, lasting for 300 ms.
Figure 1. Experimental design. (A) stimuli presented during the experiment. The “distractor” stimuli, whose associations are being learned incidentally, comprised 2 auditory CS corresponding to high- and low-frequency tones and one visual US consisting of 3 concentric squares. The target stimuli, to which the subjects responded, comprised a white noise burst and a circle. (B) Temporal sequence of a single trial. The CS and US could be either presented or omitted. The average trial duration was 2 s. The TO cue was a small central dot (100 ms); the auditory CS was presented for 500 ms, starting 400 ms after TO. The visual stimulus was presented 750 ms after TO, also for 500 ms. The intertrial interval (ITI) was jittered, ranging from 350–1350 ms, and target stimuli were inserted only in the longest ITIs, lasting for 300 ms.CC BY-NC · PubMed Central
Figure 2. Probabilistic relationship between auditory and visual stimuli. Contingency tables showing the proportion of each trial type occurring during CS+ and CS− blocks respectively. Below the tables are the resulting conditional probabilities of the visual stimulus being present (or absent), given the presence (or absence) of the auditory CS; these probabilities can be inferred by comparing the frequencies within each column of the table.
Figure 2. Probabilistic relationship between auditory and visual stimuli. Contingency tables showing the proportion of each trial type occurring during CS+ and CS− blocks respectively. Below the tables are the resulting conditional probabilities of the visual stimulus being present (or absent), given the presence (or absence) of the auditory CS; these probabilities can be inferred by comparing the frequencies within each column of the table.CC BY-NC · PubMed Central
Figure 3. Compound learning curves. Learning curves were calculated separately for trials on which the auditory CS was present (dots) and absent (crosses), during CS+ (blue), and CS− (red) blocks. Note that learning is slower in the absence of an auditory CS than in its presence and faster for CS+ than for CS− trials.
Figure 3. Compound learning curves. Learning curves were calculated separately for trials on which the auditory CS was present (dots) and absent (crosses), during CS+ (blue), and CS− (red) blocks. Note that learning is slower in the absence of an auditory CS than in its presence and faster for CS+ than for CS− trials.CC BY-NC · PubMed Central
Figure 4. Dynamic causal models of learning effects on audio-visual connectivity. For all 3 models, the primary auditory (A1) and visual (V1) areas are both driven by their respective sensory inputs. The first model tested had a single connection from A1 to V1 (M1). In model 2 (M2) the V1 → A1 connection was added. In both M1 and M2, the A1 → V1 connection was allowed to change during CS+ trials as a function of the visual outcome (V+ vs. V−) and the RW learning curve (ϕ). This modulatory effect corresponds to the interaction of the auditory CS+ prediction with the visual outcome and models a learning-dependent contribution to V1 responses from CS+ responses in A1; and this contribution depends on whether the visual stimulus was present or not (c.f., a prediction error mediated by top-down signals from A1). In the third model, suggested as a control by one of the reviewers, instead of the A1 → V1 connection, the V1 → A1 connection is modulated by the learning signal.
Figure 4. Dynamic causal models of learning effects on audio-visual connectivity. For all 3 models, the primary auditory (A1) and visual (V1) areas are both driven by their respective sensory inputs. The first model tested had a single connection from A1 to V1 (M1). In model 2 (M2) the V1 → A1 connection was added. In both M1 and M2, the A1 → V1 connection was allowed to change during CS+ trials as a function of the visual outcome (V+ vs. V−) and the RW learning curve (ϕ). This modulatory effect corresponds to the interaction of the auditory CS+ prediction with the visual outcome and models a learning-dependent contribution to V1 responses from CS+ responses in A1; and this contribution depends on whether the visual stimulus was present or not (c.f., a prediction error mediated by top-down signals from A1). In the third model, suggested as a control by one of the reviewers, instead of the A1 → V1 connection, the V1 → A1 connection is modulated by the learning signal.CC BY-NC · PubMed Central
Figure 5. fMRI results. (A) Significant activations in V1 as a function of RW learning, for both the 4-way interaction (CS type × CS presence × visual outcome × RW learning; red), and the simple (3-way) interaction (blue), which is restricted to the CS+ trials (x = −6, also showing the caudate activation) and (B) in the putamen bilaterally (y = 6), displayed on the mean structural image across all subjects. (C) z = 12. Significant 3-way interaction CS type × CS presence × RW learning in the DLPFC and left putamen (red). This interaction is driven by the CS+ trials, as shown by the simple interaction in blue.
Figure 5. fMRI results. (A) Significant activations in V1 as a function of RW learning, for both the 4-way interaction (CS type × CS presence × visual outcome × RW learning; red), and the simple (3-way) interaction (blue), which is restricted to the CS+ trials (x = −6, also showing the caudate activation) and (B) in the putamen bilaterally (y = 6), displayed on the mean structural image across all subjects. (C) z = 12. Significant 3-way interaction CS type × CS presence × RW learning in the DLPFC and left putamen (red). This interaction is driven by the CS+ trials, as shown by the simple interaction in blue.CC BY-NC · PubMed Central
Figure 6. Learning effects on audio-visual connectivity. Bayesian model comparison showed that the DCM with a single connection from A1 to V1 was superior to the other models. Across subjects, there was a significant “endogenous” or “fixed” strength of the A1 → V1 connection (0.10 s−1, P = 0.003) and a significant learning-induced modulation (magenta arrows) of this connection (P = 0.028). The insets show the parameter estimates for the main effects in both A1 and peripheral V1. The magenta arrows indicate how the main effect in peripheral V1 is modulated by changes in connectivity from A1 to V1 during CS+ trials: over time the response to surprising visual outcomes is upregulated, whereas the response to unsurprising visual outcomes is downregulated. Note that in this plot the magenta arrows designate the direction in which V1 responses change due to modulation of connectivity; for quantitative information on this modulatory effect, see the main text.
Figure 6. Learning effects on audio-visual connectivity. Bayesian model comparison showed that the DCM with a single connection from A1 to V1 was superior to the other models. Across subjects, there was a significant “endogenous” or “fixed” strength of the A1 → V1 connection (0.10 s−1, P = 0.003) and a significant learning-induced modulation (magenta arrows) of this connection (P = 0.028). The insets show the parameter estimates for the main effects in both A1 and peripheral V1. The magenta arrows indicate how the main effect in peripheral V1 is modulated by changes in connectivity from A1 to V1 during CS+ trials: over time the response to surprising visual outcomes is upregulated, whereas the response to unsurprising visual outcomes is downregulated. Note that in this plot the magenta arrows designate the direction in which V1 responses change due to modulation of connectivity; for quantitative information on this modulatory effect, see the main text.CC BY-NC · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 68 references

Research works printed but not linked: 1

  1. Hebb, 1949, The organisation of behaviour

Cited by

See all 320

Metadata

Authors
den Ouden, H. E. M., Friston, K. J., Daw, N. D., McIntosh, A. R., & Stephan, K. E.
Affiliations
  • Wellcome Centre for Human Neuroimaging (GB)
  • New York University (US)
  • University of Toronto (CA)
Venue
Cerebral Cortex
Published
2008-09-26
Volume
19
Issue
5
Pages
1175-1185
ISSN
  • 1047-3211 (ISSN-L)
  • 1460-2199
OpenAlex
W2125055052
Cited by
306
References
69
Citations by year
2026: 10 · 2025: 11 · 2024: 9 · 2023: 14 · 2022: 13 · 2021: 15 · 2020: 16 · 2019: 18 · 2018: 21 · 2017: 26 · 2016: 24 · 2015: 19 · 2014: 19 · 2013: 25 · 2012: 20
FWCI
20.90
Type
journal article
Language
en
Open access
Licence
cc-by-nc
Locations
  • Cerebral Cortex (publishedVersion, cc-by-nc)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
  • PubMed Central (publishedVersion, cc-by-nc)
  • PubMed (publishedVersion)
  • Zurich Open Repository and Archive (University of Zurich) (acceptedVersion, other-oa)
  • reroDoc Digital Library (submittedVersion)
  • Radboud Repository (Radboud University) (submittedVersion)
  • UCL Discovery (University College London) (submittedVersion)
  • Zurich Open Repository and Archive (University of Zurich) (submittedVersion, other-oa)
  • Radboud Repository (Radboud University) (submittedVersion, other-oa)
  • Zurich Open Repository and Archive (University of Zurich)
Funders
  • Wellcome Trust (078047/ZS/04/Z, 0856780/Z/99/B, 078047, 088130)
  • Universität Zürich
Topics
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
Keywords
prediction error, associative learning, incidental learning, surprise, Rescorla-Wagner model, predictive coding, dynamic causal modeling, auditory-visual association, primary visual cortex, putamen, associative plasticity, statistical learning
MeSH terms
Acoustic Stimulation, Adult, Association Learning, Cognition, Conditioning, Psychological, Female, Humans, Magnetic Resonance Imaging, Male, Models, Neurological, Neuronal Plasticity, Photic Stimulation, Young Adult

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: A Dual Role for Prediction Error in Associative Learning. https://app.cochat.ai/papers/10.1093/cercor/bhn161
The paper
den Ouden, H. E. M., Friston, K. J., Daw, N. D., McIntosh, A. R., & Stephan, K. E. (2009). A Dual Role for Prediction Error in Associative Learning. Cerebral Cortex. https://doi.org/10.1093/cercor/bhn161

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.