A Dual Role for Prediction Error in Associative Learning
Open accessThe DOI matches its Crossref record; 68 of the 69 references it cites were found in a registry or an index.
Abstract
Confronted with a rich sensory environment, the brain must learn statistical regularities across sensory domains to construct causal models of the world. Here, we used functional magnetic resonance imaging and dynamic causal modeling (DCM) to furnish neurophysiological evidence that statistical associations are learnt, even when task-irrelevant. Subjects performed an audio-visual target-detection task while being exposed to distractor stimuli. Unknown to them, auditory distractors predicted the presence or absence of subsequent visual distractors. We modeled incidental learning of these associations using a Rescorla-Wagner (RW) model. Activity in primary visual cortex and putamen reflected learning-dependent surprise: these areas responded progressively more to unpredicted, and progressively less to predicted visual stimuli. Critically, this prediction-error response was observed even when the absence of a visual stimulus was surprising. We investigated the underlying mechanism by embedding the RW model into a DCM to show that auditory to visual connectivity changed significantly over time as a function of prediction error. Thus, consistent with predictive coding models of perception, associative learning is mediated by prediction-error dependent changes in connectivity. These results posit a dual role for prediction-error in encoding surprise and driving associative plasticity.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures






Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“As with RS, ES has been consistently reported in human brain imaging studies across sensory modalities and noninvasive neural recording techniques 45 , 46 , 74 , 75 , 76 , 77 , 78 , 79 , 80 , 81 (but see Ref. 82)”
From Evaluating the neurophysiological evidence for predictive processing as a model of perception (2020) · cites this paper as [74]
Experimental — accuracy not yet measuredIn the citing paper
“These trial-wise prediction error estimates can be used as modulatory inputs in DCM, controlling changes in connection strength during learning (den Ouden et al., 2009).”
From Ten simple rules for dynamic causal modeling (2010) · cites this paper as den Ouden et al., 2009
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225 · cited 1×
“Cerebral Cortex May 2009;19:1175--1185 doi:10.1093/cercor/bhn161 Advance Access publication September 26, 2008”
InfluentialReinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Rescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 9,459
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · cited 2×
“learning because they signal the need for learning in order to update predictions (Shanks 1995; Schultz et al. 1997; Schultz and Dickinson 2000).”
Rao, R. P. N., & Ballard, D. H. (1999) · Nature Neuroscience · doi:10.1038/4580 · Cited by 5,483 · cited 1×
“The total duration of the experiment was approximately 60 min per subject.”
Maldjian, J. A., Laurienti, P. J., Kraft, R. A., & Burdette, J. H. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00169-1 · Cited by 5,085 · cited 2×
“…the role of the striatum and the prefrontal cortex in associative learning (e.g., Fletcher et al. 2001; O’Doherty et al. 2004; Corlett et al. 2004), we performed an additional restricted search in these areas, using anatomical masks generated from the PickAtlas toolbox (Maldjian et al. 2003).”
Friston, K. J., Harrison, L., & Penny, W. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00202-7 · Cited by 4,583 · cited 7×
“These models were fitted separately to each subject’s data and compared using Bayesian model selection (Penny et al. 2004).”
InfluentialSelf-citationA theory of cortical responses.
Friston, K. (2005) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2005.1622 · Cited by 4,578 · cited 8×
“a general framework for perceptual inference and learning that is discussed in the next section (Friston 2005).”
InfluentialSelf-citationPredictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
Classical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449
A new SPM toolbox for combining probabilistic cytoarchitectonic maps and functional imaging data
Eickhoff, S. B., Stephan, K. E., Mohlberg, H., Grefkes, C., Fink, G. R., Amunts, K., & Zilles, K. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2004.12.034 · Cited by 4,033 · cited 4×
“Specifically, we thresholded the subject-specific SPMs at P < 0.05 and chose the local maximum within 8 mm of the group activation maxima in primary auditory cortex (A1) and primary visual cortex (V1) as inferred by a probabilistic cytoarchitectonic atlas in MNI space (Eickhoff et al. 2005).”
InfluentialSelf-citationAn internal model for sensorimotor integration
Wolpert, D. M., Ghahramani, Z., & Jordan, M. I. (1995) · Science · doi:10.1126/science.7569931 · Cited by 3,553 · cited 2×
“A mechanism similar to predictive coding has been proposed in the motor domain for cancellation of selfgenerated events ( Wolpert et al. 1995; Blakemore et al. 1998; Shergill et al. 2005).”
Pearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023 · cited 2×
“Finally, the associative learning models of Pearce and Hall (1980) and Mackintosh (1975) assume that prediction errors affect the amount of attention that is allocated to stimuli and that the more attention is allocated to a specific stimulus, the more strongly it becomes associated with an outcome…”
A theory of attention: Variations in the associability of stimuli with reinforcement
Mackintosh, N. J. (1975) · Psychological Review · doi:10.1037/h0076778 · Cited by 2,733
Early selective-attention effect on evoked potential reinterpreted
Näätänen, R., Gaillard, A. W. K., & Mäntysalo, S. (1978) · Acta Psychologica · doi:10.1016/0001-6918(78)90006-9 · Cited by 2,706 · cited 1×
“Importantly, the relationship between the MMN and learning was not established on the basis of behavioral data; in fact, it was initially not even recognized (Naatanen et al. 1978).”
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533 · cited 2×
“More precisely, for RW and similar ‘‘caching’’ models (Daw et al. 2005) the connection strength at time t should carry the predicted association at time t (McLaren et al.”
Self-citationDissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088 · cited 6×
“Because previous studies demonstrated the role of the striatum and the prefrontal cortex in associative learning (e.g., Fletcher et al. 2001; O’Doherty et al. 2004; Corlett et al. 2004), we performed an additional restricted search in these areas, using anatomical masks generated from the PickAtlas…”
InfluentialSelf-citationDopamine-dependent prediction errors underpin reward-seeking behaviour in humans
Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J., & Frith, C. D. (2006) · Nature · doi:10.1038/nature05051 · Cited by 1,584 · cited 2×
“…(key dopaminergic targets) has been shown to covary with both predictions and prediction errors (Fletcher et al. 2001; McClure et al. 2003; Corlett et al. 2004; O’Doherty et al. 2004; Seymour et al. 2004; Turner et al. 2004; Gläscher and Büchel 2005; Pessiglione et al. 2006; Jensen et al. 2007).”
InfluentialTemporal difference models and reward-related learning in the human brain
O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003) · Neuron · doi:10.1016/s0896-6273(03)00169-7 · Cited by 1,522 · cited 2×
“…studies in humans have demonstrated that BOLD activity in the striatum is correlated with (signed) prediction errors during reinforcement learning (O’Doherty et al. 2003; McClure et al. 2003; O’Doherty et al. 2004; Seymour et al. 2004; Jensen et al. 2007; Menon et al. 2007) and other associative…”
Self-citationCentral cancellation of self-produced tickle sensation
Blakemore, S.-J., Wolpert, D. M., & Frith, C. D. (1998) · Nature Neuroscience · doi:10.1038/2870 · Cited by 1,467 · cited 2×
“A mechanism similar to predictive coding has been proposed in the motor domain for cancellation of self-generated events (Wolpert et al. 1995; Blakemore et al. 1998; Shergill et al. 2005).”
Neuronal Coding of Prediction Errors
Schultz, W., & Dickinson, A. (2000) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.23.1.473 · Cited by 1,427 · cited 8×
“2005) the connection strength at time t should carry the predicted association at time t (McLaren et al. 1989; Schultz and Dickinson 2000).”
InfluentialA free energy principle for the brain
Friston, K., Kilner, J., & Harrison, L. (2006) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2006.10.001 · Cited by 1,369 · cited 2×
“Indeed a hallmark of adaptive systems is their ability to minimize surprising exchanges with their environment (Friston et al. 2006).”
Self-citationModeling Geometric Deformations in EPI Time Series
Andersson, J. L. R., Hutton, C., Ashburner, J., Turner, R., & Friston, K. (2001) · NeuroImage · doi:10.1006/nimg.2001.0746 · Cited by 1,011
Self-citationNeural Economics and the Biological Substrates of Valuation
Montague, P. R., & Berns, G. S. (2002) · Neuron · doi:10.1016/s0896-6273(02)00974-1 · Cited by 994 · cited 1×
“In the absence of interactions among multiple cues per trial, the RW model is mathematically equivalent to a Hebbian model of associative learning ( Montague and Berns 2002 ).”
Temporal Prediction Errors in a Passive Learning Task Activate Human Striatum
McClure, S. M., Berns, G. S., & Montague, P. R. (2003) · Neuron · doi:10.1016/s0896-6273(03)00154-5 · Cited by 917 · cited 5×
“…prefrontal cortex (DLPFC) (key dopaminergic targets) has been shown to covary with both predictions and prediction errors (Fletcher et al. 2001; McClure et al. 2003; Corlett et al. 2004; O’Doherty et al. 2004; Seymour et al. 2004; Turner et al. 2004; Gläscher and Büchel 2005; Pessiglione et…”
InfluentialAnatomical evidence of multimodal integration in primate striate cortex
Falchier, A., Clavagnier, S., Barone, P., & Kennedy, H. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-13-05749.2002 · Cited by 892 · cited 1×
“3A), and anatomical connections from primary auditory cortex to peripheral visual cortex have been demonstrated in recent monkey studies (Falchier et al. 2002; Rockland and Ojima 2003).”
Comparing dynamic causal models.
Penny, W. D., Stephan, K. E., Mechelli, A., & Friston, K. J. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.03.026 · Cited by 848 · cited 1×
“These models were fitted separately to each subject’s data and compared using Bayesian model selection (Penny et al. 2004).”
Self-citation‘Primitive intelligence’ in the auditory cortex
Näätänen, R., Tervaniemi, M., Sussman, E., Paavilainen, P., & Winkler, I. (2001) · Trends in Neurosciences · doi:10.1016/s0166-2236(00)01790-2 · Cited by 832 · cited 2×
“A good example of this notion is given by the mismatch negativity (MMN), the difference between the event-related potential to an unexpected ‘‘deviant’’ and predictable ‘‘standard’’ stimuli (Naatanen et al. 2001).”
Learning and inference in the brain
Friston, K. (2003) · Neural Networks · doi:10.1016/j.neunet.2003.06.005 · Cited by 724 · cited 2×
“Cerebral Cortex May 2009;19:1175--1185 doi:10.1093/cercor/bhn161 Advance Access publication September 26, 2008”
InfluentialSelf-citationClassical and Bayesian Inference in Neuroimaging: Applications
Friston, K. J., Glaser, D. E., Henson, R. N. A., Kiebel, S., Phillips, C., & Ashburner, J. (2002) · NeuroImage · doi:10.1006/nimg.2002.1091 · Cited by 719 · cited 1×
“The data were high-pass filtered (cut-off 128 s) to remove low-frequency signal drifts, and a first-order autoregressive model was used to model the remaining serial correlations (Friston et al. 2002).”
Self-citationDynamic causal modeling of evoked responses in EEG and MEG
David, O., Kiebel, S. J., Harrison, L. M., Mattout, J., Kilner, J. M., & Friston, K. J. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2005.10.045 · Cited by 620
Self-citationTemporal difference models describe higher-order learning in humans
Seymour, B., O'Doherty, J. P., Dayan, P., Koltzenburg, M., Jones, A. K., Dolan, R. J., Friston, K. J., & Frackowiak, R. S. (2004) · Nature · doi:10.1038/nature02581 · Cited by 605 · cited 4×
“…(key dopaminergic targets) has been shown to covary with both predictions and prediction errors (Fletcher et al. 2001; McClure et al. 2003; Corlett et al. 2004; O’Doherty et al. 2004; Seymour et al. 2004; Turner et al. 2004; Gläscher and Büchel 2005; Pessiglione et al. 2006; Jensen et al. 2007).”
InfluentialSelf-citationMultisensory convergence in calcarine visual areas in macaque monkey
Rockland, K. S., & Ojima, H. (2003) · International Journal of Psychophysiology · doi:10.1016/s0167-8760(03)00121-1 · Cited by 564 · cited 1×
“3A), and anatomical connections from primary auditory cortex to peripheral visual cortex have been demonstrated in recent monkey studies (Falchier et al. 2002; Rockland and Ojima 2003).”
Marreiros, A., Stephan, K., & Friston, K. (2010) · Scholarpedia · doi:10.4249/scholarpedia.9568 · Cited by 559
Self-citationPredictive codes for forthcoming perception in the frontal cortex.
Summerfield, C., Egner, T., Greene, M., Koechlin, E., Mangels, J., & Hirsch, J. (2006) · Science · doi:10.1126/science.1132028 · Cited by 496
Shape perception reduces activity in human primary visual cortex
Murray, S. O., Kersten, D., Olshausen, B. A., Schrater, P., & Woods, D. L. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.192579399 · Cited by 496 · cited 2×
“…a hierarchy of connected brain areas in which each level strives to attain a compromise between information about sensory inputs provided by the level below and predictions (or priors) provided by the level above (Rao and Ballard 1999; Murray et al. 2002; Friston 2003; Summerfield et al. 2006).”
Theories of Associative Learning in Animals
Pearce, J. M., & Bouton, M. E. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.111 · Cited by 492 · cited 1×
“Cerebral Cortex May 2009;19:1175--1185 doi:10.1093/cercor/bhn161 Advance Access publication September 26, 2008”
InfluentialReward Value Coding Distinct From Risk Attitude-Related Uncertainty Coding in Human Reward Systems
Tobler, P. N., O'Doherty, J. P., Dolan, R. J., & Schultz, W. (2007) · Journal of Neurophysiology · doi:10.1152/jn.00745.2006 · Cited by 472 · cited 2×
“, a reward), often led to a decrease in neuronal or BOLD activity (Schultz 1998; McClure et al. 2003; Tobler et al. 2007).”
The Predictive Value of Changes in Effective Connectivity for Human Learning
Büchel, C., Coull, J. T., & Friston, K. J. (1999) · Science · doi:10.1126/science.283.5407.1538 · Cited by 447 · cited 2×
“…have exclusively searched for brain areas whose activity correlated with specific variables of a particular learning model (e.g., prediction or prediction error), but have not investigated how these variables change interactions among areas (but see McIntosh et al. 1998; Büchel et al. 1999).”
Self-citationEvidence for sensory prediction deficits in schizophrenia
Shergill, S. S., Samson, G., Bays, P. M., Frith, C. D., & Wolpert, D. M. (2005) · American Journal of Psychiatry · doi:10.1176/appi.ajp.162.12.2384 · Cited by 432 · cited 2×
“A mechanism similar to predictive coding has been proposed in the motor domain for cancellation of selfgenerated events (Wolpert et al. 1995; Blakemore et al. 1998; Shergill et al. 2005 ).”
Parallel Distributed Processing: Implications for Psychology and Neurobiology
Wolters, G. (1990) · Trends in Neurosciences · doi:10.1016/0166-2236(90)90131-s · Cited by 415
Brogden, W. J. (1939) · Journal of Experimental Psychology · doi:10.1037/h0058944 · Cited by 409 · cited 2×
“In a third and final stage, the presentation of a CS2 alone generates a conditioned response, indicating that the subject must have learned the initial CS1--CS2 association (Brogden 1939; Gewirtz and Davis 2000).”
The Psychology of Associative Learning
Shanks, D. R. (1995) · doi:10.1017/cbo9780511623288 · Cited by 387
Sound alters activity in human V1 in association with illusory visual perception
Watkins, S., Shams, L., Tanaka, S., Haynes, J.-D., & Rees, G. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.01.016 · Cited by 343 · cited 2×
“Additionally, numerous fMRI studies have demonstrated that auditory stimulation or auditory attention affect activity in visual cortices during simultaneous processing of visual stimuli (e.g., McIntosh et al. 1998; Baier et al. 2006; Watkins et al. 2006).”
Implicit multisensory associations influence voice recognition
von Kriegstein, K., & Giraud, A.-L. (2006) · PLoS Biology · doi:10.1371/journal.pbio.0040326 · Cited by 309
Human Midbrain Sensitivity to Cognitive Feedback and Uncertainty During Classification Learning
Aron, A. R., Shohamy, D., Clark, J., Myers, C., Gluck, M. A., & Poldrack, R. A. (2004) · Journal of Neurophysiology · doi:10.1152/jn.01209.2003 · Cited by 269 · cited 2×
“Cerebral Cortex May 2009;19:1175--1185 doi:10.1093/cercor/bhn161 Advance Access publication September 26, 2008”
InfluentialCsépe, V., Karmos, G., & Molnár, M. (1987) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(87)90103-9 · Cited by 264 · cited 2×
“This relationship was only subsequently inferred from striking relationships between the probability of deviants and neurophysiological time series (e.g., Csepe et al. 1987; Pincze et al. 2002).”
McLaren, I. P. L., Kaye, H., & Mackintosh, N. J. (1989) · Cited by 264
Anticipation of novelty recruits reward system and hippocampus while promoting recollection
Wittmann, B. C., Bunzeck, N., Dolan, R. J., & Düzel, E. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.06.038 · Cited by 262 · cited 2×
“for predicting significant events (Zink et al. 2006; Wittmann et al. 2007).”
Parallel Distributed Processing: Implications for Psychology and Neurobiology
Morris, R. (1990) · Oxford University Press eBooks · Cited by 242
Fletcher, P. C., Anderson, J. M., Shanks, D. R., Honey, R., Carpenter, T. A., Donovan, T., Papadakis, N., & Bullmore, E. T. (2001) · Nature Neuroscience · doi:10.1038/nn733 · Cited by 238 · cited 8×
“The adapted volumes, as a percentage of the volume of the low tone were 94.0 ± 6.2% (mean ± SD) for the high tone, and 104 ± 4.9% for the white noise burst.”
InfluentialDynamic causal modelling of evoked potentials: A reproducibility study
Garrido, M. I., Kilner, J. M., Kiebel, S. J., Stephan, K. E., & Friston, K. J. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.03.014 · Cited by 233 · cited 11×
“These studies demonstrated that MMN can be understood as a prediction-error signal, which results from deviant-induced changes in inter-regional connection strengths.”
InfluentialSelf-citationRepetition effects to sounds: evidence for predictive coding in the auditory system
Baldeweg, T. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.01.010 · Cited by 223 · cited 3×
“Current theories of MMN, which interpret it as a paradigmatic example of learning based on predictive coding (Friston 2005; Baldeweg 2006), have recently received empirical support by DCM studies of electroencephalographic measurements (David et al. 2006; Garrido et al. 2007).”
Dynamic causal models of neural system dynamics: current state and future extensions
Stephan, K. E., Harrison, L. M., Kiebel, S. J., David, O., Penny, W. D., & Friston, K. J. (2007) · Journal of Biosciences · doi:10.1007/s12038-007-0012-5 · Cited by 218
Self-citationRating causal relations: Role of probability in judgments of response^outcome contingency.
Wasserman, E. A., Elek, S. M., Chatlosh, D. L., & Baker, A. G. (1993) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037//0278-7393.19.1.174 · Cited by 216 · cited 2×
“Learning was stronger for the CS + blocks than for the CS– blocks, which is in line with previous behavioral evidence (Wasserman et al. 1993; Fletcher et al. 2001).”
Separate brain regions code for salience vs. valence during reward prediction in humans
Jensen, J., Smith, A. J., Willeit, M., Crawley, A. P., Mikulis, D. J., Vitcu, I., & Kapur, S. (2007) · Human Brain Mapping · doi:10.1002/hbm.20274 · Cited by 178 · cited 3×
“…(key dopaminergic targets) has been shown to covary with both predictions and prediction errors (Fletcher et al. 2001; McClure et al. 2003; Corlett et al. 2004; O’Doherty et al. 2004; Seymour et al. 2004; Turner et al. 2004; Gläscher and Büchel 2005; Pessiglione et al. 2006; Jensen et al. 2007).”
Prediction Error during Retrospective Revaluation of Causal Associations in Humans
Corlett, P. R., Aitken, M. R. F., Dickinson, A., Shanks, D. R., Honey, G. D., Honey, R. A. E., Robbins, T. W., Bullmore, E. T., & Fletcher, P. C. (2004) · Neuron · doi:10.1016/j.neuron.2004.11.022 · Cited by 168 · cited 7×
“…for behavior, either because they were linked to rewarding or punishing outcomes (e.g., McClure et al. 2003; O’Doherty et al. 2004; Seymour et al. 2004) or because subjects received feedback on their performance (Fletcher et al. 2001; Aron et al. 2004; Corlett et al. 2004; Turner et al. 2004).”
InfluentialGewirtz, J. C., & Davis, M. (2000) · Learning & Memory · doi:10.1101/lm.35200 · Cited by 168 · cited 2×
“In a third and final stage, the presentation of a CS2 alone generates a conditioned response, indicating that the subject must have learned the initial CS1--CS2 association (Brogden 1939; Gewirtz and Davis 2000).”
Human striatal activation reflects degree of stimulus saliency
Zink, C. F., Pagnoni, G., Chappelow, J., Martin-Skurski, M., & Berns, G. S. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2005.08.006 · Cited by 168 · cited 2×
“for predicting significant events (Zink et al. 2006; Wittmann et al. 2007).”
Interhemispheric Integration of Visual Processing during Task-Driven Lateralization
Stephan, K. E., Marshall, J. C., Penny, W. D., Friston, K. J., & Fink, G. R. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.4766-06.2007 · Cited by 166
Self-citationMenon, M., Jensen, J., Vitcu, I., Graff‐Guerrero, A., Crawley, A. P., Smith, M. A., & Kapur, S. (2007) · Biological Psychiatry · doi:10.1016/j.biopsych.2006.10.020 · Cited by 157 · cited 2×
“Previous fMRI studies in humans have demonstrated that BOLD activity in the striatum is correlated with (signed) prediction errors during reinforcement learning (O’Doherty et al. 2003; McClure et al. 2003; O’Doherty et al. 2004; Seymour et al. 2004; Jensen et al. 2007; Menon et al. 2007) and other associative learning…”
On the role of general system theory for functional neuroimaging
Stephan, K. E. (2004) · Journal of Anatomy · doi:10.1111/j.0021-8782.2004.00359.x · Cited by 152
Self-citationAnalysis of Neural Interactions Explains the Activation of Occipital Cortex by an Auditory Stimulus
McIntosh, A. R., Cabeza, R. E., & Lobaugh, N. J. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.5.2790 · Cited by 105 · cited 9×
“Because we knew from a previous study that learning should occur in the visual cortex (McIntosh et al. 1998), we adopted the approach by Gläscher and Büchel (2005) of optimizing the value of ei to best explain putative learning-induced responses within the main area of interest, the visual cortex.”
InfluentialSelf-citationBaier, B., Kleinschmidt, A., & Müller, N. G. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.1457-06.2006 · Cited by 98 · cited 3×
“Additionally, numerous fMRI studies have demonstrated that auditory stimulation or auditory attention affect activity in visual cortices during simultaneous processing of visual stimuli (e.g., McIntosh et al. 1998; Baier et al. 2006; Watkins et al. 2006).”
Turner, D. C. (2004) · Cerebral Cortex · doi:10.1093/cercor/bhh046 · Cited by 94 · cited 3×
“…(key dopaminergic targets) has been shown to covary with both predictions and prediction errors (Fletcher et al. 2001; McClure et al. 2003; Corlett et al. 2004; O’Doherty et al. 2004; Seymour et al. 2004; Turner et al. 2004; Gläscher and Büchel 2005; Pessiglione et al. 2006; Jensen et al. 2007).”
InfluentialPincze, Z., Lakatos, P., Rajkai, C., Ulbert, I., & Karmos, G. (2002) · Cognitive Brain Research · doi:10.1016/s0926-6410(01)00105-7 · Cited by 69 · cited 1×
“This relationship was only subsequently inferred from striking relationships between the probability of deviants and neurophysiological time series (e.g., Csepe et al. 1987; Pincze et al. 2002).”
CLARKE, L. (1975) · Industrial and Commercial Training · doi:10.1108/eb003490 · Cited by 69
Formal Learning Theory Dissociates Brain Regions with Different Temporal Integration
Gläscher, J. P., & Büchel, C. (2005) · Neuron · doi:10.1016/j.neuron.2005.06.008 · Cited by 66 · cited 6×
“…(key dopaminergic targets) has been shown to covary with both predictions and prediction errors (Fletcher et al. 2001; McClure et al. 2003; Corlett et al. 2004; O’Doherty et al. 2004; Seymour et al. 2004; Turner et al. 2004; Gläscher and Büchel 2005; Pessiglione et al. 2006; Jensen et al. 2007).”
Influential
Research works printed but not linked: 1
- Hebb DO The organisation of behaviour 1949 New York John Wiley
Cited by
Dysconnection in schizophrenia: from abnormal synaptic plasticity to failures of self-monitoring
Stephan, K. E., Friston, K. J., & Frith, C. D. (2009) · Schizophrenia Bulletin · doi:10.1093/schbul/sbn176 · Cited by 1,134
Self-citationExpectation (and attention) in visual cognition
Summerfield, C., & Egner, T. (2009) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2009.06.003 · Cited by 950
Expectation in perceptual decision making: neural and computational mechanisms
Summerfield, C., & de Lange, F. P. (2014) · Nature Reviews Neuroscience · doi:10.1038/nrn3838 · Cited by 832
Ten simple rules for dynamic causal modeling
Stephan, K. E., Penny, W. D., Moran, R. J., den Ouden, H. E. M., Daunizeau, J., & Friston, K. J. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.11.015 · Cited by 803
“These trial-wise prediction error estimates can be used as modulatory inputs in DCM, controlling changes in connection strength during learning (den Ouden et al., 2009).”
Self-citationLess Is More: Expectation Sharpens Representations in the Primary Visual Cortex
Kok, P., Jehee, J. F. M., & de Lange, F. P. (2012) · Neuron · doi:10.1016/j.neuron.2012.04.034 · Cited by 798
“These data suggest that expectation facilitates perception by sharpening sensory representations.”
Influential
Metadata
- Authors
- den Ouden, H. E. M., Friston, K. J., Daw, N. D., McIntosh, A. R., & Stephan, K. E.
- Affiliations
- Wellcome Centre for Human Neuroimaging (GB)
- New York University (US)
- University of Toronto (CA)
- Venue
- Cerebral Cortex
- Publisher
- Oxford University Press (OUP)
- Published
- 2008-09-26
- Volume
- 19
- Issue
- 5
- Pages
- 1175-1185
- ISSN
- 1047-3211 (ISSN-L)
- 1460-2199
- PMC
- PMC2665159
- OpenAlex
- W2125055052
- Cited by
- 306
- References
- 69
- Citations by year
- 2026: 10 · 2025: 11 · 2024: 9 · 2023: 14 · 2022: 13 · 2021: 15 · 2020: 16 · 2019: 18 · 2018: 21 · 2017: 26 · 2016: 24 · 2015: 19 · 2014: 19 · 2013: 25 · 2012: 20
- FWCI
- 20.90
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by-nc
- Locations
- Cerebral Cortex (publishedVersion, cc-by-nc)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- Zurich Open Repository and Archive (University of Zurich) (acceptedVersion, other-oa)
- reroDoc Digital Library (submittedVersion)
- Radboud Repository (Radboud University) (submittedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Zurich Open Repository and Archive (University of Zurich) (submittedVersion, other-oa)
- Radboud Repository (Radboud University) (submittedVersion, other-oa)
- Zurich Open Repository and Archive (University of Zurich)
- Funders
- Wellcome Trust (078047/ZS/04/Z, 0856780/Z/99/B, 078047, 088130)
- Universität Zürich
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- prediction error, associative learning, incidental learning, surprise, Rescorla-Wagner model, predictive coding, dynamic causal modeling, auditory-visual association, primary visual cortex, putamen, associative plasticity, statistical learning
- MeSH terms
- Acoustic Stimulation, Adult, Association Learning, Cognition, Conditioning, Psychological, Female, Humans, Magnetic Resonance Imaging, Male, Models, Neurological, Neuronal Plasticity, Photic Stimulation, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.