Responses of human frontal cortex to surprising events are predicted by formal associative learning theory
The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
Learning depends on surprise and is not engendered by predictable occurrences. In this functional magnetic resonance imaging (fMRI) study of causal associative learning, we show that dorsolateral prefrontal cortex (DLPFC) is associated specifically with the adjustment of inferential learning on the basis of unpredictability. At the outset, when all associations were unpredictable, DLPFC activation was maximal. This response attenuated with learning but, subsequently, activation here was evoked by surprise violations of the learned association. Furthermore, the magnitude of DLPFC response to a surprise event was sensitive to the relationship that had been learned and was predictive of subsequent behavioral change. In short, the physiological response properties of right DLPFC satisfied specific predictions made by associative learning theory.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In addition to the hippocampus, there may be a role for other higher-order brain regions specialized in acquiring complex associations, such as in the prefrontal cortex [54][55][56][57], particularly when complex, semantic associations are involved.”
From How Do Expectations Shape Perception? (2018) · cites this paper as [55]
Citations
Cites
An Integrative Theory of Prefrontal Cortex Function
Miller, E. K., & Cohen, J. D. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.167 · Cited by 12,803 · cited 1×
“This view resonates with the suggestion that a primary function of frontal cortex is in the provision of bias signals guiding activity in other brain regions in order to establish mappings between stimuli and appropriate response”
BackgroundCo-Planar Stereotaxic Atlas of the Human Brain
Talairach, J., & Tournoux, P. (1988) · Medical Entomology and Zoology · Cited by 11,798
Statistical parametric maps in functional imaging: A general linear approach
Friston, K. J., Holmes, A. P., Worsley, K. J., Poline, J. ‐., Frith, C. D., & Frackowiak, R. S. J. (1994) · Human Brain Mapping · doi:10.1002/hbm.460020402 · Cited by 9,688 · cited 1×
“All data analysis was done using statistical parametric mappin”
MethodCo-planar stereotaxic atlas of the human brain
Laitinen, L. (1989) · Clinical Neurology and Neurosurgery · doi:10.1016/0303-8467(89)90128-5 · Cited by 7,565
McClelland, J. L., McNaughton, B. L., & O'Reilly, R. C. (1995) · Psychological Review · doi:10.1037/0033-295x.102.3.419 · Cited by 5,256
Classical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449
From Neuropsychology to Mental Structure
Shallice, T. (1988) · doi:10.1017/cbo9780511526817 · Cited by 4,072
Spatial registration and normalization of images
Friston, K. J., Ashburner, J., Frith, C. D., Poline, J. ‐., Heather, J. D., & Frackowiak, R. S. J. (1995) · Human Brain Mapping · doi:10.1002/hbm.460030303 · Cited by 4,028 · cited 1×
“This included slice acquisition time correction, within-subject image realignment, spatial normalization to a standard templat”
MethodMacDonald, A. W., Cohen, J. D., Stenger, V. A., & Carter, C. S. (2000) · Science · doi:10.1126/science.288.5472.1835 · Cited by 3,666 · cited 1×
“Further evidence for this derives from the observation that, in the Stroop interference task, alerting a subject to imminent interference produces a preparatory activation in left DLPFC compared to the unprepared stat”
BackgroundAnterior Cingulate Cortex, Error Detection, and the Online Monitoring of Performance
Carter, C. S., Braver, T. S., Barch, D. M., Botvinick, M. M., Noll, D., & Cohen, J. D. (1998) · Science · doi:10.1126/science.280.5364.747 · Cited by 3,273 · cited 1×
“Our observation that DLPFC is sensitive to unpredictability—but not directly to error—is consistent with views that relate DLPFC and anterior cingulate cortex function to conditions in which conflict occur”
ResultThe Prefrontal Cortex: Anatomy, Physiology, and Neuropsychology of the Frontal Lobe
Fuster, J. M. (1980) · Cited by 2,407
Fuster, J. M. (1997) · Cited by 2,244
Conflict monitoring versus selection-for-action in anterior cingulate cortex
Botvinick, M., Nystrom, L. E., Fissell, K., Carter, C. S., & Cohen, J. D. (1999) · Nature · doi:10.1038/46035 · Cited by 2,044 · cited 1×
“This has been further demonstrated in a 'flanker' tas”
BackgroundEvent-Related fMRI: Characterizing Differential Responses
Friston, K. J., Fletcher, P., Josephs, O., Holmes, A., Rugg, M. D., & Turner, R. (1998) · NeuroImage · doi:10.1006/nimg.1997.0306 · Cited by 2,029 · cited 1×
“In this fMRI study of causal associative learning, we used a trial-specific desig”
MethodSelf-citationBuilding Memories: Remembering and Forgetting of Verbal Experiences as Predicted by Brain Activity
Wagner, A. D., Schacter, D. L., Rotte, M., Koutstaal, W., Maril, A., Dale, A. M., Rosen, B. R., & Buckner, R. L. (1998) · Science · doi:10.1126/science.281.5380.1188 · Cited by 1,631
Practice-related Changes in Human Brain Functional Anatomy during Nonmotor Learning
Raichle, M. E., Fiez, J. A., Videen, T. O., MacLeod, A.-M. K., Pardo, J. V., Fox, P. T., & Petersen, S. E. (1994) · Cerebral Cortex · doi:10.1093/cercor/4.1.8 · Cited by 1,593 · cited 1×
“The finding that bilateral frontal regions were sensitive to initial learning is consistent with previous studies showing that activation in areas of frontal cortex decreases and disappear”
ResultNeuronal Coding of Prediction Errors
Schultz, W., & Dickinson, A. (2000) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.23.1.473 · Cited by 1,427 · cited 1×
“Associative learning theory suggests that unpredictability—a discrepancy between a predicted and an actual outcome—forms the basis for learnin”
BackgroundMaking Memories: Brain Activity that Predicts How Well Visual Experience Will Be Remembered
Brewer, J. B., Zhao, Z., Desmond, J. E., Glover, G. H., & Gabrieli, J. D. E. (1998) · Science · doi:10.1126/science.281.5380.1185 · Cited by 1,108
Error-related brain activation during a Go/NoGo response inhibition task
Menon, V., Adleman, N. E., White, C. D., Glover, G. H., & Reiss, A. L. (2001) · Human Brain Mapping · doi:10.1002/1097-0193(200103)12:3<131::aid-hbm1010>3.0.co;2-c · Cited by 1,045
Dopamine responses comply with basic assumptions of formal learning theory
Waelti, P., Dickinson, A., & Schultz, W. (2001) · Nature · doi:10.1038/35083500 · Cited by 1,018
Prefrontal–cingulate interactions in action monitoring
Gehring, W. J., & Knight, R. T. (2000) · Nature Neuroscience · doi:10.1038/74899 · Cited by 917 · cited 1×
“Our data also support an electrophysiological study of cued motor responses in patients with lateral PFC damage who show a normal evoked electrical response to errors but weakened tendency to use this information to correct error”
ResultConjunctive representations in learning and memory: Principles of cortical and hippocampal function.
O'Reilly, R. C., & Rudy, J. W. (2001) · Psychological Review · doi:10.1037//0033-295x.108.2.311 · Cited by 865
Fuster, J. M. (2000) · Experimental Brain Research · doi:10.1007/s002210000401 · Cited by 555 · cited 1×
“A related though more anatomically specific position is that a key role of DLPFC lies in the mediation of cross-temporal contingencie”
BackgroundThe prefrontal cortex: Anatomy, physiology and neuropsychology of the frontal lobe
Andy, O. J. (1981) · Surgical Neurology · doi:10.1016/0090-3019(81)90062-8 · Cited by 455
The neural consequences of conflict between intention and the senses
Fink, G. R., Marshall, J. C., Halligan, P. W., Frith, C. D., Driver, J., Frackowiak, R. S. J., & Dolan, R. J. (1999) · Brain · doi:10.1093/brain/122.3.497 · Cited by 447 · cited 1×
“Our second observation, that right DLPFC is sensitive to unpredictability, is also consistent with previous wor”
ResultCasey, B. J., Thomas, K. M., Welsh, T. F., Badgaiyan, R. D., Eccard, C. H., Jennings, J. R., & Crone, E. A. (2000) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.97.15.8728 · Cited by 389 · cited 1×
“This has been further demonstrated in a 'flanker' tas”
BackgroundThe Psychology of Associative Learning
Shanks, D. R. (1995) · doi:10.1017/cbo9780511623288 · Cited by 387
Self-citationA Computational Model of Skill Acquisition
Sussman, G. J. (1973) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 339
Three cortical stages of colour processing in the human brain
Zeki, S. (1998) · Brain · doi:10.1093/brain/121.9.1669 · Cited by 291 · cited 1×
“Our second observation, that right DLPFC is sensitive to unpredictability, is also consistent with previous wor”
ResultRating causal relations: Role of probability in judgments of response^outcome contingency.
Wasserman, E. A., Elek, S. M., Chatlosh, D. L., & Baker, A. G. (1993) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037//0278-7393.19.1.174 · Cited by 216
The 28th Bartlett Memorial Lecture Causal learning: An associative analysis
Dickinson, A. (2001) · The Quarterly Journal of Experimental Psychology B · doi:10.1080/02724990042000010 · Cited by 186
“Sculpting the Response Space”—An Account of Left Prefrontal Activation at Encoding
Fletcher, P. C., Shallice, T., & Dolan, R. J. (2000) · NeuroImage · doi:10.1006/nimg.2000.0633 · Cited by 171 · cited 1×
“The finding that bilateral frontal regions were sensitive to initial learning is consistent with previous studies showing that activation in areas of frontal cortex decreases and disappear”
ResultSelf-citationTest question modulates cue competition between causes and between effects.
Matute, H., Arcediano, F., & Miller, R. R. (1996) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037//0278-7393.22.1.182 · Cited by 105 · cited 1×
“Three fictitious drug names (Dugetil, Batatrim and Aubina) and three fictitious syndromes (Hamkaoman, Huxley and Lyndsay) were taken from a behavioral stud”
BackgroundLiddle (2001) · doi:10.1002/1097-0193(200102)12:2<100::aid-hbm1007>3.0.co;2-6 · cited 1×
“In a 'go/no go' task in which both 'go' and 'no go' trials are equally frequen”
BackgroundIdentifying global anatomical differences: Deformation-based morphometry
(1998) · doi:10.1002/(sici)1097-0193(1998)6:5/6
Research works printed but not linked: 3
- Shanks, D. R., Medoff, D. R. & Medin, D. L. The Psychology of Learning and Motivation: Causal Learning (Academic, San Diego, 1996).
- Buckner, R. L. Event-related fMRI and the hemodynamic response Hum. Brain. Mapp. 6, 373–377 (1998). · doi:10.1002/(sici)1097-0193(1998)6:5/6<373::aid-hbm8>3.0.co;2-p
- Nelson, H. E. The National Adult Reading Test (NART) (NFER–Nelson, Windor, Connecticut, 1982).
Cited by
Getting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574
“These results argue strongly in favor of athat differ from predictions (Gemba et al., 1986; Fal- kenstein et al., 1991; Berns et al., 1997; Nobre et al., role of the ambient, sustained dopamine concentration and receptor stimulation in a large number of behavioral1999; Fletcher et al., 2001).”
Social cognition and the brain: A meta-analysis
Van Overwalle, F. (2009) · Human Brain Mapping · doi:10.1002/hbm.20547 · Cited by 1,792
Temporal difference models and reward-related learning in the human brain
O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003) · Neuron · doi:10.1016/s0896-6273(03)00169-7 · Cited by 1,522
“…that a number of previous imaging studies of associative learning have sought to explain their re-showed that when a reward was delivered later than expected in a trial, a positive BOLD signal was generated sults in terms of formal learning models (Ploghaus et al., 2000; Fletcher et al., 2001).”
BackgroundPhillips, M. L., Ladouceur, C. D., & Drevets, W. C. (2008) · Molecular Psychiatry · doi:10.1038/mp.2008.65 · Cited by 1,383
Bayesian surprise attracts human attention
Itti, L., & Baldi, P. (2009) · Vision Research · doi:10.1016/j.visres.2008.09.007 · Cited by 1,224
“Frames were presented on a Linux computer under SCHED_-FIFO scheduling which ensured microsecond-accurate timing ( Finney, 2001 ).”
Method
Metadata
- Authors
- Fletcher, P. C., Anderson, J. M., Shanks, D. R., Honey, R., Carpenter, T. A., Donovan, T., Papadakis, N., & Bullmore, E. T.
- Affiliations
- University of Cambridge (GB)
- University College London (GB)
- The University of Western Australia (AU)
- Corresponding author
- Fletcher, P. C.
- Venue
- Nature Neuroscience
- Published
- 2001-09-17
- Volume
- 4
- Issue
- 10
- Pages
- 1043-1048
- ISSN
- 1097-6256 (ISSN-L)
- 1546-1726
- OpenAlex
- W1506537224
- Cited by
- 238
- References
- 35
- Citations by year
- 2026: 1 · 2025: 3 · 2024: 2 · 2023: 25 · 2022: 7 · 2021: 8 · 2020: 9 · 2019: 7 · 2018: 17 · 2017: 9 · 2016: 13 · 2015: 9 · 2014: 9 · 2013: 17 · 2012: 14
- FWCI
- 3.67
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- Insight (University of Cumbria) (acceptedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Keywords
- surprise, dorsolateral prefrontal cortex, inferential learning, unpredictability, associative learning theory, prediction error
- MeSH terms
- Adult, Association Learning, Brain Mapping, Female, Frontal Lobe, Humans, Magnetic Resonance Imaging, Male
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.