Learning about Expectation Violation from Prediction Error Paradigms – A Meta-Analysis on Brain Processes Following a Prediction Error
Open accessThe DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Abstract
Modifying patients' expectations by exposing them to expectation violation situations (thus maximizing the difference between the expected and the actual situational outcome) is proposed to be a crucial mechanism for therapeutic success for a variety of different mental disorders. However, clinical observations suggest that patients often maintain their expectations regardless of experiences contradicting their expectations. It remains unclear which information processing mechanisms lead to modification or persistence of patients' expectations. Insight in the processing could be provided by Neuroimaging studies investigating prediction error (PE, i.e., neuronal reactions to non-expected stimuli). Two methods are often used to investigate the PE: (1) paradigms, in which participants passively observe PEs ("passive" paradigms) and (2) paradigms, which encourage a behavioral adaptation following a PE ("active" paradigms). These paradigms are similar to the methods used to induce expectation violations in clinical settings: (1) the confrontation with an expectation violation situation and (2) an enhanced confrontation in which the patient actively challenges his expectation. We used this similarity to gain insight in the different neuronal processing of the two PE paradigms. We performed a meta-analysis contrasting neuronal activity of PE paradigms encouraging a behavioral adaptation following a PE and paradigms enforcing passiveness following a PE. We found more neuronal activity in the striatum, the insula and the fusiform gyrus in studies encouraging behavioral adaptation following a PE. Due to the involvement of reward assessment and avoidance learning associated with the striatum and the insula we propose that the deliberate execution of action alternatives following a PE is associated with the integration of new information into previously existing expectations, therefore leading to an expectation change. While further research is needed to directly assess expectations of participants, this study provides new insights into the information processing mechanisms following an expectation violation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Maximizing exposure therapy: An inhibitory learning approach
Craske, M. G., Treanor, M., Conway, C. C., Zbozinek, T., & Vervliet, B. (2014) · Behaviour Research and Therapy · doi:10.1016/j.brat.2014.04.006 · Cited by 2,339 · cited 2×
“In alignment with the approach by Craske et al. (2014) to maximize inhibitory learning by actively testing the expectation, we hypothesize a different cognitive processing of “active” paradigms, which encourage a behavioral adaptation and Frontiers in Psychology | www.frontiersin.org 3 July 2017 |…”
MethodDissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088
Learning the value of information in an uncertain world
Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S. (2007) · Nature Neuroscience · doi:10.1038/nn1954 · Cited by 2,053
Eickhoff, S. B., Laird, A. R., Grefkes, C., Wang, L. E., Zilles, K., & Fox, P. T. (2009) · Human Brain Mapping · doi:10.1002/hbm.20718 · Cited by 1,924 · cited 3×
“We performed an activation likelihood estimation (ALE) analysis using the Software GingerAle (Eickhoff et al., 2009, 2012).”
BackgroundMethodLearning and Memory Functions of the Basal Ganglia
Packard, M. G., & Knowlton, B. J. (2002) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.25.112701.142937 · Cited by 1,717 · cited 1×
“The caudate body has been shown to be involved in cognitive tasks such as categorization and reward information assessment in monkeys (Yanike and Ferrera, 2014) as well as in humans (Packard and Knowlton, 2002).”
BackgroundThe visual word form area: expertise for reading in the fusiform gyrus
McCandliss, B. D., Cohen, L., & Dehaene, S. (2003) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(03)00134-7 · Cited by 1,489
Bias between MNI and Talairach coordinates analyzed using the ICBM‐152 brain template
Lancaster, J. L., Tordesillas‐Gutiérrez, D., Martinez, M., Salinas, F., Evans, A., Zilles, K., Mazziotta, J. C., & Fox, P. T. (2007) · Human Brain Mapping · doi:10.1002/hbm.20345 · Cited by 1,464
Gläscher, J., Daw, N., Dayan, P., & O'Doherty, J. P. (2010) · Neuron · doi:10.1016/j.neuron.2010.04.016 · Cited by 1,166
Temporal Prediction Errors in a Passive Learning Task Activate Human Striatum
McClure, S. M., Berns, G. S., & Montague, P. R. (2003) · Neuron · doi:10.1016/s0896-6273(03)00154-5 · Cited by 917
Eickhoff, S. B., Nichols, T. E., Laird, A. R., Hoffstaedter, F., Amunts, K., Fox, P. T., Bzdok, D., & Eickhoff, C. R. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.04.072 · Cited by 683 · cited 1×
“Eickhoff et al. (2016) recommend a minimal sample size of 17 studies for the ALE meta-analysis.”
BackgroundSubstantia nigra/ventral tegmental reward prediction error disruption in psychosis
Murray, G. K., Corlett, P. R., Clark, L., Pessiglione, M., Blackwell, A. D., Honey, G., Jones, P. B., Bullmore, E. T., Robbins, T. W., & Fletcher, P. C. (2008) · Molecular Psychiatry · doi:10.1038/sj.mp.4002058 · Cited by 532
Hampton, A. N., Bossaerts, P., & O’Doherty, J. P. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.1010-06.2006 · Cited by 498
Expected value and prediction error abnormalities in depression and schizophrenia
Gradin, V. B., Kumar, P., Waiter, G., Ahearn, T., Stickle, C., Milders, M., Reid, I., Hall, J., & Steele, J. D. (2011) · Brain · doi:10.1093/brain/awr059 · Cited by 485
Eickhoff, S. B., Bzdok, D., Laird, A. R., Roski, C., Caspers, S., Zilles, K., & Fox, P. T. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.05.021 · Cited by 484 · cited 11×
“In alignment with the approach by Craske et al. (2014) to maximize inhibitory learning by actively testing the expectation, we hypothesize a different cognitive processing of “active” paradigms, which encourage a behavioral adaptation and Frontiers in Psychology | www.frontiersin.org 3 July 2017 | Volume 8 | Article 1…”
MethodInfluentialAre patient expectations still relevant for psychotherapy process and outcome
Greenberg, R. P., Constantino, M. J., & Bruce, N. (2006) · Clinical Psychology Review · doi:10.1016/j.cpr.2005.03.002 · Cited by 477 · cited 1×
“Patients’ expectations have a great influence on their treatment and outcomes in psychotherapy (Greenberg et al., 2006), medical conditions as well as in patients undergoing surgery (Auer et al., 2016; Rief and Glombiewski, 2016).”
BackgroundOverlapping activity in anterior insula during interoception and emotional experience
Zaki, J., Davis, J. I., & Ochsner, K. N. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.05.012 · Cited by 462 · cited 1×
“The insula is associated with the perception and processing of interoception of emotional states (Zaki et al., 2012; Simmons et al., 2013).”
BackgroundOpponent appetitive-aversive neural processes underlie predictive learning of pain relief
Seymour, B., O'Doherty, J. P., Koltzenburg, M., Wiech, K., Frackowiak, R., Friston, K., & Dolan, R. (2005) · Nature Neuroscience · doi:10.1038/nn1527 · Cited by 439
Haruno, M., & Kawato, M. (2006) · Journal of Neurophysiology · doi:10.1152/jn.00382.2005 · Cited by 433
From Fear to Safety and Back: Reversal of Fear in the Human Brain
Schiller, D., Levy, I., Niv, Y., LeDoux, J. E., & Phelps, E. A. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.2265-08.2008 · Cited by 429
Schönberg, T., Daw, N. D., Joel, D., & O'Doherty, J. P. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2496-07.2007 · Cited by 390
Gläscher, J., Hampton, A. N., & O'Doherty, J. P. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhn098 · Cited by 387
Prediction error as a linear function of reward probability is coded in human nucleus accumbens
Abler, B., Walter, H., Erk, S., Kammerer, H., & Spitzer, M. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.01.001 · Cited by 376
Neural prediction errors reveal a risk-sensitive reinforcement-learning process in the human brain
Niv, Y., Edlund, J. A., Dayan, P., & O'Doherty, J. P. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.5498-10.2012 · Cited by 356
The globus pallidus sends reward-related signals to the lateral habenula
Hong, S., & Hikosaka, O. (2008) · Neuron · doi:10.1016/j.neuron.2008.09.035 · Cited by 346
Maltby, N., Tolin, D. F., Worhunsky, P., O'Keefe, T. M., & Kiehl, K. A. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2004.08.041 · Cited by 331 · cited 1×
“Several disorders are linked to fronto-striatal circuit dysfunctions, such as Huntington’s disease (Beste et al., 2012), Parkinson’s Disease (Owen, 2004) and obsessive-compulsive disorder (Maltby et al., 2005; Marsh et al., 2014).”
BackgroundA computational framework for the study of confidence in humans and animals
Kepecs, A., & Mainen, Z. F. (2012) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2012.0037 · Cited by 305
Striatal Prediction Error Modulates Cortical Coupling
den Ouden, H. E. M., Daunizeau, J., Roiser, J., Friston, K. J., & Stephan, K. E. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.4458-09.2010 · Cited by 304
Dopamine enhances model-based over model-free choice behavior
Wunderlich, K., Smittenaar, P., & Dolan, R. J. (2012) · Neuron · doi:10.1016/j.neuron.2012.03.042 · Cited by 294 · cited 1×
“However, there is evidence of different brain activity involved in various types of learning and in particular in model-based (i.e., goal-directed actions) vs. model-free (i.e., habit-based actions) approaches (Maia, 2009; Wunderlich et al., 2012).”
BackgroundHam, T., Leff, A., de Boissezon, X., Joffe, A., & Sharp, D. J. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.4692-12.2013 · Cited by 271
Uncertainty during anticipation modulates neural responses to aversion in human insula and amygdala
Sarinopoulos, I., Grupe, D. W., Mackiewicz, K. L., Herrington, J. D., Lor, M., Steege, E. E., & Nitschke, J. B. (2010) · Cerebral Cortex · doi:10.1093/cercor/bhp155 · Cited by 241 · cited 1×
“The processing of uncertainty has also been shown to be associated with insula activity (Simmons et al., 2008; Sarinopoulos et al., 2010), which could be interpreted as an aversive and thus emotional state.”
BackgroundLadwig, I., Rief, W., & Nestoriuc, Y. (2014) · Verhaltenstherapie · doi:10.1159/000367928 · Cited by 227 · cited 1×
“In addition, negative expectations about psychological interventions may lead to negative effects of psychotherapy (Ladwig et al., 2014).”
BackgroundSelf-citationHuman neural learning depends on reward prediction errors in the blocking paradigm.
Tobler, P. N., O’Doherty, J. P., Dolan, R. J., & Schultz, W. (2006) · Journal of Neurophysiology · doi:10.1152/jn.00762.2005 · Cited by 209
The basal ganglia in human learning
Seger, C. A. (2006) · The Neuroscientist · doi:10.1177/1073858405285632 · Cited by 182 · cited 1×
“The medial globus pallidus is part of the four corticostriatal loops, which are responsible for executive function, visual processing, motor function and motivational evaluation (Seger, 2006).”
BackgroundEncoding of sensory prediction errors in the human cerebellum
Schlerf, J., Ivry, R. B., & Diedrichsen, J. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.4504-11.2012 · Cited by 168
Intolerance of uncertainty correlates with insula activation during affective ambiguity
Simmons, A., Matthews, S. C., Paulus, M. P., & Stein, M. B. (2008) · Neuroscience Letters · doi:10.1016/j.neulet.2007.10.030 · Cited by 150 · cited 1×
“The processing of uncertainty has also been shown to be associated with insula activity (Simmons et al., 2008; Sarinopoulos et al., 2010), which could be interpreted as an aversive and thus emotional state.”
BackgroundDisambiguating ventral striatum fMRI-related bold signal during reward prediction in schizophrenia
Morris, R. W., Vercammen, A., Lenroot, R., Moore, L., Langton, J. M., Short, B., Kulkarni, J., Curtis, J., O'Donnell, M., Weickert, C. S., et al. (2012) · Molecular Psychiatry · doi:10.1038/mp.2011.75 · Cited by 149
Ventral–striatal/nucleus–accumbens sensitivity to prediction errors during classification learning
Rodriguez, P. F., Aron, A. R., & Poldrack, R. A. (2006) · Human Brain Mapping · doi:10.1002/hbm.20186 · Cited by 122
Cerebral Correlates of Salient Prediction Error for Different Rewards and Punishments
Metereau, E., & Dreher, J.-C. (2013) · Cerebral Cortex · doi:10.1093/cercor/bhs037 · Cited by 114
Marsh, R., Horga, G., Parashar, N., Wang, Z., Peterson, B. S., & Simpson, H. B. (2014) · Biological Psychiatry · doi:10.1016/j.biopsych.2013.02.004 · Cited by 79
Watanabe, N., Sakagami, M., & Haruno, M. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.3400-12.2013 · Cited by 65
Combining fMRI and behavioral measures to examine the process of human learning
Karuza, E. A., Emberson, L. L., & Aslin, R. N. (2014) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2013.09.012 · Cited by 50 · cited 1×
“Learning research has mainly focused on reinforcement learning, whereby the expectations comprises predictions about reward and/or punishment (Karuza et al., 2014).”
Background
Cited by
fMRI reveals language-specific predictive coding during naturalistic sentence comprehension
Shain, C., Blank, I. A., van Schijndel, M., Schuler, W., & Fedorenko, E. (2020) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2019.107307 · Cited by 215
Meta-analysis of human prediction error for incentives, perception, cognition, and action
Corlett, P. R., Mollick, J. A., & Kober, H. (2022) · Neuropsychopharmacology · doi:10.1038/s41386-021-01264-3 · Cited by 135
Exposure Therapy and Its Mechanisms
Hamlett, G. E., Foa, E. B., & Brown, L. A. (2023) · Current Topics in Behavioral Neurosciences · doi:10.1007/7854_2023_428 · Cited by 16
Metadata
- Authors
- D’Astolfo, L., & Rief, W.
- Venue
- Frontiers in Psychology
- Publisher
- Frontiers Media SA
- Published
- 2017-07-28
- Volume
- 8
- Pages
- 1253-1253
- ISSN
- 1664-1078 (ISSN-L)
- OpenAlex
- W2735221042
- Cited by
- 43
- References
- 41
- FWCI
- 0.46
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.