Predictions penetrate perception: Converging insights from brain, behaviour and disorder
Open accessThe DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Abstract
It is argued that during ongoing visual perception, the brain is generating top-down predictions to facilitate, guide and constrain the processing of incoming sensory input. Here we demonstrate that these predictions are drawn from a diverse range of cognitive processes, in order to generate the richest and most informative prediction signals. This is consistent with a central role for cognitive penetrability in visual perception. We review behavioural and mechanistic evidence that indicate a wide spectrum of domains—including object recognition, contextual associations, cognitive biases and affective state—that can directly influence visual perception. We combine these insights from the healthy brain with novel observations from neuropsychiatric disorders involving visual hallucinations, which highlight the consequences of imbalance between top-down signals and incoming sensory information. Together, these lines of evidence converge to indicate that predictive penetration, be it cognitive, social or emotional, should be considered a fundamental framework that supports visual perception.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The human brain is intrinsically organized into dynamic, anticorrelated functional networks
Fox, M. D., Snyder, A. Z., Vincent, J. L., Corbetta, M., Van Essen, D. C., & Raichle, M. E. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0504136102 · Cited by 8,553
The free-energy principle: a unified brain theory?
Friston, K. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2787 · Cited by 8,120 · cited 1×
“Along these lines, a predictive coding framework for visual perception is well established, fitting with a broader general principle of the brain as a predictive machine (Clark, 2013; Dayan, Hinton, Neal, & Zemel, 1995; Friston, 2010).”
BackgroundWhatever next? Predictive brains, situated agents, and the future of cognitive science
Clark, A. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12000477 · Cited by 5,924
Rao, R. P. N., & Ballard, D. H. (1999) · Nature Neuroscience · doi:10.1038/4580 · Cited by 5,483 · cited 1×
“Under this scheme, top-down predictions are generated at higher levels and compared with lower-level representations of sensory input, with any resultant mismatch coded as a prediction error (Clark, 2013; Friston, 2005b; Friston et al., 2014; Rao & Ballard, 1999).”
BackgroundDynamic predictions: Oscillations and synchrony in top–down processing
Engel, A. K., Fries, P., & Singer, W. (2001) · Nature Reviews Neuroscience · doi:10.1038/35094565 · Cited by 3,454 · cited 1×
“A fundamental assumption is that our cognitive and perceptual processes do not operate in a vacuum, but are subject to the constraints of a changeable environment that requires flexible and context-dependent behaviour (Engel et al., 2001).”
BackgroundFunctional-anatomic fractionation of the brain’s default network
Andrews-Hanna, J. R., Reidler, J. S., Sepulcre, J., Poulin, R., & Buckner, R. L. (2010) · Neuron · doi:10.1016/j.neuron.2010.02.005 · Cited by 2,767
KRINGELBACH, M. (2004) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2004.03.006 · Cited by 1,977 · cited 1×
“Responses to contextual cues dictate much of human behaviour, from influencing our social interaction to determining levels of reward seeking or avoidant behaviours (Bartz, Zaki, Bolger, & Ochsner, 2011; Koob & Volkow, 2010; Pennartz, Ito, Verschure, Battaglia, & Robbins, 2011).”
BackgroundPessoa, L., & Adolphs, R. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2920 · Cited by 1,794 · cited 2×
“…for orbitofrontal cortex computations about the affective value of stimuli, given the amygdala’s connectivity with the orbitofrontal cortex, its position as a target of visual pathways and its role in encoding emotionally salient information (Pessoa & Adolphs, 2010; Roy, Shohamy, & Wager, 2012).”
BackgroundBar, M. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1476 · Cited by 1,613
Self-citationSocial effects of oxytocin in humans: context and person matter
Bartz, J. A., Zaki, J., Bolger, N., & Ochsner, K. N. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.05.002 · Cited by 1,581
Top-down facilitation of visual recognition
Bar, M., Kassam, K. S., Ghuman, A. S., Boshyan, J., Schmid, A. M., Dale, A. M., Hämäläinen, M. S., Marinkovic, K., Schacter, D. L., Rosen, B. R., et al. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0507062103 · Cited by 1,489 · cited 1×
“Consciousness and Cognition (2016), http://dx.doi.org/10.1016/j.concog.2016.05.003 2013; Bar & Aminoff, 2003).”
InfluentialSelf-citationDefault Mode Network Activity and Connectivity in Psychopathology
Whitfield-Gabrieli, S., & Ford, J. M. (2012) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032511-143049 · Cited by 1,465 · cited 1×
“More broadly this is in keeping with observations that an over-active/poorly suppressed default network may underscore many positive and ruminative symptoms in neuropsychiatric disorders (Anticevic et al., 2012; Whitfield-Gabrieli & Ford, 2012).”
BackgroundThe functions of the orbitofrontal cortex
Rolls, E. T. (2004) · Brain and Cognition · doi:10.1016/s0278-2626(03)00277-x · Cited by 1,327
Top-down influences on visual processing
Gilbert, C. D., & Li, W. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3476 · Cited by 1,224
Cognition does not affect perception: Evaluating the evidence for “top-down” effects
Firestone, C., & Scholl, B. J. (2016) · Behavioral and Brain Sciences · doi:10.1017/s0140525x15000965 · Cited by 1,200
Creative Cognition and Brain Network Dynamics
Beaty, R. E., Benedek, M., Silvia, P. J., & Schacter, D. L. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.10.004 · Cited by 1,105
The role of context in object recognition
Oliva, A., & Torralba, A. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.09.009 · Cited by 1,063
Expectation (and attention) in visual cognition
Summerfield, C., & Egner, T. (2009) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2009.06.003 · Cited by 950 · cited 2×
“…processing, the reduced responses in early visual areas shown in the context of cued or expected visual stimuli (Marois, Leung, & Gore, 2000; Summerfield & Egner, 2009; Yoshiura et al., 1999) result in sharper representations of the expected stimulus in those early regions (Kok, Jehee, & de…”
BackgroundA cortical mechanism for triggering top-down facilitation in visual object recognition
Bar, M. (2003) · Journal of Cognitive Neuroscience · doi:10.1162/089892903321662976 · Cited by 900
Self-citationVentromedial prefrontal–subcortical systems and the generation of affective meaning
Roy, M., Shohamy, D., & Wager, T. D. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2012.01.005 · Cited by 856
The Computational Anatomy of Psychosis
Adams, R. A., Stephan, K. E., Brown, H. R., Frith, C. D., & Friston, K. J. (2013) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2013.00047 · Cited by 850 · cited 1×
“…an object is to the perceiver are suggested to influence perception of the size, distance, steepness, salience, and brightness of visual stimuli (Alter & Balcetis, 2011; Balcetis & Dunning, 2006; Banerjee, Chatterjee, & Sinha, 2012; Bhalla & Proffitt, 1999; Den Daas, Häfner, & de Wit, 2013;…”
BackgroundSelf-citationThe orbitofrontal cortex: Neuronal activity in the behaving monkey
Thorpe, S. J., Rolls, E. T., & Maddison, S. (1983) · Experimental Brain Research · doi:10.1007/bf00235545 · Cited by 836
Expectation in perceptual decision making: neural and computational mechanisms
Summerfield, C., & de Lange, F. P. (2014) · Nature Reviews Neuroscience · doi:10.1038/nrn3838 · Cited by 832
Less Is More: Expectation Sharpens Representations in the Primary Visual Cortex
Kok, P., Jehee, J. F. M., & de Lange, F. P. (2012) · Neuron · doi:10.1016/j.neuron.2012.04.034 · Cited by 798
Circuits for local and global signal integration in primary visual cortex
Angelucci, A., Levitt, J. B., Walton, E. J. S., Hupé, J.-M., Bullier, J., & Lund, J. S. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-19-08633.2002 · Cited by 789
Active Inference, homeostatic regulation and adaptive behavioural control
Pezzulo, G., Rigoli, F., & Friston, K. (2015) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2015.09.001 · Cited by 650
See it with feeling: affective predictions during object perception
Barrett, L. F., & Bar, M. (2009) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2008.0312 · Cited by 632 · cited 1×
“In this way, a person’s affective state is presumed to be a source of top-down penetration of visual perception (Barrett & Bar, 2009).”
BackgroundSelf-citationChapter 4 Affect as a Psychological Primitive
Barrett, L. F., & Bliss‐Moreau, E. (2009) · Advances in Experimental Social Psychology · doi:10.1016/s0065-2601(08)00404-8 · Cited by 621
Gustatory, olfactory, and visual convergence within the primate orbitofrontal cortex
Rolls, E., & Baylis, L. (1994) · The Journal of Neuroscience · doi:10.1523/jneurosci.14-09-05437.1994 · Cited by 587
Automatic attention to emotional stimuli: Neural correlates
Carretié, L., Hinojosa, J. A., Martín‐Loeches, M., Mercado, F., & Tapia, M. (2004) · Human Brain Mapping · doi:10.1002/hbm.20037 · Cited by 585
A new perspective on the role of the orbitofrontal cortex in adaptive behaviour
Schoenbaum, G., Roesch, M. R., Stalnaker, T. A., & Takahashi, Y. K. (2009) · Nature reviews. Neuroscience · doi:10.1038/nrn2753 · Cited by 585
Computational psychiatry: the brain as a phantastic organ
Friston, K. J., Stephan, K. E., Montague, R., & Dolan, R. J. (2014) · The Lancet Psychiatry · doi:10.1016/s2215-0366(14)70275-5 · Cited by 531 · cited 3×
“Predictive coding frameworks allocate precision weighting measurements that signal how much confidence should be assigned to prediction errors, in effect this allows information from the most relevant channels to be weighed higher (Friston et al., 2014).”
BackgroundShape perception reduces activity in human primary visual cortex
Murray, S. O., Kersten, D., Olshausen, B. A., Schrater, P., & Woods, D. L. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.192579399 · Cited by 496
Predictive codes for forthcoming perception in the frontal cortex.
Summerfield, C., Egner, T., Greene, M., Koechlin, E., Mangels, J., & Hirsch, J. (2006) · Science · doi:10.1126/science.1132028 · Cited by 496
Attention Modulates Contextual Influences in the Primary Visual Cortex of Alert Monkeys
Ito, M., & Gilbert, C. D. (1999) · Neuron · doi:10.1016/s0896-6273(00)80713-8 · Cited by 456 · cited 1×
“These human findings are supported and extended by cell recordings in monkeys that show effects of attention (Ito & Gilbert, 1999) and task context (Li, Piëch, & Gilbert, 2004) are evident in V1 from the very onset of neural response.”
BackgroundThe timing of information transfer in the visual system
Nowak, L. G., & Bullier, J. (1997) · Cerebral cortex · doi:10.1007/978-1-4757-9625-4_5 · Cited by 444 · cited 1×
“…transmits fine detail in the luminance channel, low spatial frequency information in the colour channel, has slower conduction velocities and can only process lower temporal frequencies (Maunsell, Nealey, & DePriest, 1990; Nowak & Bullier, 1997; Tootell, Switkes, Silverman, & Hamilton, 1988).”
BackgroundRudebeck, P. H., & Murray, E. A. (2014) · Neuron · doi:10.1016/j.neuron.2014.10.049 · Cited by 405 · cited 2×
“…cortex is to signal the predicted value of choice or action outcomes, by encoding both the sensory features of outcomes and their biological value relative to the current state of the organism (Passingham & Wise, 2012; Rudebeck & Murray, 2014; Schoenbaum, Roesch, Stalnaker, & Takahashi, 2009).”
BackgroundWaters, F., Collerton, D., ffytche, D. H., Jardri, R., Pins, D., Dudley, R., Blom, J. D., Mosimann, U. P., Eperjesi, F., Ford, S., et al. (2014) · Schizophrenia Bulletin · doi:10.1093/schbul/sbu036 · Cited by 325 · cited 1×
“…has been linked to mood and physiological states (e.g., stress, depression and fatigue), with mood also playing an important role in determining the content of hallucinations (e.g., when the image of a deceased spouse is perceived during a period of bereavement) (Waters et al., 2014).”
BackgroundTeufel, C., Subramaniam, N., Dobler, V., Perez, J., Finnemann, J., Mehta, P. R., Goodyer, I. M., & Fletcher, P. C. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1503916112 · Cited by 308
The hippocampal-striatal axis in learning, prediction and goal-directed behavior
Pennartz, C. M. A., Ito, R., Verschure, P. F. M. J., Battaglia, F. P., & Robbins, T. W. (2011) · Trends in Neurosciences · doi:10.1016/j.tins.2011.08.001 · Cited by 287
Glutamatergic model psychoses: prediction error, learning, and inference
Corlett, P. R., Honey, G. D., Krystal, J. H., & Fletcher, P. C. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2010.163 · Cited by 229
Top-down effects on early visual processing in humans: A predictive coding framework
Rauss, K., Schwartz, S., & Pourtois, G. (2011) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2010.12.011 · Cited by 219
Hallucinations and perceptual inference
Friston, K. J. (2005) · Behavioral and Brain Sciences · doi:10.1017/s0140525x05290131 · Cited by 196
Evidence of Motivational Influences in Early Visual Perception: Hunger Modulates Conscious Access
Radel, R., & Clément-Guillotin, C. (2012) · Psychological Science · doi:10.1177/0956797611427920 · Cited by 144
Shine, J. M., Muller, A. J., O’Callaghan, C., Hornberger, M., Halliday, G. M., & Lewis, S. J. (2015) · npj Parkinson's Disease · doi:10.1038/npjparkd.2015.3 · Cited by 106
Self-citationShine, J. M., Keogh, R., O'Callaghan, C., Muller, A. J., Lewis, S. J. G., & Pearson, J. (2015) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2014.2047 · Cited by 97
Self-citationElectrical Cortical Stimulation of the Human Prefrontal Cortex Evokes Complex Visual Hallucinations
Blanke, O., Landis, T., & Seeck, M. (2000) · Epilepsy & Behavior · doi:10.1006/ebeh.2000.0109 · Cited by 82
Gantman, A. P., & Van Bavel, J. J. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.08.004 · Cited by 74
Charting the landscape of priority problems in psychiatry, part 2: pathogenesis and aetiology
Stephan, K. E., Binder, E. B., Breakspear, M., Dayan, P., Johnstone, E. C., Meyer-Lindenberg, A., Schnyder, U., Wang, X.-J., Bach, D. R., Fletcher, P. C., et al. (2016) · The Lancet Psychiatry · doi:10.1016/s2215-0366(15)00360-0 · Cited by 64
Cited by
Emotion words, emotion concepts, and emotional development in children: A constructionist hypothesis
Hoemann, K., Xu, F., & Barrett, L. F. (2019) · Developmental Psychology · doi:10.1037/dev0000686 · Cited by 354
The power of predictions: An emerging paradigm for psychological research
Hutchinson, J. B., & Barrett, L. F. (2019) · Current Directions in Psychological Science · doi:10.1177/0963721419831992 · Cited by 216
Cerebellum, Predictions and Errors
Popa, L. S., & Ebner, T. J. (2019) · Frontiers in Cellular Neuroscience · doi:10.3389/fncel.2018.00524 · Cited by 191
Deane, G. (2021) · Neuroscience of Consciousness · doi:10.1093/nc/niab024 · Cited by 38
“‘Predictive penetration’—social, cognitive and emotional— have all been demonstrated (O’Callaghan et al. 2016).”
BackgroundZarkali, A., McColgan, P., Leyland, L. A., Lees, A. J., & Weil, R. S. (2022) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp-2021-326630 · Cited by 32
Metadata
- Authors
- O’Callaghan, C., Kveraga, K., Shine, J. M., Adams, R. B., & Bar, M.
- Venue
- Consciousness and Cognition
- Publisher
- Elsevier BV
- Published
- 2017-01
- Volume
- 47
- Pages
- 63-74
- ISSN
- 1053-8100 (ISSN-L)
- OpenAlex
- W2395730384
- Cited by
- 164
- References
- 49
- FWCI
- 8.03
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.