Free-Energy and Illusions: The Cornsweet Effect
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
In this paper, we review the nature of illusions using the free-energy formulation of Bayesian perception. We reiterate the notion that illusory percepts are, in fact, Bayes-optimal and represent the most likely explanation for ambiguous sensory input. This point is illustrated using perhaps the simplest of visual illusions; namely, the Cornsweet effect. By using plausible prior beliefs about the spatial gradients of illuminance and reflectance in visual scenes, we show that the Cornsweet effect emerges as a natural consequence of Bayes-optimal perception. Furthermore, we were able to simulate the appearance of secondary illusory percepts (Mach bands) as a function of stimulus contrast. The contrast-dependent emergence of the Cornsweet effect and subsequent appearance of Mach bands were simulated using a simple but plausible generative model. Because our generative model was inverted using a neurobiologically plausible scheme, we could use the inversion as a simulation of neuronal processing and implicit inference. Finally, we were able to verify the qualitative and quantitative predictions of this Bayes-optimal simulation psychophysically, using stimuli presented briefly to normal subjects at different contrast levels, in the context of a fixed alternative forced choice paradigm.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rao, R. P. N., & Ballard, D. H. (1999) · Nature Neuroscience · doi:10.1038/4580 · Cited by 5,483 · cited 1×
“For example, Rao and Ballard (1999) used predictive coding to provide a compelling explanation for extraclassical receptive field effects in striate cortex.”
MethodThe Bayesian brain: The role of uncertainty in neural coding and computation
Knill, D. C., & Pouget, A. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.10.007 · Cited by 2,588 · cited 1×
“The Bayesian approach to visual perception has been exploited in previous work (Yuille et al., 1991; Knill and Pouget, 2004).”
The free-energy principle: a rough guide to the brain?
Friston, K. (2009) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2009.04.005 · Cited by 1,831
Self-citationA free energy principle for the brain
Friston, K., Kilner, J., & Harrison, L. (2006) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2006.10.001 · Cited by 1,369
Self-citationAttention, uncertainty, and free-energy
Feldman, H., & Friston, K. J. (2010) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2010.00215 · Cited by 1,365
Self-citationMotion illusions as optimal percepts
Weiss, Y., Simoncelli, E. P., & Adelson, E. H. (2002) · Nature Neuroscience · doi:10.1038/nn0602-858 · Cited by 1,076
On the computational architecture of the neocortex: II The role of cortico-cortical loops
Mumford, D. (1992) · Biological Cybernetics · doi:10.1007/bf00198477 · Cited by 1,074 · cited 3×
“It shows the putative cells of origin of forward driving connections that convey prediction error from a lower area to a higher area (red arrows) and non-linear backward connections (black arrows) that construct predictions (Mumford, 1992; Friston, 2008).”
Hierarchical Models in the Brain
Friston, K. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000211 · Cited by 952 · cited 3×
“It shows the putative cells of origin of forward driving connections that convey prediction error from a lower area to a higher area (red arrows) and non-linear backward connections (black arrows) that construct predictions (Mumford, 1992; Friston, 2008).”
BackgroundSelf-citationOn the computational architecture of the neocortex: I. The role of the thalamo-cortical loop
Mumford, D. (1991) · Biological Cybernetics · doi:10.1007/bf00202389 · Cited by 929
Summation and Division by Neurons in Primate Visual Cortex
Carandini, M., & Heeger, D. J. (1994) · Science · doi:10.1126/science.8191289 · Cited by 649 · cited 2×
“…the following sense: If we assume that the brain uses divisive normalization (Weber, 1846; Fechner, 1860; Craik, 1938; Geisler and Albrecht, 1992; Carandini and Heeger, 1994), the key change in sensory information, following an increase in contrast, is an increase in signal to noise; in other…”
Cited by
An aberrant precision account of autism
Lawson, R. P., Rees, G., & Friston, K. J. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00302 · Cited by 641
Self-citationThe free-energy self: a predictive coding account of self-recognition
Apps, M. A. J., & Tsakiris, M. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.01.029 · Cited by 514
Selective Activation of the Deep Layers of the Human Primary Visual Cortex by Top-Down Feedback
Kok, P., Bains, L. J., van Mourik, T., Norris, D. G., & de Lange, F. P. (2016) · Current Biology · doi:10.1016/j.cub.2015.12.038 · Cited by 397
Words and the World: Predictive Coding and the Language-Perception-Cognition Interface
Lupyan, G., & Clark, A. (2015) · Current Directions in Psychological Science · doi:10.1177/0963721415570732 · Cited by 380
The Border Between Seeing and Thinking
Block, N. (2023) · doi:10.1093/oso/9780197622223.001.0001 · Cited by 367
Minimal self-models and the free energy principle.
Limanowski, J., & Blankenburg, F. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00547 · Cited by 263
Generalised free energy and active inference
Parr, T., & Friston, K. J. (2019) · Biological Cybernetics · doi:10.1007/s00422-019-00805-w · Cited by 236
Self-citationNormal and abnormal coding of somatosensory stimuli causing pain
Prescott, S. A., Ma, Q., & De Koninck, Y. (2014) · Nature Neuroscience · doi:10.1038/nn.3629 · Cited by 210
Forms of prediction in the nervous system
Teufel, C., & Fletcher, P. C. (2020) · Nature Reviews Neuroscience · doi:10.1038/s41583-020-0275-5 · Cited by 155
Model averaging, optimal inference, and habit formation
FitzGerald, T. H. B., Dolan, R. J., & Friston, K. J. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00457 · Cited by 121
Self-citationTabor, A., Thacker, M. A., Moseley, G. L., & Körding, K. P. (2017) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1005142 · Cited by 111
The influence of subcortical shortcuts on disordered sensory and cognitive processing.
McFadyen, J., Dolan, R. J., & Garrido, M. I. (2020) · Nature Reviews Neuroscience · doi:10.1038/s41583-020-0287-1 · Cited by 91
Ueltzhöffer, K. (2018) · Biological Cybernetics · doi:10.1007/s00422-018-0785-7 · Cited by 98
“This theory is able to account formany aspects of action and perception as well as anatomical and physiological features of the brain, on the one hand (Brown and Friston 2012; Friston 2005; Friston et al. 2011; Friston and Kiebel 2009; Schwartenbeck et al. 2015; Adams et al. 2013), and encompasses many formal theories…”
Perceptual awareness and active inference
Parr, T., Corcoran, A. W., Friston, K. J., & Hohwy, J. (2019) · Neuroscience of Consciousness · doi:10.1093/nc/niz012 · Cited by 91
Self-citationPrecision and False Perceptual Inference
Parr, T., Benrimoh, D. A., Vincent, P., & Friston, K. J. (2018) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2018.00039 · Cited by 87
Self-citationA Bayesian Perspective on Sensory and Cognitive Integration in Pain Perception and Placebo Analgesia
Anchisi, D., & Zanon, M. (2015) · PLOS ONE · doi:10.1371/journal.pone.0117270 · Cited by 84
“The placebo effect would be a perceptive illusion and, like other illusions, results not from a malfunction of the system but is a byproduct of computational strategies pursuing optimal integration of information [26, 33, 76].”
Transfer of Predictive Signals Across Saccades
Vetter, P., Edwards, G., & Muckli, L. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00176 · Cited by 24
Metadata
- Authors
- Brown, H., & Friston, K. J.
- Venue
- Frontiers in Psychology
- Publisher
- Frontiers Media SA
- Published
- 2012
- Volume
- 3
- Pages
- 43-43
- ISSN
- 1664-1078 (ISSN-L)
- OpenAlex
- W1994892978
- Cited by
- 88
- References
- 13
- FWCI
- 3.84
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.