Predictive coding and thought
Open accessAbstract
Predictive processing has recently been advanced as a global cognitive architecture for the brain. I argue that its commitments concerning the nature and format of cognitive representation are inadequate to account for two basic characteristics of conceptual thought: first, its generality—the fact that we can think and flexibly reason about phenomena at any level of spatial and temporal scale and abstraction; second, its rich compositionality—the specific way in which concepts productively combine to yield our thoughts. I consider two strategies for avoiding these objections and I argue that both confront formidable challenges.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The FEP's universal scope and mathematical generality render it effectively unfalsifiable.
“Williams (2018); Williams and Colling (2018); Williams (2020) argued that the FEP’s universal scope and mathematical generality render it effectively unfalsifiable.”
From The myth of the Bayesian brain (2025) · cites this paper as Williams 2020
Section 5 says there is plausibly nothing that could falsify the bare claim that the brain is Bayesian and that a similar point may apply to the prediction-error-minimization framework. But Section 2 distinguishes that framework from the free-energy principle (FEP) and says the paper will have little to say about the FEP. The paper therefore supports a related falsifiability concern, not the specific claim that the FEP’s universal scope and mathematical generality render it unfalsifiable. (LLM, conf=0.87)
Experimental — accuracy not yet measuredThe free energy principle, which incorporates and extends the Bayesian brain hypothesis, has been especially subject to criticism for unfalsifiability because its mathematical formalism and conceptual elasticity enable it to accommodate virtually any empirical outcome.
“The FEP, which incorporates and extends the Bayesian brain hypothesis, has been especially subject to such criticism. As Williams (2020) and Colombo and Wright (2021) have persuasively argued, the FEP’s sweeping mathematical formalism and conceptual elasticity enable it to accommodate virtually any empirical outcome, rendering it difficult—if not impossible—to falsify (Fig. 2).”
From The myth of the Bayesian brain (2025) · cites this paper as Williams 2020
Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Artificial intelligence: a modern approach
Kumar, D. A., Balasubramanian, S., Byeon, D. H., & Manerkar, P. G. V. (1995) · Choice Reviews Online · doi:10.5860/choice.33-1577 · Cited by 22,182 · see citing works
(2016) · Cited by 11,679 · see citing works
Artificial intelligence: A modern approach
Nilsson, N. J. (1996) · Artificial Intelligence · doi:10.1016/0004-3702(96)00007-0 · Cited by 10,726 · see citing works
The free-energy principle: a unified brain theory?
Friston, K. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2787 · Cited by 8,120 · cited 4× · see citing works
“The first of these ideas relates predictive processing to the “free-energy principle,” according to which prediction error minimization is a special case of a more fundamental imperative in biological agents to self-organize (Friston 2010).”
BackgroundInfluentialWhatever next? Predictive brains, situated agents, and the future of cognitive science
Clark, A. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12000477 · Cited by 5,924 · see citing works
Rao, R. P. N., & Ballard, D. H. (1999) · Nature Neuroscience · doi:10.1038/4580 · Cited by 5,483 · cited 2× · see citing works
“The second idea connects predictive processing to “predictive coding,” probably the most influential name for the framework under discussion in the broader scientific literature (Bogacz 2017; Rao and Ballard 1998).”
BackgroundMethodFodor, J. A. (1975) · Medical Entomology and Zoology · Cited by 4,588 · see citing works
A theory of cortical responses.
Friston, K. (2005) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2005.1622 · Cited by 4,578 · see citing works
Jackendoff, R. S. (2002) · doi:10.1093/acprof:oso/9780198270126.001.0001 · Cited by 4,472 · see citing works
Connectionism and cognitive architecture: A critical analysis
Fodor, J. A., & Pylyshyn, Z. W. (1988) · Cognition · doi:10.1016/0010-0277(88)90031-5 · Cited by 4,022 · see citing works
Probabilistic Reasoning in Intelligent Systems
(1988) · Elsevier eBooks · doi:10.1016/c2009-0-27609-4 · Cited by 3,371 · see citing works
Main Trends in Recent Philosophy: Two Dogmas of Empiricism
Quine, W. V. O. (1951) · The Philosophical Review · doi:10.2307/2181906 · Cited by 3,042 · see citing works
Human-level concept learning through probabilistic program induction
Lake, B. M., Salakhutdinov, R., & Tenenbaum, J. B. (2015) · Science · doi:10.1126/science.aab3050 · Cited by 2,817 · see citing works
Quine, W. V. O. (1976) · Sententiae · doi:10.1007/978-94-010-1863-0_2 · Cited by 2,709 · see citing works
Building machines that learn and think like people
Lake, B. M., Ullman, T. D., Tenenbaum, J. B., & Gershman, S. J. (2017) · Behavioral and Brain Sciences · doi:10.1017/s0140525x16001837 · Cited by 2,550 · see citing works
Canonical Microcircuits for Predictive Coding
Bastos, A. M., Usrey, W. M., Adams, R. A., Mangun, G. R., Fries, P., & Friston, K. J. (2012) · Neuron · doi:10.1016/j.neuron.2012.10.038 · Cited by 2,421 · cited 2× · see citing works
“This would relate predictive processing to a long tradition in both psychology and philosophy (see Bermúdez 2005, Ch. 10) that attributes many of the idiosyncrasies of higher cognition in humans not to a qualitatively distinct neural architecture from other mammals, but to the public symbol systems…”
BackgroundComputer science as empirical inquiry
Newell, A., & Simon, H. A. (1976) · Communications of the ACM · doi:10.1145/360018.360022 · Cited by 2,351 · see citing works
Handbuch der physiologischen Optik
Cz., P. (1896) · Monatshefte für Mathematik · doi:10.1007/bf01708548 · Cited by 2,071 · see citing works
Evans, G., & McDowell, J. (1982) · Medical Entomology and Zoology · Cited by 2,047 · see citing works
Probabilistic machine learning and artificial intelligence
Ghahramani, Z. (2015) · Nature · doi:10.1038/nature14541 · Cited by 1,995 · see citing works
Handbuch der physiologischen Optik
Helmholtz, H. L. F. (2011) · DFG Viewer (DFG Viewer) · Cited by 1,947 · see citing works
Hohwy, J. (2013) · doi:10.1093/acprof:oso/9780199682737.001.0001 · Cited by 1,914 · see citing works
How to grow a mind: Statistics, structure, and abstraction
Tenenbaum, J. B., Kemp, C., Griffiths, T. L., & Goodman, N. D. (2011) · Science · doi:10.1126/science.1192788 · Cited by 1,815 · see citing works
Hierarchical Bayesian inference in the visual cortex
Lee, T. S., & Mumford, D. (2003) · Journal of the Optical Society of America A · doi:10.1364/josaa.20.001434 · Cited by 1,473 · cited 1× · see citing works
“Although this point is not often made clear in the literature, the structure of HPGMs in predictive processing can be understood in terms of probabilistic graphical models (Bastos et al. 2012; Denève and Jardri 2016; Friston et al. 2017b; Kiefer and Hohwy 2017; Lee and Mumford 2003; Penny 2012a, b).”
BackgroundPerceiving is believing: a Bayesian approach to explaining the positive symptoms of schizophrenia
Fletcher, P. C., & Frith, C. D. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2536 · Cited by 1,462 · see citing works
Attention, uncertainty, and free-energy
Feldman, H., & Friston, K. J. (2010) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2010.00215 · Cited by 1,365 · see citing works
Surfing Uncertainty: Prediction, Action, and the Embodied Mind
Clark, A. (2016) · doi:10.1093/acprof:oso/9780190217013.001.0001 · Cited by 1,358 · see citing works
Dayan, P., Hinton, G. E., Neal, R. M., & Zemel, R. S. (1995) · Neural Computation · doi:10.1162/neco.1995.7.5.889 · Cited by 1,207 · see citing works
Cognition does not affect perception: Evaluating the evidence for “top-down” effects
Firestone, C., & Scholl, B. J. (2016) · Behavioral and Brain Sciences · doi:10.1017/s0140525x15000965 · Cited by 1,200 · see citing works
Active inference: a process theory
Friston, K., FitzGerald, T., Rigoli, F., Schwartenbeck, P., & Pezzulo, G. (2017) · Neural Computation · doi:10.1162/neco_a_00912 · Cited by 1,156 · see citing works
Predictive coding: an account of the mirror neuron system
Kilner, J. M., Friston, K. J., & Frith, C. D. (2007) · Cognitive Processing · doi:10.1007/s10339-007-0170-2 · Cited by 1,134 · see citing works
Hawkins, J., & Blakeslee, S. (2004) · Cited by 1,012 · see citing works
Learning and inference in the brain
Friston, K. (2003) · Neural Networks · doi:10.1016/j.neunet.2003.06.005 · Cited by 724 · see citing works
Causal Models: How People Think about the World and Its Alternatives
Sloman, S. (2005) · doi:10.1093/acprof:oso/9780195183115.001.0001 · Cited by 677 · see citing works
Reconstructing constructivism: Causal models, Bayesian learning mechanisms, and the theory theory.
Alison Gopnik, C., & Wellman, H. M. (2012) · Psychological Bulletin · doi:10.1037/a0028044 · Cited by 660 · see citing works
Hohwy, J. (2016) · Noûs · doi:10.1111/nous.12062 · Cited by 578 · see citing works
Probabilistic models of cognition: exploring representations and inductive biases
Griffiths, T. L., Chater, N., Kemp, C., Perfors, A., & Tenenbaum, J. B. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.05.004 · Cited by 568 · see citing works
Jones, M., & Love, B. C. (2011) · Behavioral and Brain Sciences · doi:10.1017/s0140525x10003134 · Cited by 533 · see citing works
Uncertainty in perception and the Hierarchical Gaussian Filter
Mathys, C. D., Lomakina, E. I., Daunizeau, J., Iglesias, S., Brodersen, K. H., Friston, K. J., & Stephan, K. E. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00825 · Cited by 465 · see citing works
Beyond Phrenology: What Can Neuroimaging Tell Us About Distributed Circuitry?
Friston, K. (2002) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.25.112701.142846 · Cited by 465 · see citing works
Bayesian just-so stories in psychology and neuroscience.
Bowers, J. S., & Davis, C. J. (2012) · Psychological Bulletin · doi:10.1037/a0026450 · Cited by 436 · see citing works
The graphical brain: Belief propagation and active inference
Friston, K. J., Parr, T., & de Vries, B. (2017) · Network Neuroscience · doi:10.1162/netn_a_00018 · Cited by 415 · see citing works
Towards a mathematical theory of cortical micro-circuits
George, D., & Hawkins, J. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000532 · Cited by 404 · see citing works
Attention and conscious perception in the hypothesis testing brain
Hohwy, J. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00096 · Cited by 396 · see citing works
The Oxford handbook of the philosophy of perception
(2016) · Choice Reviews Online · doi:10.5860/choice.194275 · Cited by 391 · see citing works
Bayesian models of object perception
Kersten, D., & Yuille, A. (2003) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(03)00042-4 · Cited by 301 · see citing works
Waking and dreaming consciousness: neurobiological and functional considerations.
Hobson, J. A., & Friston, K. J. (2012) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2012.05.003 · Cited by 287 · see citing works
A tutorial on the free-energy framework for modelling perception and learning
Bogacz, R. (2017) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2015.11.003 · Cited by 283 · see citing works
The Mind's Arrows: Bayes Nets and Graphical Causal Models in Psychology
Glymour, C. (2001) · Cited by 279 · see citing works
Illusions, perception and Bayes
Geisler, W. S., & Kersten, D. (2002) · Nature Neuroscience · doi:10.1038/nn0602-508 · Cited by 249 · see citing works
Handbuch der physiologischen Optik
von Helmholtz, H. (n.d.) · Cited by 246 · see citing works
Churchland, P. M. (2012) · The MIT Press eBooks · doi:10.7551/mitpress/9116.001.0001 · Cited by 245 · see citing works
Predictive, interactive multiple memory systems
Henson, R. N., & Gagnepain, P. (2010) · Hippocampus · doi:10.1002/hipo.20857 · Cited by 226 · see citing works
Seth, A. K. (2015) · Figshare · doi:10.15502/9783958570108 · Cited by 210 · see citing works
Philosophy of Psychology: A Contemporary Introduction
Bermúdez, J. L. (2005) · Cited by 171 · see citing works
Minds Without Meanings: An Essay on the Content of Concepts
Fodor, J. A., & Pylyshyn, Z. W. (2014) · Cited by 153 · see citing works
Bayesian learning theory applied to human cognition
Jacobs, R. A., & Kruschke, J. K. (2010) · Wiley Interdisciplinary Reviews Cognitive Science · doi:10.1002/wcs.80 · Cited by 147 · see citing works
Predictive Processing and the Representation Wars
Williams, D. (2017) · Minds and Machines · doi:10.1007/s11023-017-9441-6 · Cited by 146 · see citing works
Self-citationBayesian Perceptual Psychology
Rescorla, M. (2013) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199600472.013.010 · Cited by 136 · see citing works
Clark, A. (2012) · Mind · doi:10.1093/mind/fzs106 · Cited by 133 · see citing works
The Cambridge Handbook of Cognitive Science
(2012) · Cambridge University Press eBooks · doi:10.1017/cbo9781139033916 · Cited by 131 · see citing works
Hohwy, J. (2016) · Consciousness and Cognition · doi:10.1016/j.concog.2016.09.004 · Cited by 131 · see citing works
Nick Chater, A., Oaksford, M., Hahn, U., & Heit, E. (2010) · Wiley Interdisciplinary Reviews Cognitive Science · doi:10.1002/wcs.79 · Cited by 129 · see citing works
Concepts in a Probabilistic Language of Thought
Goodman, N. D., Tenenbaum, J. B., & Gerstenberg, T. (2015) · The MIT Press eBooks · doi:10.7551/mitpress/9383.003.0035 · Cited by 120 · see citing works
Rolls, E. T. (2016) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780198784852.001.0001 · Cited by 116 · see citing works
What do predictive coders want?
Klein, C. (2016) · Synthese · doi:10.1007/s11229-016-1250-6 · Cited by 114 · see citing works
Content and misrepresentation in hierarchical generative models
Kiefer, A. B., & Hohwy, J. (2017) · Synthese · doi:10.1007/s11229-017-1435-7 · Cited by 111 · see citing works
Unifying the Mind: Cognitive Representations as Graphical Models
Danks, D. (2014) · doi:10.7551/mitpress/9540.001.0001 · Cited by 96 · see citing works
The Development of Modern Logic
Sandu, G., & Alexandro, L. (2009) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195137316.001.0001 · Cited by 89 · see citing works
The atoms of neural computation
Marcus, G., Marblestone, A. H., & Dean, T. (2014) · Science · doi:10.1126/science.1261661 · Cited by 80 · see citing works
Unifying logic and probability
Russell, S. (2015) · Communications of the ACM · doi:10.1145/2699411 · Cited by 77 · see citing works
Gordon, N., Koenig‐Robert, R., Tsuchiya, N., van Boxtel, J. J. A., & Hohwy, J. (2017) · eLife · doi:10.7554/elife.22749 · Cited by 72 · see citing works
(2018) · International series on intelligent systems, control and automation: science and engineering · doi:10.1007/978-3-319-97550-4 · Cited by 70 · see citing works
From symbols to icons: the return of resemblance in the cognitive neuroscience revolution
Williams, D., & Colling, L. (2018) · Synthese · doi:10.1007/s11229-017-1578-6 · Cited by 69 · see citing works
Self-citationExplanatory pluralism: An unrewarding prediction error for free energy theorists
Colombo, M., & Wright, C. (2017) · Brain and Cognition · doi:10.1016/j.bandc.2016.02.003 · Cited by 67 · see citing works
Unifying the mind: cognitive representations as graphical models
(2015) · Choice Reviews Online · doi:10.5860/choice.188193 · Cited by 65 · see citing works
Circular inference: mistaken belief, misplaced trust
Denève, S., & Jardri, R. (2016) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2016.04.001 · Cited by 65 · see citing works
The principles and practice of probabilistic programming
Goodman, N. D. (2013) · ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages (POPL) · doi:10.1145/2429069.2429117 · Cited by 57 · see citing works
The Neural Organ Explains the Mind
Hohwy, J. (2015) · doi:10.15502/9783958570016 · Cited by 54 · see citing works
Clark, A. (2015) · doi:10.15502/9783958570979 · Cited by 38 · see citing works
Bayesian Models of Brain and Behaviour
Penny, W. D. (2012) · ISRN Biomathematics · doi:10.5402/2012/785791 · Cited by 35 · see citing works
Tracing the Roots of Cognition in Predictive Processing
Pezzulo, G. (2017) · Theoretical Philosophy/MIND Group – JGU Mainz · doi:10.15502/9783958573215 · Cited by 33 · see citing works
Representation in the Prediction Error Minimization Framework
Kiefer, A. B., & Hohwy, J. (2019) · Routledge eBooks · doi:10.4324/9780429244629-24 · Cited by 25 · see citing works
Delusional parasitosis: Worms of the mind
Prakash, J., Shashikumar, R., Bhat, P., et al. (2012) · Industrial Psychiatry Journal · doi:10.4103/0972-6748.110958 · Cited by 24 · see citing works
Pragmatism and the predictive mind
Williams, D. (2018) · Phenomenology and the Cognitive Sciences · doi:10.1007/s11097-017-9556-5 · Cited by 22 · see citing works
Self-citationMachine learning for neuroscience
Hinton, G. E. (2011) · Neural Systems & Circuits · doi:10.1186/2042-1001-1-12 · Cited by 21 · see citing works
Huang, G. T. (2008) · The New Scientist · doi:10.1016/s0262-4079(08)61366-4 · Cited by 20 · see citing works
The principles and practice of probabilistic programming
Goodman, N. D. (2013) · ACM SIGPLAN Notices · doi:10.1145/2480359.2429117 · Cited by 17 · see citing works
Catching the Prediction Wave in Brain Science
Roskies, A. L., & Wood, C. C. (2017) · Analysis · doi:10.1093/analys/anx083 · Cited by 7 · see citing works
A predictive-coding account of multistable perception
Sterzer, P., Weilnhammer, V. A., Hesselmann, G., & Schmack, K. (2017) · Journal of Vision · doi:10.1167/17.10.580 · Cited by 3 · see citing works
Flagged first, then by citations
Research works printed but not linked: 10
- Clark, A. (2000). Mindware (1st ed.). New York: Oxford University Press.
- Clark, A. (2016). Surfing uncertainty. Oxford: Oxford University Press.
- Fodor, J. (2011). Fire the press secretary. [Review of the book Why everyone (else) is a hypocrite: Evolution and the modular mind.] London Review of Books, 33(9), 24-25. Retrieved from https://www.lrb.co. uk/v33/n09/jerry-fodor/fire-the-press-secretary.
- Gerstenberg, T., & Tenenbaum, J. B. (in press). Intuitive theories. In M. Waldman (Ed.), Oxford handbook of causal reasoning. Oxford University Press.
- Symons, P. Calvo, & S. Robins (Eds.), Routledge handbook to the philosophy of psychology. Routledge.
- Mountcastle, V. (1978). An organizing principle for cerebral function: The unit model and the distributed system. In G. M. Edelman & V. B. Mountcastle (Eds.), The mindful brain. Cambridge MA: MIT Press.
- Pearl, J. (2000). Causality. Cambridge: Cambridge University Press.
- Penny, W. (2012b). Bayesian models of brain and behaviour. ISRN Biomathematics, 2012, 1-19. https:// doi.org/10.5402/2012/785791. · DOI
- Sloman, S. (2005). Causal models. New York: Oxford University Press.
- Vance, J. (2015). Review of the predictive mind. Notre Dame Philosophical Reviews.
Cited by
Sorted by citations
The myth of the Bayesian brain
Mangalam, M. (2025) · European Journal of Applied Physiology · doi:10.1007/s00421-025-05855-6 · Cited by 14 · see citing works
“The Bayesian explanation, while mathematically elegant, risks functioning more as a narrative scaffold than a mechanistic theory of pathophysiology (Williams 2018).”
- Authors
- Williams, D.
- Affiliations
- University of Cambridge (GB)
- Corresponding author
- Williams, Daniel
- ORCID
- Williams, Daniel
- Venue
- Synthese
- Published
- 2018-03-24
- Volume
- 197
- Issue
- 4
- Pages
- 1749-1775
- ISSN
- 0039-7857 (ISSN-L)
- 1573-0964
- OpenAlex
- W2792648290
- Cited by
- 63
- References
- 90
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 6 · 2023: 11 · 2022: 18 · 2021: 9 · 2020: 7 · 2019: 5 · 2018: 2
- FWCI
- 3.43
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Synthese (publishedVersion, cc-by)
- Apollo (University of Cambridge) (submittedVersion, cc-by)
- Apollo (cc-by)
- Funders
- Arts and Humanities Research Council
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Embodied and Extended Cognition
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Philosophy and Theoretical Science
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Philosophy and History of Science
- Keywords
- predictive processing, predictive coding, conceptual thinking, mental representation, compositional semantics, conceptual combination, cognitive architecture, abstraction, spatial and temporal scales
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review