The evolution of brain architectures for predictive coding and active inference
Open accessThe DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Abstract
This article considers the evolution of brain architectures for predictive processing. We argue that brain mechanisms for predictive perception and action are not late evolutionary additions of advanced creatures like us. Rather, they emerged gradually from simpler predictive loops (e.g. autonomic and motor reflexes) that were a legacy from our earlier evolutionary ancestors—and were key to solving their fundamental problems of adaptive regulation. We characterize simpler-to-more-complex brains formally, in terms of generative models that include predictive loops of increasing hierarchical breadth and depth. These may start from a simple homeostatic motif and be elaborated during evolution in four main ways: these include the multimodal expansion of predictive control into an allostatic loop; its duplication to form multiple sensorimotor loops that expand an animal's behavioural repertoire; and the gradual endowment of generative models with hierarchical depth (to deal with aspects of the world that unfold at different spatial scales) and temporal depth (to select plans in a future-oriented manner). In turn, these elaborations underwrite the solution to biological regulation problems faced by increasingly sophisticated animals. Our proposal aligns neuroscientific theorising—about predictive processing—with evolutionary and comparative data on brain architectures in different animal species. This article is part of the theme issue ‘Systems neuroscience through the lens of evolutionary theory’.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Factor graphs and the sum-product algorithm
Kschischang, F. R., Frey, B. J., & Loeliger, H.-A. (2001) · IEEE Transactions on Information Theory · doi:10.1109/18.910572 · Cited by 6,486 · cited 1×
“In Bayesian statistics and physics, this kind of factorization is ubiquitous and is known as a mean field approximation [48].”
BackgroundAutopoiesis and Cognition: The Realization of the Living
Maturana, H. R., & Varela, F. J. (1980) · Boston Studies in the Philosophy and History of Science · doi:10.1007/978-94-009-8947-4 · Cited by 5,815
A perspective on judgment and choice: mapping bounded rationality.
Kahneman, D. (2003) · American Psychologist · doi:10.1037/0003-066x.58.9.697 · Cited by 5,540
Rao, R. P. N., & Ballard, D. H. (1999) · Nature Neuroscience · doi:10.1038/4580 · Cited by 5,483 · cited 1×
“There is growing consensus that the brains of humans and other phylogenetically derived or advanced organisms operate in a predictive manner across perception (predictive coding [1,2]) and action control (active inference [3,4]).”
BackgroundPlans and the structure of behavior.
Miller, G. A., Galanter, E., & Pribram, K. H. (1960) · doi:10.1037/10039-000 · Cited by 4,630
Cybernetics. Or Control and Communication in the Animal and the Machine
N., E., & Wiener, N. (1949) · The Journal of Philosophy · doi:10.2307/2020260 · Cited by 3,590
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533
Behavior: The Control of Perception
Kuhn, A., & Powers, W. T. (1975) · Contemporary Sociology · doi:10.2307/2063243 · Cited by 2,398 · cited 1×
“This is closely related to the good regulator theorem and perceptual control theory [9,10,15].”
Background‘What’ and ‘where’ in the human brain
Ungerleider, L. G., & Haxby, J. V. (1994) · Current Opinion in Neurobiology · doi:10.1016/0959-4388(94)90066-3 · Cited by 1,913
Memory, navigation and theta rhythm in the hippocampal-entorhinal system
Buzsáki, G., & Moser, E. I. (2013) · Nature Neuroscience · doi:10.1038/nn.3304 · Cited by 1,847
Interoceptive predictions in the brain
Barrett, L. F., & Simmons, W. K. (2015) · Nature Reviews Neuroscience · doi:10.1038/nrn3950 · Cited by 1,766
The basal ganglia: a vertebrate solution to the selection problem?
Redgrave, P., Prescott, T. J., & Gurney, K. (1999) · Neuroscience · doi:10.1016/s0306-4522(98)00319-4 · Cited by 1,199
Active inference: a process theory
Friston, K., FitzGerald, T., Rigoli, F., Schwartenbeck, P., & Pezzulo, G. (2017) · Neural Computation · doi:10.1162/neco_a_00912 · Cited by 1,156 · cited 3×
“Active inference formalizes the ensuing resolution of surprise as the minimization of variational free energy: a quantity that is an upper bound on surprise and whose two components (divergence and surprise) map to perception and action, respectively; see figure 1b and [3] for technical details.”
BackgroundSelf-citationAllostasis: A model of predictive regulation
Sterling, P. (2012) · Physiology & Behavior · doi:10.1016/j.physbeh.2011.06.004 · Cited by 1,073
How the Body Shapes the Way We Think: A New View of Intelligence
Pfeifer, R., & Bongard, J. (2006) · doi:10.7551/mitpress/3585.001.0001 · Cited by 956
Active interoceptive inference and the emotional brain
Seth, A. K., & Friston, K. J. (2016) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2016.0007 · Cited by 945
Self-citationThermoregulation: some concepts have changed. Functional architecture of the thermoregulatory system
Romanovsky, A. A. (2007) · American Journal of Physiology-Regulatory, Integrative and Comparative Physiology · doi:10.1152/ajpregu.00668.2006 · Cited by 786
Spontaneous Cortical Activity Reveals Hallmarks of an Optimal Internal Model of the Environment
Berkes, P., Orbán, G., Lengyel, M., & Fiser, J. (2011) · Science · doi:10.1126/science.1195870 · Cited by 782
Predictions not commands: Active inference in the motor system
Adams, R. A., Shipp, S., & Friston, K. J. (2013) · Brain Structure and Function · doi:10.1007/s00429-012-0475-5 · Cited by 765 · cited 1×
“For example, active inference emphasizes that some aspects (that roughly correspond to the notion of inverse models in optimal control) can be directly implemented by reflex arcs in the spinal cord [87].”
BackgroundSelf-citationFriston, K., FitzGerald, T., Rigoli, F., Schwartenbeck, P., ODoherty, J., & Pezzulo, G. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.06.022 · Cited by 674
Self-citationActive Inference, homeostatic regulation and adaptive behavioural control
Pezzulo, G., Rigoli, F., & Friston, K. (2015) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2015.09.001 · Cited by 650 · cited 2×
“An animal will strive to achieve these cognitive goals through a similar error correction scheme as homeostatic control: by selecting courses of actions expected to reduce the discrepancy between the current and the goal state [5,18].”
BackgroundSelf-citation(2005) · Edinburgh Research Explorer (University of Edinburgh) · doi:10.5555/1046920.1088695 · Cited by 650
Motivation and cognitive control in the human prefrontal cortex
Kouneiher, F., Charron, S., & Koechlin, E. (2009) · Nature Neuroscience · doi:10.1038/nn.2321 · Cited by 590 · cited 2×
“Finally, ventromedial brain areas may support the prioritization of different hierarchical levels, depending on their current motivational value (see §11 below for our discussion of hierarchical models) [41,42].”
BackgroundHohwy, J. (2016) · Noûs · doi:10.1111/nous.12062 · Cited by 578
A taxonomy of prospection: Introducing an organizational framework for future-oriented cognition
Szpunar, K. K., Spreng, R. N., & Schacter, D. L. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1417144111 · Cited by 539 · cited 1×
“Intriguingly, the same hippocampal circuits that support spatial navigation and foraging are also involved in prospection and imagination [50].”
BackgroundAllostatic Self-efficacy: A Metacognitive Theory of Dyshomeostasis-Induced Fatigue and Depression
Stephan, K. E., Manjaly, Z. M., Mathys, C. D., Weber, L. A. E., Paliwal, S., Gard, T., Tittgemeyer, M., Fleming, S. M., Haker, H., Seth, A. K., et al. (2016) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2016.00550 · Cited by 437 · cited 1×
“This is in contrast to the functioning of the ‘homeostat’, where an autonomic action is only triggered after the thermoreceptor activity increases (see [20,27] for alternative formulations of allostatic control that appeal to hierarchical models; and [28] for a discussion of multimodal variables and convergence zones).”
ResultNavigating the Affordance Landscape: Feedback Control as a Process Model of Behavior and Cognition
Pezzulo, G., & Cisek, P. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.03.013 · Cited by 419
Self-citationThe graphical brain: Belief propagation and active inference
Friston, K. J., Parr, T., & de Vries, B. (2017) · Network Neuroscience · doi:10.1162/netn_a_00018 · Cited by 415
Self-citationDopamine, affordance and active inference
Friston, K. J., Shiner, T., FitzGerald, T., Galea, J. M., Adams, R., Brown, H., Dolan, R. J., Moran, R., Stephan, K. E., & Bestmann, S. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002327 · Cited by 381 · cited 1×
“The ‘homeostat’ and the ‘allostat’ permit the control of simple forms of swimming, locomotion, reachingandothermovements [29].”
BackgroundSelf-citationThe Neurobiology of the Prefrontal Cortex: Anatomy, Evolution, and the Origin of Insight
Passingham, R. E., & Wise, S. P. (2012) · doi:10.1093/acprof:osobl/9780199552917.001.0001 · Cited by 379
Thinking through other minds: A variational approach to cognition and culture
Veissière, S. P. L., Constant, A., Ramstead, M. J. D., Friston, K. J., & Kirmayer, L. J. (2020) · Behavioral and Brain Sciences · doi:10.1017/s0140525x19001213 · Cited by 348
Self-citationHierarchical active inference: A theory of motivated control
Pezzulo, G., Rigoli, F., & Friston, K. J. (2018) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2018.01.009 · Cited by 334 · cited 2×
“Finally, ventromedial brain areas may support the prioritization of different hierarchical levels, depending on their current motivational value (see §11 below for our discussion of hierarchical models) [41,42].”
BackgroundSelf-citationRedefining the role of limbic areas in cortical processing
Chanes, L., & Barrett, L. F. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.11.005 · Cited by 259 · cited 1×
“In active inference, these and other similar imperatives lie at the top of the animal’s control hierarchy and permit animals to continuously evaluate their current state in relation to their desired states of affairs; and to steer action if deviations are sensed [13].”
BackgroundA variational approach to niche construction
Constant, A., Ramstead, M. J. D., Veissière, S. P. L., Campbell, J. O., & Friston, K. J. (2018) · Journal of The Royal Society Interface · doi:10.1098/rsif.2017.0685 · Cited by 204
Self-citationNew insights into action–perception coupling
Feldman, A. G. (2009) · Experimental Brain Research · doi:10.1007/s00221-008-1667-3 · Cited by 162
Universal darwinism as a process of bayesian inference
Campbell, J. O. (2016) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2016.00049 · Cited by 140 · cited 1×
“Specifically, one can cast natural selection as nature’s way of performing Bayesian model selection––sometimes known as structure learning [77] (i.”
BackgroundThe why, what, where, when and how of goal-directed choice: neuronal and computational principles
Verschure, P. F. M. J., Pennartz, C. M. A., & Pezzulo, G. (2014) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2013.0483 · Cited by 131 · cited 1×
“Rather, older solutions largely remain available and can be selected in the appropriate conditions—thus rendering action selection context-sensitive [5,63].”
BackgroundClosed-loop Neuronal Computations: Focus on Vibrissa Somatosensation in Rat
Ahissar, E. (2003) · Cerebral Cortex · doi:10.1093/cercor/13.1.53 · Cited by 122
Learning action-oriented models through active inference
Tschantz, A., Seth, A. K., & Buckley, C. L. (2020) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1007805 · Cited by 121
First principles in the life sciences: the free-energy principle, organicism, and mechanism
Colombo, M., & Wright, C. (2021) · Synthese · doi:10.1007/s11229-018-01932-w · Cited by 101
A Multi-scale View of the Emergent Complexity of Life: A Free-Energy Proposal
Hesp, C., Ramstead, M., Constant, A., Badcock, P., Kirchhoff, M., & Friston, K. (2019) · Springer Proceedings in Complexity · doi:10.1007/978-3-030-00075-2_7 · Cited by 63 · cited 1×
“Although not our focus here, the process by which selective pressure generates new neuronal structures can itself be expressed as a surpriseor free energy-minimizing process [74,75].”
BackgroundSelf-citationFrank, S. A. (2012) · Journal of Evolutionary Biology · doi:10.1111/jeb.12010 · Cited by 21
Research works printed but not linked: 45
- Friston, 2005, A theory of cortical responses, Phil. Trans. R. Soc. B, 360, 815, 10.1098/rstb.2005.1622 · DOI · Paper page
- Parr, 2022, Active inference: the free energy principle in mind, brain, and behavior, 10.7551/mitpress/12441.001.0001 · DOI · Paper page
- Ashby, 1952, Design for a brain
- Hull, 1943, Principles of behaviour
- Conant, 1970, Every good regulator of a system must be a model of that system, Intl. J. Syst. Sci., 1, 89, 10.1080/00207727008920220 · DOI · Paper page
- Pezzulo, 2009, Thinking as the control of imagination: a conceptual framework for goal-directed systems, Psychol. Res., 73, 559, 10.1007/s00426-009-0237-z · DOI · Paper page
- O'Reilly, 2014
- Pezzulo, 2020, The secret life of predictive brains: what's spontaneous activity for?, Trends Cogn. Sci., 25, 730, 10.1016/j.tics.2021.05.007 · DOI · Paper page
- Meyer, 2009, Convergence and divergence in a neural architecture for recognition and memory, Trends Neurosci., 32, 376, 10.1016/j.tins.2009.04.002 · DOI · Paper page
- Torigoe, 2021, Zebrafish capable of generating future state prediction error show improved active avoidance behavior in virtual reality, Nat. Commun., 12, 5712, 10.1038/s41467-021-26010-7 · DOI
- Mueller, 2009, An evolutionary interpretation of teleostean forebrain anatomy, Brain Behav. Evol., 74, 30, 10.1159/000229011 · DOI · Paper page
- Krubitzer, 2007, The magnificent compromise: cortical field evolution in mammals, Neuron, 56, 201, 10.1016/j.neuron.2007.10.002 · DOI · Paper page
- Friston, 2021, Sophisticated inference, Neural Comput., 33, 713, 10.1162/neco_a_01351 · DOI · Paper page
- Cisek, 2019, Resynthesizing behavior through phylogenetic refinement, Atten. Percept. Psychophys., 81, 2265, 10.3758/s13414-019-01760-1 · DOI · Paper page
- Krubitzer, 2009, In search of a unifying theory of complex brain evolution, Ann. NY Acad. Sci., 1156, 44, 10.1111/j.1749-6632.2009.04421.x · DOI · Paper page
- Alexander, 1986, Parallel organization of functionally segregated circuits linking basal ganglia and cortex, Annu. Rev. Neurosci., 9, 357, 10.1146/annurev.ne.09.030186.002041 · DOI · Paper page
- Graziano, 2016, Ethological action maps: a paradigm shift for the motor cortex, Trends Cogn. Sci., 20, 121, 10.1016/j.tics.2015.10.008 · DOI · Paper page
- Cisek, 2007, Cortical mechanisms of action selection: the affordance competition hypothesis, Phil. Trans. R. Soc. B, 362, 1585, 10.1098/rstb.2007.2054 · DOI · Paper page
- Desimone, 1995, Neural mechanisms of selective visual attention, Annu. Rev. Neurosci., 18, 193, 10.1146/annurev.ne.18.030195.001205 · DOI · Paper page
- Parr, 2020, Modules or mean-fields?, Entropy, 22, 552, 10.3390/e22050552 · DOI · Paper page
- Zeki, 2005, The Ferrier Lecture 1995 Behind the seen: The functional specialization of the brain in space and time, Phil. Trans. R. Soc. B, 360, 1145, 10.1098/rstb.2005.1666 · DOI · Paper page
- Friston, 2016, The functional anatomy of time: what and when in the brain, Trends Cogn. Sci., 20, 500, 10.1016/j.tics.2016.05.001 · DOI · Paper page
- Buzsáki, 2014, Emergence of cognition from action, Cold Spring Harb. Symp. Quant. Biol., 79, 41, 10.1101/sqb.2014.79.024679 · DOI · Paper page
- Yu, 1996, Temporal hierarchical control of singing in birds, Science, 273, 1871, 10.1126/science.273.5283.1871 · DOI · Paper page
- Friston, 2009, Cortical circuits for perceptual inference, Neural Netw., 22, 1093, 10.1016/j.neunet.2009.07.023 · DOI · Paper page
- Tinbergen, 1951, The study of instinct
- Berman, 2016, Predictability and hierarchy in Drosophila behavior, Proc. Natl Acad. Sci. USA, 113, 11 943, 10.1073/pnas.1607601113 · DOI · Paper page
- Stout, 2010, The evolution of cognitive control, Top. Cogn. Sci., 2, 614, 10.1111/j.1756-8765.2009.01078.x · DOI · Paper page
- Hills, 2011, The evolutionary origins of cognitive control, Top. Cogn. Sci., 3, 231, 10.1111/j.1756-8765.2011.01135.x · DOI
- Barkley, 2001, The executive functions and self-regulation: an evolutionary neuropsychological perspective, Neuropsychol. Rev., 11, 1, 10.1023/A:1009085417776 · DOI · Paper page
- Cheng, 2014, Zebrafish forebrain and temporal conditioning, Phil. Trans. R. Soc. B, 369, 20120462, 10.1098/rstb.2012.0462 · DOI
- Qi, 2018, How cognitive and reactive fear circuits optimize escape decisions in humans, Proc. Natl Acad. Sci. USA, 115, 3186, 10.1073/pnas.1712314115 · DOI · Paper page
- Horridge,, 1968, The origins of the nervous system
- Miller, 2001, An integrative theory of prefrontal cortex function, Annu. Rev. Neurosci., 24, 167, 10.1146/annurev.neuro.24.1.167 · DOI · Paper page
- MacLean, 1990, The triune brain in evolution: role in paleocerebral functions
- Cisek, 1999, Beyond the computer metaphor: behavior as interaction, J. Conscious. Stud., 6, 125
- Pezzulo, 2018, Embodying Markov blankets: comment on 'Answering Schrödinger's question: a free-energy formulation' by Maxwell James Désormeau Ramstead, et al. Phys. Life Revs, 24, 32, 10.1016/j.plrev.2017.11.020 · DOI
- Badcock, 2019, The hierarchically mechanistic mind: a free-energy formulation of the human psyche, Phys. Life Rev., 31, 104, 10.1016/j.plrev.2018.10.002 · DOI · Paper page
- Dunbar, 1998, The social brain hypothesis. Evolutionary anthropology: issues, News Rev., 6, 178
- Laland, 2016, An introduction to niche construction theory, Evol. Ecol., 30, 191, 10.1007/s10682-016-9821-z · DOI · Paper page
- Bruineberg, 2018, Free-energy minimization in joint agent-environment systems: a niche construction perspective, J. Theor. Biol., 455, 161, 10.1016/j.jtbi.2018.07.002 · DOI · Paper page
- Nave, 2020, Wilding the predictive brain, WIREs Cogn. Sci., 11, e1542, 10.1002/wcs.1542 · DOI
- Clark, 2015, Surfing uncertainty: prediction, action, and the embodied mind
- Mannella, 2021, Active inference through whiskers, Neural Netw., 144, 428, 10.1016/j.neunet.2021.08.037 · DOI
- Gordon, 2021, The road towards understanding embodied decisions, Neurosci. Biobehav. Rev., 131, 722, 10.1016/j.neubiorev.2021.09.034 · DOI
Cited by
Active inference as a theory of sentient behavior
Pezzulo, G., Parr, T., & Friston, K. (2024) · Biological Psychology · doi:10.1016/j.biopsycho.2023.108741 · Cited by 109
Self-citationGenerating meaning: active inference and the scope and limits of passive AI
Pezzulo, G., Parr, T., Cisek, P., Clark, A., & Friston, K. (2024) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2023.10.002 · Cited by 80
“In organisms like us, abstract thought and linguistic knowledge are grounded in the circuits that supported sensorimotor predictions and purposive control in our evolutionary ancestors [22,27,95,96].”
Self-citationThe memory systems of the human brain and generative artificial intelligence
Rolls, E. T. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e31965 · Cited by 23
Generating Meaning: Active Inference and the Scope and Limits of Passive AI
Pezzulo, G., Parr, T., Cisek, P., Clark, A., & Friston, K. (2023) · doi:10.31234/osf.io/8xgzv · Cited by 8
Self-citationMeng, J., Zhao, Y., Wang, K., Sun, J., Yi, W., Xu, F., Xu, M., & Ming, D. (2023) · Journal of Neural Engineering · doi:10.1088/1741-2552/ad0650 · Cited by 5
“Strikingly, temporal prediction, especially the rhythmic form, is closely related to the motor system [16–18].”
Metadata
- Authors
- Pezzulo, G., Parr, T., & Friston, K.
- Venue
- Philosophical Transactions of the Royal Society B
- Publisher
- The Royal Society
- Published
- 2021-12-27
- Volume
- 377
- Issue
- 1844
- Pages
- 20200531-20200531
- ISSN
- 0962-8436 (ISSN-L)
- 1471-2970
- OpenAlex
- W4200300030
- Cited by
- 117
- References
- 42
- FWCI
- 6.71
- Type
- journal article
- Language
- en
- Open access
- bronze
- Licence
- royalsociety.org/-/media/journals/author/Licence-to-Publish-20062019-final.pdf (vor)
- royalsociety.org/journals/ethics-policies/data-sharing-mining/ (vor)
- royalsociety.org/journals/ethics-policies/data-sharing-mining/ (tdm)
- Funders
- H2020 (785907, 945539)
- Wellcome Centre for Human Neuroimaging (205103/Z/16/Z)
- H2020 European Research Council (820213)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.