Generating Meaning: Active Inference and the Scope and Limits of Passive AI
Open accessThe DOI matches its Crossref record; 142 of the 154 references it cites were found in a registry or an index.
Abstract
Prominent accounts of sentient behaviour depict brains as generative models of organismic interaction with the world, raising points of contact with current work in Generative AI. However, because they contend with the control of purposive, life-maintaining sensorimotor interactions, the generative models of living organisms are inextricably anchored to the body and world. Unlike the passive models learnt by Generative AIs, they must capture and control the sensory consequences of action. This allows embodied agents to intervene upon their worlds in ways that constantly put their best models to the test; providing a solid bedrock that is—we argue—essential to the development of genuine understanding. Here, we review the resulting implications, and consider future directions of travel for Generative AI.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“AIF models are always primarily concerned with how the agent is able to act, reducing prediction errors over an integrated array of interoceptive, proprioceptive and exteroceptive sensations, and grounding their understanding of language in their biological, social and cultural activity”
From Active inference goes to school: the importance of active learning in the age of large language models (2024) · cites this paper as [76]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Advances in neural information processing systems 7
Cios, K., & Shields, M. (1997) · Neurocomputing · doi:10.1016/s0925-2312(97)90018-7 · Cited by 22,059
The Proceedings of the National Academy of Sciences
Richards, J. W. (1915) · Science · doi:10.1126/science.42.1074.161 · Cited by 13,983
Kaugeranna, R., Kaugeranna, E., & Aion, (. S. 4. 6. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.giscience.2023.43 · Cited by 13,690
Statistical Decision Theory and Bayesian Analysis
Berger, J. O. (1985) · Springer Series in Statistics · doi:10.1007/978-1-4757-4286-2 · Cited by 7,722
Searle, J. R. (1980) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00005756 · Cited by 6,954
Rao, R. P. N., & Ballard, D. H. (1999) · Nature Neuroscience · doi:10.1038/4580 · Cited by 5,483
Intelligence without representation
Brooks, R. A. (1991) · Artificial Intelligence · doi:10.1016/0004-3702(91)90053-m · Cited by 4,853
Harnad, S. (1990) · Physica D: Nonlinear Phenomena · doi:10.1016/0167-2789(90)90087-6 · Cited by 4,235
Training language models to follow instructions with human feedback
Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C. L., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2203.02155 · Cited by 4,208
Cybernetics. Or Control and Communication in the Animal and the Machine
N., E., & Wiener, N. (1949) · The Journal of Philosophy · doi:10.2307/2020260 · Cited by 3,590
On the Opportunities and Risks of Foundation Models
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.07258 · Cited by 2,676
The Ecological Approach To Visual Perception
Gibson, J. J. (2013) · Psychology Press eBooks · doi:10.4324/9780203767764 · Cited by 2,564
Building machines that learn and think like people
Lake, B. M., Ullman, T. D., Tenenbaum, J. B., & Gershman, S. J. (2017) · Behavioral and Brain Sciences · doi:10.1017/s0140525x16001837 · Cited by 2,550
Canonical Microcircuits for Predictive Coding
Bastos, A. M., Usrey, W. M., Adams, R. A., Mangun, G. R., Fries, P., & Friston, K. J. (2012) · Neuron · doi:10.1016/j.neuron.2012.10.038 · Cited by 2,421
Self-citationBehavior: The Control of Perception
Kuhn, A., & Powers, W. T. (1975) · Contemporary Sociology · doi:10.2307/2063243 · Cited by 2,398
Generative Agents: Interactive Simulacra of Human Behavior
Park, J. S., O'Brien, J., Cai, C. J., Morris, M. R., Liang, P., & Bernstein, M. S. (2023) · Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3586183.3606763 · Cited by 2,187
Path integration and the neural basis of the 'cognitive map'
McNaughton, B. L., Battaglia, F. P., Jensen, O., Moser, E. I., & Moser, M.-B. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn1932 · Cited by 2,024
Perceiving, Acting, and Knowing: Toward an Ecological Psychology
Mayzner, M. S., Shaw, R., & Bransford, J. (1978) · The American Journal of Psychology · doi:10.2307/1421838 · Cited by 1,917
Memory, navigation and theta rhythm in the hippocampal-entorhinal system
Buzsáki, G., & Moser, E. I. (2013) · Nature Neuroscience · doi:10.1038/nn.3304 · Cited by 1,847
Organization for physiological homeostasis
Cannon, W. B. (1929) · Physiological Reviews · doi:10.1152/physrev.1929.9.3.399 · Cited by 1,844
The reflex arc concept in psychology.
Dewey, J. (1896) · Psychological Review · doi:10.1037/h0070405 · Cited by 1,817
Interoceptive inference, emotion, and the embodied self
Seth, A. K. (2013) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2013.09.007 · Cited by 1,816
Interoceptive predictions in the brain
Barrett, L. F., & Simmons, W. K. (2015) · Nature Reviews Neuroscience · doi:10.1038/nrn3950 · Cited by 1,766
Proceedings for the Annual Meeting of the Cognitive Science Society
Dziemianko, M., Clarke, A. D. F., & Keller, F. (2013) · Cited by 1,726
The Book of Why: The New Science of Cause and Effect
Goldberg, L. R. (2019) · Notices of the American Mathematical Society · doi:10.1090/noti1912 · Cited by 1,655
Using goal-driven deep learning models to understand sensory cortex
Yamins, D. L. K., & DiCarlo, J. J. (2016) · Nature Neuroscience · doi:10.1038/nn.4244 · Cited by 1,621
Flamingo: a Visual Language Model for Few-Shot Learning
Alayrac, J.-B., Donahue, J., Luc, P., Miech, A., Barr, I., Hasson, Y., Lenc, K., Mensch, A., Millican, K., Reynolds, M., et al. (2022) · arXiv · doi:10.48550/arxiv.2204.14198 · Cited by 1,555
Neural Mechanisms for Interacting with a World Full of Action Choices
Cisek, P., & Kalaska, J. F. (2010) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.051508.135409 · Cited by 1,543
Self-citationOn a measure of the information provided by an experiment
Lindley, D. V. (1956) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177728069 · Cited by 1,509
The Body in the Mind: The Bodily Basis of Meaning, Imagination, and Reason
WALLACE, R. J. (1988) · Philosophical Books · doi:10.1111/j.1468-0149.1988.tb02084.x · Cited by 1,505
Emergent Abilities of Large Language Models
Wei, J., Tay, Y., Bommasani, R., Raffel, C., Zoph, B., Borgeaud, S., Yogatama, D., Bosma, M., Zhou, D., Metzler, D., et al. (2022) · arXiv · doi:10.48550/arxiv.2206.07682 · Cited by 1,264
Active inference: a process theory
Friston, K., FitzGerald, T., Rigoli, F., Schwartenbeck, P., & Pezzulo, G. (2017) · Neural Computation · doi:10.1162/neco_a_00912 · Cited by 1,156
Self-citationCortical mechanisms of action selection: the affordance competition hypothesis
Cisek, P. (2007) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2007.2054 · Cited by 1,083
Self-citationThe "Wake-Sleep" Algorithm for Unsupervised Neural Networks
Hinton, G. E., Dayan, P., Frey, B. J., & Neal, R. M. (1995) · Science · doi:10.1126/science.7761831 · Cited by 1,070
Every good regulator of a system must be a model of that system †
CONANT, R. C., & ROSS ASHBY, W. (1970) · International Journal of Systems Science · doi:10.1080/00207727008920220 · Cited by 1,063
Active interoceptive inference and the emotional brain
Seth, A. K., & Friston, K. J. (2016) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2016.0007 · Cited by 945
Self-citationThe neural correlate of (un)awareness: lessons from the vegetative state
Laureys, S. (2005) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2005.10.010 · Cited by 813
Two neural correlates of consciousness
Block, N. (2005) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.12.006 · Cited by 713
Active Inference, homeostatic regulation and adaptive behavioural control
Pezzulo, G., Rigoli, F., & Friston, K. (2015) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2015.09.001 · Cited by 650
Self-citation(2005) · Edinburgh Research Explorer (University of Edinburgh) · doi:10.5555/1046920.1088695 · Cited by 650
Evidence for a large-scale brain system supporting allostasis and interoception in humans
Kleckner, I. R., Zhang, J., Touroutoglou, A., Chanes, L., Xia, C., Simmons, W. K., Quigley, K. S., Dickerson, B. C., & Feldman Barrett, L. (2017) · Nature Human Behaviour · doi:10.1038/s41562-017-0069 · Cited by 641
Do As I Can, Not As I Say: Grounding Language in Robotic Affordances
Ahn, M., Brohan, A., Brown, N., Chebotar, Y., Cortes, O., David, B., Finn, C., Fu, C., Gopalakrishnan, K., Hausman, K., et al. (2022) · arXiv · doi:10.48550/arxiv.2204.01691 · Cited by 624
Mindware: An Introduction to the Philosophy of Cognitive Science
Clark, A. (2000) · Cited by 621
Self-citationEmbodiment as a unifying perspective for psychology
Glenberg, A. M. (2010) · WIREs Cognitive Science · doi:10.1002/wcs.55 · Cited by 597
PaLM-E: An Embodied Multimodal Language Model
Driess, D., Xia, F., Sajjadi, M. S. M., Lynch, C., Chowdhery, A., Ichter, B., Wahid, A., Tompson, J., Vuong, Q., Yu, T., et al. (2023) · arXiv · doi:10.48550/arxiv.2303.03378 · Cited by 591
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
Srivastava, A., Rastogi, A., Rao, A., Shoeb, A. A. M., Abid, A., Fisch, A., Brown, A. R., Santoro, A., Gupta, A., Garriga-Alonso, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2206.04615 · Cited by 569
Using cognitive psychology to understand GPT-3
Binz, M., & Schulz, E. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2218523120 · Cited by 559
Global Brain Dynamics Embed the Motor Command Sequence of Caenorhabditis elegans
Kato, S., Kaplan, H. S., Schrödel, T., Skora, S., Lindsay, T. H., Yemini, E., Lockery, S., & Zimmer, M. (2015) · Cell · doi:10.1016/j.cell.2015.09.034 · Cited by 550
Neural scene representation and rendering
Eslami, S. M. A., Jimenez Rezende, D., Besse, F., Viola, F., Morcos, A. S., Garnelo, M., Ruderman, A., Rusu, A. A., Danihelka, I., Gregor, K., et al. (2018) · Science · doi:10.1126/science.aar6170 · Cited by 495
Shared computational principles for language processing in humans and deep language models
Goldstein, A., Zada, Z., Buchnik, E., Schain, M., Price, A., Aubrey, B., Nastase, S. A., Feder, A., Emanuel, D., Cohen, A., et al. (2022) · Nature Neuroscience · doi:10.1038/s41593-022-01026-4 · Cited by 447
A Self-Organizing Spatial Vocabulary
Steels, L. (1995) · Artificial Life · doi:10.1162/artl.1995.2.3.319 · Cited by 422
Navigating the Affordance Landscape: Feedback Control as a Process Model of Behavior and Cognition
Pezzulo, G., & Cisek, P. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.03.013 · Cited by 419
Self-citationEmergent analogical reasoning in large language models
Webb, T., Holyoak, K. J., & Lu, H. (2023) · Nature Human Behaviour · doi:10.1038/s41562-023-01659-w · Cited by 404
On the Human "Interaction Engine"
Levinson, S. C. (2020) · Roots of Human Sociality · doi:10.4324/9781003135517-3 · Cited by 401
Surfing uncertainty: prediction, action and the embodied mind
Bruineberg, J., & Froese, T. (2016) · International Journal of Performance Arts and Digital Media · doi:10.1080/14794713.2016.1257478 · Cited by 400
Wordcraft: Story Writing With Large Language Models
Yuan, A., Coenen, A., Reif, E., & Ippolito, D. (2022) · 27th International Conference on Intelligent User Interfaces · doi:10.1145/3490099.3511105 · Cited by 374
Active Inference, Curiosity and Insight
Friston, K. J., Lin, M., Frith, C. D., Pezzulo, G., Hobson, J. A., & Ondobaka, S. (2017) · Neural Computation · doi:10.1162/neco_a_00999 · Cited by 351
Self-citationThinking through other minds: A variational approach to cognition and culture
Veissière, S. P. L., Constant, A., Ramstead, M. J. D., Friston, K. J., & Kirmayer, L. J. (2020) · Behavioral and Brain Sciences · doi:10.1017/s0140525x19001213 · Cited by 348
Self-citationNeural elements for predictive coding
Shipp, S. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.01792 · Cited by 340
Emergent linguistic structure in artificial neural networks trained by self-supervision
Manning, C. D., Clark, K., Hewitt, J., Khandelwal, U., & Levy, O. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1907367117 · Cited by 339
Evaluating Large Language Models in Theory of Mind Tasks
Kosinski, M. (2023) · arXiv · doi:10.48550/arxiv.2302.02083 · Cited by 339
Evaluating large language models in theory of mind tasks
Kosinski, M. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2405460121 · Cited by 339
Faith and Fate: Limits of Transformers on Compositionality
Dziri, N., Lu, X., Sclar, M., Li, X. (., Jiang, L., Lin, B. Y., Welleck, S., West, P., Bhagavatula, C., Bras, R. L., et al. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-3081 · Cited by 335
Hierarchical active inference: A theory of motivated control
Pezzulo, G., Rigoli, F., & Friston, K. J. (2018) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2018.01.009 · Cited by 334
Self-citationCellular Mechanisms of Conscious Processing
Aru, J., Suzuki, M., & Larkum, M. E. (2020) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2020.07.006 · Cited by 321
Catalyzing next-generation Artificial Intelligence through NeuroAI
Zador, A., Escola, S., Richards, B., Ölveczky, B., Bengio, Y., Boahen, K., Botvinick, M., Chklovskii, D., Churchland, A., Clopath, C., et al. (2023) · Nature Communications · doi:10.1038/s41467-023-37180-x · Cited by 300
Physical Experience Enhances Science Learning
Kontra, C., Lyons, D. J., Fischer, S. M., & Beilock, S. L. (2015) · Psychological Science · doi:10.1177/0956797615569355 · Cited by 290
Resynthesizing behavior through phylogenetic refinement
Cisek, P. (2019) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-019-01760-1 · Cited by 289
Self-citationFunctions of interoception: From energy regulation to experience of the self
Quigley, K. S., Kanoski, S., Grill, W. M., Barrett, L. F., & Tsakiris, M. (2021) · Trends in Neurosciences · doi:10.1016/j.tins.2020.09.008 · Cited by 286
Developmental robotics, optimal artificial curiosity, creativity, music, and the fine arts
Schmidhuber, J. (2006) · Connection Science · doi:10.1080/09540090600768658 · Cited by 268
Words as social tools: language, sociality and inner grounding in abstract concepts
Borghi, A. M., Barca, L., Binkofski, F., Castelfranchi, C., Pezzulo, G., & Tummolini, L. (2019) · Physics of Life Reviews · doi:10.1016/j.plrev.2018.12.001 · Cited by 253
Self-citationEthological Action Maps: A Paradigm Shift for the Motor Cortex
Graziano, M. S. A. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.10.008 · Cited by 242
Language Is Not All You Need: Aligning Perception with Language Models
Huang, S., Dong, L., Wang, W., Hao, Y., Singhal, S., Ma, S., Lv, T., Cui, L., Mohammed, O. K., Patra, B., et al. (2023) · arXiv · doi:10.48550/arxiv.2302.14045 · Cited by 235
Knowing one's place: a free-energy approach to pattern regulation
Friston, K., Levin, M., Sengupta, B., & Pezzulo, G. (2015) · Journal of The Royal Society Interface · doi:10.1098/rsif.2014.1383 · Cited by 234
Self-citationPrediction and memory: A predictive coding account
Barron, H. C., Auksztulewicz, R., & Friston, K. (2020) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2020.101821 · Cited by 220
Self-citationInternally generated sequences in learning and executing goal-directed behavior
Pezzulo, G., van der Meer, M. A. A., Lansink, C. S., & Pennartz, C. M. A. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.06.011 · Cited by 217
Self-citationPezzulo, G., Barsalou, L. W., Cangelosi, A., Fischer, M. H., McRae, K., & Spivey, M. J. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00612 · Cited by 210
Self-citationPlanning by Probabilistic Inference.
Attias, H. T. (2003) · Cited by 204
The Anatomy of Inference: Generative Models and Brain Structure
Parr, T., & Friston, K. J. (2018) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2018.00090 · Cited by 204
Self-citationDeep problems with neural network models of human vision
Bowers, J. S., Malhotra, G., Dujmović, M., Llera Montero, M., Tsvetkov, C., Biscione, V., Puebla, G., Adolfi, F., Hummel, J. E., Heaton, R. F., et al. (2023) · Behavioral and Brain Sciences · doi:10.1017/s0140525x22002813 · Cited by 204
Circular inferences in schizophrenia
Jardri, R., & Denève, S. (2013) · Brain · doi:10.1093/brain/awt257 · Cited by 201
Language Is Not All You Need: Aligning Perception with Language Models
Huang, S., Dong, L., Wang, W., Hao, Y., Singhal, S., Ma, S., Lv, T., Cui, L., Mohammed, O. K., Patra, B., et al. (2023) · neural information processing systems · doi:10.52202/075280-3155 · Cited by 191
Learning Semantic Combinatoriality from the Interaction between Linguistic and Behavioral Processes
Sugita, Y., & Tani, J. (2005) · Adaptive Behavior · doi:10.1177/105971230501300102 · Cited by 183
Large Language Models and the Reverse Turing Test
Sejnowski, T. J. (2023) · Neural Computation · doi:10.1162/neco_a_01563 · Cited by 169
Can language models learn from explanations in context?
Lampinen, A. K., Dasgupta, I., Chan, S. C. Y., Matthewson, K., Tessler, M. H., Creswell, A., McClelland, J. L., Wang, J. X., & Hill, F. (2022) · arXiv · doi:10.48550/arxiv.2204.02329 · Cited by 163
Embodied, Situated, and Distributed Cognition
Clark, A. (2017) · A Companion to Cognitive Science · doi:10.1002/9781405164535.ch39 · Cited by 158
Self-citationWhat Makes Good In-Context Examples for GPT-$3$?
Liu, J., Shen, D., Zhang, Y., Dolan, B., Carin, L., & Chen, W. (2021) · arXiv · doi:10.48550/arxiv.2101.06804 · Cited by 148
Can language models learn from explanations in context?
Lampinen, A., Dasgupta, I., Chan, S., Mathewson, K., Tessler, M., Creswell, A., McClelland, J., Wang, J., & Hill, F. (2022) · Findings of the Association for Computational Linguistics: EMNLP 2022 · doi:10.18653/v1/2022.findings-emnlp.38 · Cited by 142
Thinking as the control of imagination: a conceptual framework for goal-directed systems
Pezzulo, G., & Castelfranchi, C. (2009) · Psychological Research Psychologische Forschung · doi:10.1007/s00426-009-0237-z · Cited by 141
Self-citationWhy do you fear the bogeyman? An embodied predictive coding model of perceptual inference
Pezzulo, G. (2014) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-013-0227-x · Cited by 128
Self-citationThe Hippocampus Maps Concept Space, Not Feature Space
Theves, S., Fernández, G., & Doeller, C. F. (2020) · Journal of Neuroscience · doi:10.1523/jneurosci.0494-20.2020 · Cited by 124
Faith and Fate: Limits of Transformers on Compositionality
Dziri, N., Lu, X., Sclar, M., Li, X. L., Jiang, L., Lin, B. Y., West, P., Bhagavatula, C., Bras, R. L., Hwang, J. D., et al. (2023) · arXiv · Cited by 124
The evolution of brain architectures for predictive coding and active inference
Pezzulo, G., Parr, T., & Friston, K. (2022) · Philosophical Transactions of the Royal Society B · doi:10.1098/rstb.2020.0531 · Cited by 117
Self-citationPath integrals, particular kinds, and strange things
Friston, K., Da Costa, L., Sakthivadivel, D. A. R., Heins, C., Pavliotis, G. A., Ramstead, M., & Parr, T. (2023) · Physics of Life Reviews · doi:10.1016/j.plrev.2023.08.016 · Cited by 113
Self-citationRecurrent dynamics in the cerebral cortex: Integration of sensory evidence with stored knowledge
Singer, W. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2101043118 · Cited by 110
Pezzulo, G., & Castelfranchi, C. (2007) · Cognitive Processing · doi:10.1007/s10339-007-0164-0 · Cited by 109
Self-citationGeorge, D., Rikhye, R. V., Gothoskar, N., Guntupalli, J. S., Dedieu, A., & Lázaro-Gredilla, M. (2021) · Nature Communications · doi:10.1038/s41467-021-22559-5 · Cited by 109
Generative models, linguistic communication and active inference
Friston, K. J., Parr, T., Yufik, Y., Sajid, N., Price, C. J., & Holmes, E. (2020) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2020.07.005 · Cited by 108
Self-citationShaking the foundations: delusions in sequence models for interaction and controlPreprint
Ortega, P. A., Kunesch, M., Delétang, G., Genewein, T., Grau-Moya, J., Veness, J., Buchli, J., Degrave, J., Piot, B., Pérolat, J., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.10819 · Cited by 100
The feasibility of artificial consciousness through the lens of neuroscience
Aru, J., Larkum, M. E., & Shine, J. M. (2023) · Trends in Neurosciences · doi:10.1016/j.tins.2023.09.009 · Cited by 98
Laying down a forking path: tensions between enaction and the free energy principle
Di Paolo, E., Thompson, E., & Beer, R. (2022) · Philosophy and the Mind Sciences · doi:10.33735/phimisci.2022.9187 · Cited by 94
Bayesing qualia: consciousness as inference, not raw datum
Clark, A., Friston, K. J., & Wilkinson, S. (2019) · Journal of Consciousness Studies · Cited by 86
Self-citationHuman visual exploration reduces uncertainty about the sensed world
Mirza, M. B., Adams, R. A., Mathys, C., & Friston, K. J. (2018) · PLOS ONE · doi:10.1371/journal.pone.0190429 · Cited by 85
Self-citationImplicit Representations of Meaning in Neural Language Models
Li, B. Z., Nye, M., & Andreas, J. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.143 · Cited by 84
Simulation as an Engine of Physical Scene Understanding
Battaglia, P., Hamrick, J. B., & Tenenbaum, J. B. (2013) · PsycEXTRA Dataset · doi:10.1037/e633262013-904 · Cited by 81
Stoianov, I. P., Maisto, D., & Pezzulo, G. (2022) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2022.102329 · Cited by 81
Self-citationEmergence of Cognition from Action
Buzsáki, G., Peyrache, A., & Kubie, J. (2014) · Cold Spring Harbor Symposia on Quantitative Biology · doi:10.1101/sqb.2014.79.024679 · Cited by 76
Tschantz, A., Baltieri, M., Seth, A. K., & Buckley, C. L. (2020) · Sussex Research Online (University of Sussex) · Cited by 69
Jansen, P. A. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.395 · Cited by 69
Taniguchi, T., Murata, S., Suzuki, M., Ognibene, D., Lanillos, P., Ugur, E., Jamone, L., Nakamura, T., Ciria, A., Lara, B., et al. (2023) · Advanced Robotics · doi:10.1080/01691864.2023.2225232 · Cited by 66
Self-citationCan Language Models Encode Perceptual Structure Without Grounding? A Case Study in Color
Abdou, M., Kulmizev, A., Hershcovich, D., Frank, S., Pavlick, E., & Søgaard, A. (2021) · Proceedings of the 25th Conference on Computational Natural Language Learning · doi:10.18653/v1/2021.conll-1.9 · Cited by 64
Active Inference in Robotics and Artificial Agents: Survey and Challenges
Lanillos, P., Meo, C., Pezzato, C., Meera, A. A., Baioumy, M., Ohata, W., Tschantz, A., Millidge, B., Wisse, M., Buckley, C. L., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2112.01871 · Cited by 55
Sequential Neural Networks as Automata
Merrill, W. (2019) · Proceedings of the Workshop on Deep Learning and Formal Languages: Building Bridges · doi:10.18653/v1/w19-3901 · Cited by 52
Safron, A. (2021) · Entropy · doi:10.3390/e23060783 · Cited by 52
Consciousness as Generative Entanglement
Clark, A., & Journal of Philosophy Inc. (2019) · The Journal of Philosophy · doi:10.5840/jphil20191161241 · Cited by 50
Self-citationWhere are we in the search for an Artificial Visual Cortex for Embodied Intelligence?
Majumdar, A., Yadav, K., Arnaud, S., Ma, Y. J., Chen, C., Silwal, S., Jain, A., Berges, V.-P., Abbeel, P., Malik, J., et al. (2023) · arXiv · doi:10.48550/arxiv.2303.18240 · Cited by 49
Where are we in the search for an artificial visual cortex for embodied intelligence
Majumdar, A., Yadav, K., Arnaud, S., Ma, J., Chen, C., Silwal, S., Jain, A., Berges, V.-P., Wu, T., Vakil, J., et al. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-0031 · Cited by 49
Planning at decision time and in the background during spatial navigation
Pezzulo, G., Donnarumma, F., Maisto, D., & Stoianov, I. (2019) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2019.04.009 · Cited by 46
Self-citationModel-Based Approaches to Active Perception and Control
Pezzulo, G., Donnarumma, F., Iodice, P., Maisto, D., & Stoianov, I. (2017) · Entropy · doi:10.3390/e19060266 · Cited by 45
Self-citationModel-based spatial navigation in the hippocampus-ventral striatum circuit: A computational analysis
Stoianov, I. P., Pennartz, C. M. A., Lansink, C. S., & Pezzulo, G. (2018) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006316 · Cited by 45
Self-citationCognitive effort and active inference
Parr, T., Holmes, E., Friston, K. J., & Pezzulo, G. (2023) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2023.108562 · Cited by 45
Self-citationAdapting Pretrained Vision-Language Foundational Models to Medical Imaging Domains
Chambon, P., Blüthgen, C., Langlotz, C. P., & Chaudhari, A. S. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2210.04133 · Cited by 41
Pennartz, C. M. A. (2022) · Behavioural Brain Research · doi:10.1016/j.bbr.2022.113969 · Cited by 40
Meaning from movement and stillness: Signatures of coordination dynamics reveal infant agency
Sloan, A., Jones, N. A., & Kelso, J. A. S. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2306732120 · Cited by 37
Understanding, Explanation, and Active Inference
Parr, T., & Pezzulo, G. (2021) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2021.772641 · Cited by 36
Self-citationWong, L., Grand, G., Lew, A. K., Goodman, N. D., Mansinghka, V. K., Andreas, J., & Tenenbaum, J. B. (2023) · arXiv · doi:10.48550/arxiv.2306.12672 · Cited by 36
Safron, A., Çatal, O., & Verbelen, T. (2022) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2022.787659 · Cited by 35
Pezzulo, G. (2011) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2011.2166261 · Cited by 34
Self-citationLinearly Mapping from Image to Text Space
Merullo, J., Castricato, L., Eickhoff, C., & Pavlick, E. (2022) · arXiv · doi:10.48550/arxiv.2209.15162 · Cited by 34
Integrated world modeling theory expanded: Implications for the future of consciousness
Safron, A. (2022) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2022.642397 · Cited by 34
Learning action-oriented models through active inferencePreprint
Tschantz, A., Seth, A. K., & Buckley, C. L. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/764969 · Cited by 28
Active inference tree search in large POMDPs
Maisto, D., Gregoretti, F., Friston, K. J., & Pezzulo, G. (2025) · Neurocomputing · doi:10.1016/j.neucom.2024.129319 · Cited by 25
Self-citationActive inference through whiskers
Mannella, F., Maggiore, F., Baltieri, M., & Pezzulo, G. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.08.037 · Cited by 25
Self-citationDoes Vision-and-Language Pretraining Improve Lexical Grounding?
Yun, T., Sun, C., & Pavlick, E. (2021) · Findings of the Association for Computational Linguistics: EMNLP 2021 · doi:10.18653/v1/2021.findings-emnlp.370 · Cited by 22
The Chess Transformer: Mastering Play using Generative Language Models
Noever, D. A., Ciolino, M., & Kalin, J. D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.04057 · Cited by 20
The secret life of predictive brains: what's spontaneous activity for?Preprint
Pezzulo, G., Zorzi, M., & Corbetta, M. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/qus3h · Cited by 19
Self-citationFitting elephants in modern machine learning by statistically consistent interpolation
Mitra, P. P. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00345-8 · Cited by 18
Active inference through whiskersPreprint
Mannella, F., Maggiore, F., Baltieri, M., et al. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.07.16.452665 · Cited by 2
(1977) · doi:10.4324/9781315740218-18
Research works printed but not linked: 6
- [9]9. Parr, T. et al. (2022) Active Inference: The Free Energy Principle in Mind, Brain, and Behavior , MIT Press
- [19]19. Barsalou, L.W. (2008) Grounded cognition. Annual Review of Psychology 59, 617-645
- [24]24. Ashby, W.R. (1952) Design for a brain , ix, Wiley
- [30]30. Hohwy, J. (2013) The predictive mind , Oxford University Press
- [52]52. Cisek, P. (1999) Beyond the computer metaphor: Behaviour as interaction. Journal of Consciousness Studies 6, 11-12
- [55]55. Bender, E.M. et al. (2021) On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? in Proceedings of the 2021 ACM conference on fairness, accountability, and
Cited by
Active inference as a theory of sentient behavior
Pezzulo, G., Parr, T., & Friston, K. (2024) · Biological Psychology · doi:10.1016/j.biopsycho.2023.108741 · Cited by 109
Self-citationBellini-Leite, S. C. (2023) · Adaptive Behavior · doi:10.1177/10597123231206604 · Cited by 34
Di Paolo, L. D., White, B., Guénin-Carlut, A., Constant, A., & Clark, A. (2024) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2023.0148 · Cited by 14
Self-citationChemical Systems for Wetware Artificial Life: Selected Perspectives in Synthetic Cell Research
Stano, P. (2023) · International Journal of Molecular Sciences · doi:10.3390/ijms241814138 · Cited by 14
ChatGPT, extended: large language models and the extended mind
Smart, P., Clowes, R., & Clark, A. (2025) · Synthese · doi:10.1007/s11229-025-05046-y · Cited by 13
Self-citation
Metadata
- Authors
- Pezzulo, G., Parr, T., Cisek, P., Clark, A., & Friston, K.
- Affiliations
- National Research Council (IT)
- University of Oxford (GB)
- Université de Montréal (CA)
- University of Sussex (GB)
- Wellcome Centre for Human Neuroimaging (GB)
- Corresponding author
- Pezzulo, Giovanni
- Publisher
- Center for Open Science
- Published
- 2023-06-08
- OpenAlex
- W4380084928
- Cited by
- 8
- References
- 154
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 3 · 2023: 3
- Type
- posted content
- Language
- en
- Open access
- green
- doi.org
- Locations
- UCL Discovery (University College London) (submittedVersion, cc-by)
- Figshare (submittedVersion, cc-by)
- PsyArXiv (OSF Preprints) (submittedVersion)
- PsyArXiv (OSF Preprints) (submittedVersion, cc-by)
- Funders
- European Commission (IR0000011, HORIZON2020, 951631, 952215, 945539)
- Horizon 2020 Framework Programme (952215, #945539, 820213)
- Natural Sciences and Engineering Research Council of Canada
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Embodied and Extended Cognition
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Cybernetics and Technology in Society
- Social Sciences › Arts and Humanities › Philosophy › Philosophy and Theoretical Science
- Keywords
- active inference, generative models, embodied agents, sensorimotor interaction, meaning generation, understanding, generative AI, perception and action
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.