PreprintCited by 15Philosophy and Theoretical SciencePsychiatry, Mental Health, NeuroscienceCybernetics and Technology in Society

How To Build Conscious Machines

Open access
Bennett, Michael Timothy·2025

Abstract

How to build a conscious machine? For that matter, what is consciousness? Why is my world made of qualia like the colour red or the smell of coffee? Are these fundamental building blocks of reality, or can I break them down into something more basic? If so, that suggests qualia are like an abstraction layer in a computer. A simplification. Some say simplicity is the key to intelligence. Systems which prefer simpler models need fewer resources to adapt. They ``generalise'' better. Yet simplicity is a property of form. Generalisation is of function. Any correlation between them depends on interpretation. In theory there could be no correlation and yet in practice, there is. Why? Software depends on the hardware that interprets it. It is made of abstraction layers, each interpreted by the layer below. I argue hardware is just another layer. As software is interpreted by hardware, hardware is by physics. There is no way to know where the stack ends. Hence I formalise an infinite stack of layers to describe all possible worlds. Each layer embodies policies that constrain possible worlds. A task is the worlds in which it is completed. Adaptive systems are abstraction layers are polycomputers, and a policy simultaneously completes more than one task. When the environment changes state, a subset of tasks are completed. This is the cosmic ought from which goal-directed behaviour emerges (e.g. natural selection). ``Simp-maxing'' systems prefer simpler policies, and ``w-maxing'' systems choose weaker constraints on possible worlds. I show w-maxing maximises generalisation, proving an upper bound on intelligence. I show all policies can take equally simple forms. Simp-maxing shouldn't work. To explain why it does, I invoke the Bekenstein bound. It means layers can use only finite subsets of all possible forms. Processes that favour generalisation (e.g. natural selection) will then make weak constraints take simple forms. I perform experiments. W-maxing generalises at 110-500% the rate of simp-maxing. I formalise how systems delegate adaptation down their stacks. I show w-maxing will simp-max if control is infinitely delegated. Biological systems are more adaptable than artificial because they delegate adaptation further down. They are bioelectric polycomputers. As they scale from cells to organs, they go from simple attraction and repulsion to rich tapestries of valence. These tapestries classify objects and properties that cause valence, which I call causal-identities. I propose the psychophysical principle of causality arguing qualia are tapestries of valence. A vast orchestra of cells play a symphony of valence, classifying and judging. A system can learn 1ST, 2ND and higher order tapestries for itself. Phenomenal ``what it is like'' consciousness begins at 1ST-order-self. Conscious access for communication begins at 2ND-order-selves, making philosophical zombies impossible. This links intelligence and consciousness. So why do we have the qualia we do? A stable environment is a layer where systems can w-max without simp-maxing. Stacks can then grow tall and complex. This may shed light on the origins of life and the Fermi paradox. Diverse intelligences could be everywhere, but we cannot perceive them because they do not meet preconditions for a causal-identity afforded by our stack. I conclude by integrating all this to explain how to build a conscious machine, and a problem I call The Temporal Gap.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.31237/osf.io/wehmg_v1

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Some proposed indicators for AI consciousness lean on behavior that looks like a stable self model, including self-report, memory, and narrative continuity.

    “Some proposed indicators for AI consciousness therefore lean on behavior that looks like a stable self model.This includes self-report, memory, and narrative continuity (Bennett 2023a(Bennett , 2025(Bennett , 2026b(Bennett , 2023b)).”

    From Time, Identity and Consciousness in Language Model Agents (2026) · cites this paper as Bennett 2025

    In “3. Self Awareness” (page unavailable), the paper links self-awareness to contents available for report; “THE SELF” ties a first-order self to past actions in memory, and “OPTION 1: CONSCIOUSNESS IS AT A POINT IN TIME” discusses an internal narrative. It does not present self-report, memory, and narrative continuity as a set of behavioral indicators for AI consciousness. In “THE NORMIES,” it cautions that a machine could behave intelligently and have proposed orders of self yet still seem to lack consciousness. (LLM, conf=0.84)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 174

  1. Chris R. Reid, David J T Sumpter, and Madeleine Beekman. Optimisation in a natural system: Argentine ants solve the towers of hanoi. Journal of Experimental Biology, 214(1):50-58, jan 2011 any one of its parts, and the parts become less intelligent the more top-down control is exerted upon them as the colony is scaled up 504 . 504
  2. Daniel W. McShea. A complex- ity drain on cells in the evolution of multicellularity. Evolution, 56(3):441- 452, 03 2002. ISSN 0014-3820. doi: 10.1111/j.0014-3820.2002.tb01357.x. URL https://doi.org/10.1111/ j.0014-3820.2002.tb01357.x; and Jordi Delgado and Ricard V. Solé. Collective-induced computation. Phys. Rev. E, 55:2338-2344, Mar 1997. doi: 10.1103/PhysRevE.55.2338. URL https://link.aps.org/doi/10.1103/ PhysRevE.55.2338 511 · DOI
  3. Keisuke Suzuki and Takashi Ikegami. Spatial-pattern-induced evolution of a self-replicating loop network. Artificial Life, 12(4):461-485, 2006; and Takashi Ikegami and Keisuke Suzuki. From a homeostatic to a homeodynamic self. Biosystems, 91(2):388-400, 2008 of adaptive material, such as self organising nanites 512 , then it could 512
  4. and B. Paroli, G. Martini, M.A.C. Potenza, M. Siano, M. Mirigliano, and P. Milani. Solving classification tasks by a receptron based on nonlinear optical speckle fields. Neural Networks, 166: 634-644, 2023 construct stacks highly specialised to the problems for which it is employed. Then, it might be as generally intelligent as a human. 552 Fritz Heider and Marianne Sim- mel. An experimental study of apparent behavior. The Amer- ican Journal of Psychology, 57(2): 243-259, apr 1944. URL https: //www.jstor.org/stable/1416950;
  5. Nicholas Epley, Adam Waytz, and John T. Cacioppo. On seeing human: A three-factor theory of anthropomor- phism. Psychological Review, 114(4): 864-886, 2007. doi: 10.1037/0033- 295X.114.4.864. URL https://doi.org/ 10.1037/0033-295X.114.4.864; and Esmeralda G. Urquiza-Haas and Kurt Kotrschal. The mind behind anthropo- morphic thinking: attribution of mental states to other species. Animal Behaviour, 109:167-176, 2015 575 · DOI · Paper page
  6. Patrick Hammer and Tony Lofthouse. 'opennars for applica- tions': Architecture and control. In Ben Goertzel, Aleksandr I. Panov, Alexey Potapov, and Roman Yampolskiy, edi- tors, Artificial General Intelligence, pages 193-204, Cham, 2020. Springer Nature; and Kristinn R Thorisson, Eric Nivel, Bas Steunebrink, Helgi P. Helgason, Giovanni Pezzulo, Ricardo Sanz, Jurgen Schmidhuber, Harris Dindo, Manuel Rodriguez, Antonio Chella, Gudberg K Jonsson, Dimitri Ognibene, and Carlos Corbato-Hernandez. Autonomous acquisition of situated natural commu- nication. Intl. J. Comp. Sci.& Info. Sys., 2014 576
  7. Lenore Blum and Manuel Blum. A theory of consciousness from a theoretical computer science per- spective: Insights from the con- scious turing machine. Proceedings of the National Academy of Sciences, 119(21):e2115934119, 2022. doi: 10.1073/pnas.2115934119. URL https://www.pnas.org/doi/abs/ 10.1073/pnas.2115934119; and Pei Wang. A Constructive Explanation of Consciousness and its Implementation. World Scientific, 2023 Bibliography · DOI · Paper page
  8. Salvatore J. Agosta, Niklas Janz, and Daniel R. Brooks. How specialists can be generalists: resolving the "parasite para- dox" and implications for emerging infectious disease. Zoolo- gia (Curitiba), 27(2):151-162, Apr 2010. ISSN 1984-4670. doi: 10.1590/S1984-46702010000200001. URL https://doi.org/10. 1590/S1984-46702010000200001. · DOI · Paper page
  9. John R. Anderson, Daniel Bothell, Michael D. Byrne, Scott Douglass, Christian Lebiere, and Yulin Qin. An integrated theory of the mind. Psychological Review, 2004. Because apparently six authors are needed to figure out how your brain works.
  10. Michael F. Barnsley. Fractals Everywhere. Academic Press, second edition edition, 2012.
  11. Andrew B. Barron and Colin Klein. What insects can tell us about the origins of consciousness. Proceedings of the National Academy of Sciences, 2016.
  12. Martha Ann Bell and Kirby Deater-Deckard. Biological systems and the development of self-regulation: Integrating behavior, genet- ics, and psychophysiology. Journal of developmental and behavioral pediatrics, 2007.
  13. Emily M. Bender, Timnit Gebru, Angelina McMillan-Major, and Shmargaret Shmitchell. On the dangers of stochastic parrots: Can language models be too big? In Proceedings of the 2021 ACM Con- ference on Fairness, Accountability, and Transparency, FAccT '21, page 610-623, New York, NY, USA, 2021. Association for Computing Machinery. ISBN 9781450383097.
  14. Michael Timothy Bennett. Symbol emergence and the solutions to any task. In Artificial General Intelligence. Springer Nature, 2022a.
  15. Michael Timothy Bennett. Compression, the fermi paradox and artificial super-intelligence. In Artificial General Intelligence. Springer Nature, 2022b.
  16. Michael Timothy Bennett. Computable Artificial General Intelligence. Under Review, 2022c.
  17. Michael Timothy Bennett. The optimal choice of hypothesis is the weakest, not the shortest. In Artificial General Intelligence. Springer Nature, 2023a.
  18. Michael Timothy Bennett. Emergent causality and the foundation of consciousness. In Artificial General Intelligence. Springer Nature, 2023b.
  19. Michael Timothy Bennett. On the computation of meaning, language models and incomprehensible horrors. In Artificial General Intelli- gence. Springer Nature, 2023c.
  20. Michael Timothy Bennett. Computational dualism and objective superintelligence. In Artificial General Intelligence. Springer Nature, 2024a.
  21. Michael Timothy Bennett. Is complexity an illusion? In Artificial General Intelligence. Springer Nature, 2024b.
  22. Michael Timothy Bennett. Lies, damned lies, and the orthogonality thesis. Preprint, 2025d.
  23. Michael Timothy Bennett. A formal theory of optimal learning with experimental results. IJCAI, 2025f.
  24. Michael Timothy Bennett and Yoshihiro Maruyama. Philosophical specification of empathetic ethical artificial intelligence. IEEE Transactions on Cognitive and Developmental Systems, 14(2):292-300, 2022a.
  25. Michael Timothy Bennett and Yoshihiro Maruyama. The artificial scientist: Logicist, emergentist, and universalist approaches to arti- ficial general intelligence. In Artificial General Intelligence. Springer Nature, 2022b.
  26. Michael Timothy Bennett and Ricard Solé. Does suspended anima- tion kill consciousness? Under review, 2025.
  27. Michael Timothy Bennett, Sean Welsh, and Anna Ciaunica. Why Is Anything Conscious? Preprint, accepted to and presented at ASSC27 and MoC5, 2024.
  28. Lenore Blum and Manuel Blum. A theory of consciousness from a theoretical computer science perspective: Insights from the con- scious turing machine. Proceedings of the National Academy of Sci- ences, 119(21):e2115934119, 2022. doi: 10.1073/pnas.2115934119. URL https://www.pnas.org/doi/abs/10.1073/pnas.2115934119. · DOI · Paper page
  29. Anselm Blumer, Andrzej Ehrenfeucht, David Haussler, and Man- fred K. Warmuth. Occam's razor. Information Processing Letters, 1987.
  30. Piotr Boltuc. The engineering thesis in machine consciousness. Techné: Research in Philosophy and Technology, 2012.
  31. Joshua Bongard and Michael Levin. There's plenty of room right here: Biological systems as evolved, overloaded, multi-scale ma- chines. Biomimetics, 8(1), 2023.
  32. Nick Bostrom. The superintelligent will: Motivation and instrumental rationality in advanced artificial agents. Minds and Machines, 22(2): 71-85, May 2012. ISSN 1572-8641. doi: 10.1007/s11023-012-9281-3. URL https://doi.org/10.1007/s11023-012-9281-3. · DOI · Paper page
  33. Nick Bostrom. Superintelligence: Paths, Dangers, Strategies. Oxford University Press, Oxford, UK, 2014. ISBN 9780199678112.
  34. Richard Brown, Hakwan Lau, and Joseph E. LeDoux. Understanding the higher-order approach to consciousness. Trends in Cognitive Sciences, 23(9):754-768, 2019. doi: 10.1016/j.tics.2019.06.009. · DOI · Paper page
  35. Tom B Brown et al. Language models are few-shot learners. In Proceedings of the 34th International Conference on Neural Information Processing Systems, NIPS '20, NY, 2020.
  36. Scott Camazine, Nigel Franks, J Sneyd, Eric Bonabeau, Jean-Louis Deneubourg, and Guy Theraulaz. Self-Organization in Biological Systems. Princeton University Press, NJ, 2001.
  37. Gregory J. Chaitin. On the length of programs for computing finite binary sequences. J. ACM, 1966.
  38. D. J. Chalmers. The conscious mind: In search of a fundamental theory. Oxford University Press, 1996.
  39. David Chalmers. Facing up to the problem of consciousness. Journal of Consciousness Studies, 1995.
  40. Andy Clark. Being There: Putting Brain, Body, and World Together Again. MIT Press, 1997.
  41. Joel Crampton, Celine H. Frère, and Dominique A. Potvin. Aus- tralian magpies gymnorhina tibicen cooperate to remove track- ing devices. Australian Field Ornithology, 39:7-11, 2022. doi: http://dx.doi.org/10.20938/afo39007011. URL https://afo. birdlife.org.au/afo/index.php/afo/issue/view/221. · DOI
  42. Jordi Delgado and Ricard V. Solé. Collective-induced computa- tion. Phys. Rev. E, 55:2338-2344, Mar 1997. doi: 10.1103/Phys- RevE.55.2338. URL https://link.aps.org/doi/10.1103/ PhysRevE.55.2338. · DOI
  43. David Deutsch. The Fabric of Reality: The Science of Parallel Universes- and Its Implications. Penguin Books, 1997.
  44. Jacob Devlin et al. BERT: Pre-training of deep bidirectional trans- formers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Compu- tational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). Association for Computational Linguistics, 2019.
  45. Hubert L. Dreyfus. Why heideggerian ai failed and how fixing it would require making it more heideggerian. Philosophical Psychol- ogy, 20(2):247-268, 2007. doi: 10.1080/09515080701239510. URL https://doi.org/10.1080/09515080701239510. · DOI
  46. Stefan Edelkamp and Stefan Schrödl. Chapter 9 -distributed search. In Stefan Edelkamp and Stefan Schrödl, editors, Heuristic Search, pages 369-427.
  47. Morgan Kaufmann, San Francisco, 2012.
  48. Nicholas Epley, Adam Waytz, and John T. Cacioppo. On seeing human: A three-factor theory of anthropomorphism. Psychological Review, 114(4):864-886, 2007. doi: 10.1037/0033-295X.114.4.864. URL https://doi.org/10.1037/0033-295X.114.4.864. · DOI · Paper page
  49. Ramon Ferrer i Cancho and Ricard Solé. The small world of human language. Proceedings of the Royal Society B: Biological Sciences, 268 (1482):2261-2265, 2001. doi: 10.1098/rspb.2001.1800. · DOI
  50. Chris Fields and Michael Levin and. Life, its origin, and its distribu- tion: a perspective from the conway-kochen theorem and the free energy principle. Communicative & Integrative Biology, 18(1):2466017, 2025.
  51. J. A. Fodor. Methodological solipsism considered as a research strat- egy in cognitive psychology. Behavioral and Brain Sciences, 3(1): 63-73, 1980. doi: 10.1017/S0140525X00001771. · DOI
  52. Jerry A. Fodor. The Language of Thought. Harvard University Press, 1975.
  53. Bas C. van Fraassen. Laws and Symmetry. Oxford University Press, 1989.
  54. Sarah A. Fricke and Christina M. Frederick. The look- ing glass self: The impact of explicit self-awareness on self-esteem. Inquiries Journal, 9(10), 2017. URL http://www.inquiriesjournal.com/articles/1711/ the-looking-glass-self-the-impact-of-explicit-self-awareness-on-self-esteem. Accessed: 2025-05-03.
  55. M. Friedman and R.D. Friedman. Capitalism and Freedom. University of Chicago Press, 1962.
  56. Karl Friston. The free-energy principle: A unified brain theory? Nature Reviews Neuroscience, 11(2):127-138, 2010.
  57. Karl Friston. Life as we know it. Journal of The Royal Society Interface, 10(86):20130475, 2013. doi: 10.1098/rsif.2013.0475. URL https:// royalsocietypublishing.org/doi/abs/10.1098/rsif.2013.0475. · DOI · Paper page
  58. Karl Friston, Lancelot Da Costa, Dalton A.R. Sakthivadivel, Conor Heins, Grigorios A. Pavliotis, Maxwell Ramstead, and Thomas Parr. Path integrals, particular kinds, and strange things. Physics of Life Reviews, 47:35-62, 2023. ISSN 1571-0645. doi: https://doi.org/10.1016/j.plrev.2023.08.016. URL https://www. sciencedirect.com/science/article/pii/S1571064523001094. · DOI
  59. Thomas Fuchs. Ecology of the Brain: The phenomenology and biology of the embodied mind. Oxford University Press, 2017.
  60. Ashitha Ganapathy and Michael Timothy Bennett. Cybernet- ics and the future of work. In 2021 IEEE 21CW, 2021. doi: 10.1109/21CW48944.2021.9532561. · DOI
  61. Robin Gandy. Church's thesis and principles for mechanisms. In The Kleene Symposium. North-Holland, 1980.
  62. Ben Goertzel. The Hidden Pattern: A Patternist Philosophy of Mind. BrownWalker Press, USA, 2006.
  63. Ben Goertzel. Artificial general intelligence: Concept, state of the art. Journal of Artificial General Intelligence, 5(1):1-48, 2014.
  64. Ben Goertzel. Generative ai vs. agi: The cognitive strengths and weaknesses of modern llms, 2023. URL https://arxiv.org/abs/ 2309.10371.
  65. Paul Grice. Meaning. The Philosophical Review, 66(3):377-388, 1957.
  66. Paul Grice. Utterer's meaning and intention. The Philosophical Review, 78(2):147-177, 1969.
  67. Hermann Haken. Advanced Synergetics: Instability Hierarchies of Self- Organizing Systems and Devices. Springer-Verlag, Berlin, 1983.
  68. Patrick Hammer and Tony Lofthouse. 'opennars for applications': Architecture and control. In Ben Goertzel, Aleksandr I. Panov, Alexey Potapov, and Roman Yampolskiy, editors, Artificial General Intelligence, pages 193-204, Cham, 2020. Springer Nature.
  69. Gilbert H. Harman. The inference to the best explanation. The Philo- sophical Review, 74(1):88-95, 1965. ISSN 00318108, 15581470. URL http://www.jstor.org/stable/2183532.
  70. Stevan Harnad. The symbol grounding problem. Physica D: Non- linear Phenomena, 42(1):335-346, 1990. ISSN 0167-2789. doi: https://doi.org/10.1016/0167-2789(90)90087-6. URL https:// www.sciencedirect.com/science/article/pii/0167278990900876. · DOI · Paper page
  71. Peter E. Hart, Nils J. Nilsson, and Bertram Raphael. A formal basis for the heuristic determination of minimum cost paths. IEEE Transactions on Systems Science and Cybernetics, 4(2):100-107, 1968. doi: 10.1109/TSSC.1968.300136. · DOI · Paper page
  72. FA Hayek. The use of knowledge in society. American Economic Review, 35(4), 1945.
  73. Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Deep residual learning for image recognition. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 770-778, 2016.
  74. Fritz Heider and Marianne Simmel. An experimental study of appar- ent behavior. The American Journal of Psychology, 57(2):243-259, apr 1944. URL https://www.jstor.org/stable/1416950. how to build conscious machines 207
  75. C. Horsman, S. Stepney, R. C. Wagner, and V. M. Kendon. When does a physical system compute? Proceedings of the Royal Society A, 470 (2169):20140182, 2014.
  76. David A. Huffman. A method for the construction of minimum- redundancy codes. Proceedings of the IRE, 1952.
  77. Marcus Hutter. Universal Algorithmic Intelligence: A Mathematical Top→Down Approach, pages 227-290. Springer Berlin Heidelberg, Berlin, Heidelberg, 2007.
  78. Marcus Hutter. Universal Artificial Intelligence: Sequential Decisions Based on Algorithmic Probability. Springer Nature, Heidelberg, 2010.
  79. Marcus Hutter, David Quarel, and Elliot Catt. An Introduction to Universal Artificial Intelligence. Chapman and Hall/CRC, 1st edition, 2024. doi: 10.1201/9781003460299. · DOI
  80. Takashi Ikegami. Simulating active perception and mental imagery with embodied chaotic itinerancy. Journal of Consciousness Studies, 14(7):111-125, 2007.
  81. Takashi Ikegami and Keisuke Suzuki. From a homeostatic to a home- odynamic self. Biosystems, 91(2):388-400, 2008.
  82. Tony Ingesson. The Politics of Combat: The Political and Strategic Impact of Tactical-Level Subcultures, 1939-1995. Doctoral thesis (monograph), Department of Political Science, Lund University, 2016.
  83. Friston K., FitzGerald T., Rigoli F., Schwartenbeck P., O. Doherty J., and Pezzulo G. Active inference and learning. Neurosci Biobehav Rev., pages 862-879, 2016.
  84. Stuart A. Kauffman. The Origins of Order: Self-Organization and Selec- tion in Evolution. Oxford University Press, 1993.
  85. Henry Kautz and Bart Selman. Planning as satisfiability. In IN ECAI- 92, pages 359-363, New York, 1992. Wiley.
  86. Scott Kelso. Dynamic Patterns: The Self-Organization of Brain and Behav- ior. MIT Press, Boston, 1997.
  87. M. Khajehnejad, F. Habibollahi, A. Paul, A. Razi, and B. J. Kagan. Biological neurons compete with deep reinforcement learning in sample efficiency in a simulated gameworld. arXiv preprint arXiv:2405.16946, 2024. · arXiv
  88. Jaegwon Kim. Philosophy of Mind. Routledge, New York, 3rd ed. edition, 2011.
  89. David Kirk. Nvidia cuda software and gpu parallel comput- ing architecture. In Proceedings of the 6th International Sympo- sium on Memory Management, ISMM '07, page 103-104, New York, NY, USA, 2007. Association for Computing Machinery. ISBN 9781595938930. doi: 10.1145/1296907.1296909. URL https://doi.org/10.1145/1296907.1296909. · DOI
  90. A.N. Kolmogorov. On tables of random numbers. Sankhya: The Indian Journal of Statistics, A:369-376, 1963.
  91. Stefanie J Krauth, Jean T Coulibaly, Stefanie Knopp, Mahamadou Traoré, Eliézer K N'Goran, and Jürg Utzinger. An in-depth analysis of a piece of shit: distribution of Schistosoma mansoni and hook- worm eggs in human stool. PLoS Neglected Tropical Diseases, 6(12): e1969, 12 2012. ISSN 1935-2727. doi: 10.1371/journal.pntd.0001969. URL https://doi.org/10.1371/journal.pntd.0001969. · DOI
  92. Sam Kriegman, Douglas Blackiston, Michael Levin, and Josh Bon- gard. A scalable pipeline for designing reconfigurable organisms. Proc Natl Acad Sci U S A, 117(4):1853-1859, January 2020.
  93. Alex Krizhevsky et al. Imagenet classification with deep convolu- tional neural networks. Commun. ACM, 2017.
  94. John E. Laird. The Soar Cognitive Architecture. MIT Press, MA, 2012.
  95. Brenden M. Lake, Tomer D. Ullman, Joshua B. Tenenbaum, and Samuel J. Gershman. Building machines that learn and think like people. Behavioral and Brain Sciences, 40, 2017. doi: 10.1017/S0140525X16001837. · DOI · Paper page
  96. R. Landauer. Irreversibility and heat generation in the computing process. IBM Journal of Research and Development, 5(3):183-191, 1961.
  97. Shane Legg. Machine Super Intelligence. PhD thesis, Uni. of Lugano, 2008.
  98. Shane Legg and Marcus Hutter. Universal intelligence: A definition of machine intelligence. Minds and Machines, pages 391-444, 2007.
  99. Jan Leike and Marcus Hutter. Bad universal priors and notions of optimality. Proceedings of The 28th Conference on Learning Theory, in Proceedings of Machine Learning Research, pages 1244-1259, 2015.
  100. L. A. Levin. Universal sequential search problems. Problems of Infor- mation Transmission, 9(3):265-266, 1973.
  101. Ming Li and Paul M. B. Vitányi. An Introduction to Kolmogorov Com- plexity and its Applications (Third Edition). Springer Nature, New York, 2008.
  102. Seth Lloyd. Ultimate physical limits to computation. Nature, 406 (6799):1047-1054, 2000.
  103. Scott M. Lundberg and Su-In Lee. A unified approach to interpreting model predictions. In Proceedings of the 31st International Conference on Neural Information Processing Systems, NIPS'17, NY, 2017.
  104. Kingson Man and Antonio R. Damasio. Homeostasis and soft robotics in the design of feeling machines. Nature Machine Intel- ligence, 1:446 -452, 2019. URL https://api.semanticscholar.org/ CorpusID:208089594.
  105. John Maynard Smith. Evolution and the Theory of Games. Cambridge University Press, 1982.
  106. Daniel W. McShea. A complexity drain on cells in the evolution of multicellularity. Evolution, 56(3):441-452, 03 2002. ISSN 0014-3820. doi: 10.1111/j.0014-3820.2002.tb01357.x. URL https://doi.org/ 10.1111/j.0014-3820.2002.tb01357.x. · DOI
  107. Aaron Meurer, Christopher Smith, Mateusz Paprocki, Ondřej Čertík, Sergey Kirpichev, Matthew Rocklin, AMiT Kumar, Sergiu Ivanov, Jason Moore, Sartaj Singh, Thilina Rathnayake, Sean Vig, Brian Granger, Richard Muller, Francesco Bonazzi, Harsh Gupta, Shivam Vats, Fredrik Johansson, Fabian Pedregosa, and Anthony Scopatz. Sympy: Symbolic computing in python. PeerJ Computer Science, 3: e103, 01 2017. doi: 10.7717/peerj-cs.103. · DOI
  108. Qingwei Mi and Tianhan Gao. Adaptive rubber-banding system of dynamic difficulty adjustment in racing games. ICGA Journal, 44(1): 18-38, 2022.
  109. Kevin J. Mitchell. Free Agents: How Evolution Gave Us Free Will. Princeton University Press, Princeton, NJ, 2023. ISBN 9780691226231.
  110. John Morrison. Perceptual confidence. Analytic Philosophy, 57(1): 15-48, 2016. doi: 10.1111/phib.12077. · DOI
  111. Thomas Nagel. What is it like to be a bat? Philosophical Review, 1974.
  112. T. Nakagaki, H. Yamada, and A. Toth. Maze-solving by an amoeboid organism. Nature, 407(6803):470, 2000.
  113. A. Newell and H. Simon. The logic theory machine-a complex infor- mation processing system. IRE Transactions on Information Theory, 2 (3):61-79, 1956.
  114. Georg Northoff. Unlocking The Brain, Vol. II: Consciousness, volume 2. Oxford University Press, USA, 2014.
  115. Laurent Orseau. Asymptotic non-learnability of universal agents with neural networks. In Joscha Bach, Ben Goertzel, and Matthew Iklé, editors, Artificial General Intelligence: 5th International Confer- ence, AGI 2012, pages 234-243, Berlin, Heidelberg, 2012. Springer Nature.
  116. Laurent Orseau and Mark Ring. Space-time embedded intelligence. In Joscha Bach, Ben Goertzel, and Matthew Iklé, editors, Artifi- cial General Intelligence, pages 209-218, Berlin, Heidelberg, 2012. Springer Berlin Heidelberg. ISBN 978-3-642-35506-6.
  117. Adam Paszke et al. Pytorch: An imperative style, high-performance deep learning library. In Proceedings of the 33rd International Confer- ence on Neural Information Processing Systems, 2019.
  118. Judea Pearl and Dana Mackenzie. The Book of Why: The New Science of Cause and Effect. Basic Books, Inc., New York, 1st edition, 2018.
  119. Elija Perrier and Michael Timothy Bennett. Position: Stop acting like language model agents are normal agents, 2025. URL https: //arxiv.org/abs/2502.10420.
  120. Gualtiero Piccinini. Physical Computation: A Mechanistic Account. Oxford University Press, UK, 2015.
  121. Gualtiero Piccinini and Corey Maley. Computation in Physical Sys- tems. In Edward N. Zalta, editor, The Stanford Encyclopedia of Philos- ophy. Stanford University, Stanford, Sum. 21 edition, 2021.
  122. I. Prigogine and R. Lefever. Theory of dissipative structures. In H. Haken, editor, Synergetics, pages 124-135. Vieweg+Teubner Verlag, 1973.
  123. Hilary Putnam. Psychological predicates. In William H. Capitan and Daniel Davy Merrill, editors, Art, mind, and religion, pages 37-48. University of Pittsburgh Press, 1967.
  124. W.V.O. Quine. Philosophy of Logic: Second Edition. Harvard University Press, Cambridge MA, 1986. ISBN 9780674665637. http://www. jstor.org/stable/j.ctvk12scx.
  125. Chris R. Reid, David J T Sumpter, and Madeleine Beekman. Opti- misation in a natural system: Argentine ants solve the towers of hanoi. Journal of Experimental Biology, 214(1):50-58, jan 2011.
  126. Marco Tulio Ribeiro, Sameer Singh, and Carlos Guestrin. "why should i trust you?": Explaining the predictions of any classifier. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD '16, page 1135-1144, New York, NY, USA, 2016. Association for Computing Machinery. ISBN 9781450342322.
  127. Jonathan Richens and Tom Everitt. Robust agents learn causal world models. In The Twelfth International Conference on Learning Represen- tations, 2024. URL https://openreview.net/forum?id=pOoKI3ouv1.
  128. David M. Rosenthal. Consciousness and Mind. Oxford University Press UK, New York, 2005.
  129. S. Russell and P. Norvig. Artificial intelligence: A modern approach, global edition 4th. Pearson, London, 2021.
  130. Stuart Russell. Artificial Intelligence and the Problem of Control, pages 19-24. Springer Nature, 2022.
  131. Stuart Russell and Peter Norvig. Artificial Intelligence: A Modern Approach, 4th Edition. Prentice Hall, Hoboken, 2020.
  132. L. J. Savage. The Foundations of Statistics. John Wiley & Sons, NY, USA, 1954.
  133. Jürgen Schmidhuber. Discovering neural nets with low kolmogorov complexity and high generalization capability. Neural Networks, 10 (5):857-873, 1997.
  134. Christian Schulte and Mats Carlsson. Chapter 14 -finite domain constraint programming systems. In Francesca Rossi, Peter van Beek, and Toby Walsh, editors, Handbook of Constraint Programming, Foundations of Artificial Intelligence. Elsevier, 2006.
  135. Thomas D. Seeley. When is self-organization used in biological sys- tems? The Biological Bulletin, 2002.
  136. Murray Shanahan. The brain's connective core and its role in an- imal cognition. Philosophical transactions of the Royal Society of London. Series B, Biological sciences, 367:2704-14, 10 2012. doi: 10.1098/rstb.2012.0128. · DOI · Paper page
  137. David Silver et al. Mastering the game of go with deep neural net- works and tree search. Nature, 529(7587):484-489, 2016.
  138. Gabriel Simmons. Comment on is complexity an illusion?, 2024. URL https://arxiv.org/abs/2411.08897. · arXiv
  139. JJC Smart. Sensations and brain processes. Philosophical Review, 68 (April):141-56, 1959. doi: 10.2307/2182164. · DOI · Paper page
  140. Elliott Sober. Ockham's Razors: A User's Manual. Cambridge Uni. Press, 2015. doi: 10.1017/CBO9781107705937. · DOI
  141. Ricard Solé and Luís F Seoane. Evolution of brains and computers: The roads not taken. Entropy, 24(5):665, 2022.
  142. R.J. Solomonoff. A formal theory of inductive inference. part i. Infor- mation and Control, 7(1):1-22, 1964.
  143. Ricard Solé, Melanie Moses, and Stephanie Forrest. Liquid brains, solid brains. Philosophical Transactions of the Royal Society B: Biologi- cal Sciences, 374(1774):20190040, 2019. doi: 10.1098/rstb.2019.0040. URL https://royalsocietypublishing.org/doi/abs/10.1098/ rstb.2019.0040. · DOI · Paper page
  144. J. Speaks. Theories of Meaning. In Edward N. Zalta, editor, The Stanford Encyclopedia of Philosophy. Stanford University, Stanford, Spring 2021 edition, 2021.
  145. Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. Dropout: A simple way to prevent neural networks from overfitting. Journal of Machine Learning Re- search, 15(56):1929-1958, 2014. URL http://jmlr.org/papers/v15/ srivastava14a.html.
  146. Luc Steels. Evolving grounded communication for robots. Trends in Cognitive Sciences, 7(7):308-312, 2003. ISSN 1364- 6613. doi: https://doi.org/10.1016/S1364-6613(03)00129-3. URL https://www.sciencedirect.com/science/article/pii/ S1364661303001293. · DOI
  147. Emma Strubell, Ananya Ganesh, and Andrew McCallum. Energy and policy considerations for deep learning in NLP. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Florence, Italy, 2019. Association for Computational Linguistics.
  148. Richard S Sutton and Andrew G Barto. Reinforcement learning: An introduction. MIT press, MA, 2018.
  149. Keisuke Suzuki and Takashi Ikegami. Spatial-pattern-induced evolu- tion of a self-replicating loop network. Artificial Life, 12(4):461-485, 2006.
  150. Jack W. Szostak. Functional information: Molecular messages. Nature, 423(6941):689-689, 06 2003. ISSN 1476-4687. doi: 10.1038/423689a. URL https://doi.org/10.1038/423689a. · DOI
  151. Tor Tarantola, Dharshan Kumaran, Peter Dayan, and Benedetto De Martino. Prior preferences beneficially influence social and non-social learning. Nature Communications, 8(1):817, 10 2017. ISSN 2041-1723. doi: 10.1038/s41467-017-00826-8. URL https://doi.org/10.1038/s41467-017-00826-8. The authors declare no competing financial interests. · DOI
  152. Evan Thompson. Mind in Life: Biology, Phenomenology, and the Sciences of Mind. Harvard University Press, Cambridge MA, 2007.
  153. Kristinn R. Thorisson. A New Constructivist AI: From Manual Methods to Self-Constructive Systems, pages 145-171. Atlantis Press, Paris, 2012.
  154. Giulio Tononi. An information integration theory of consciousness. BMC Neuroscience, 5(1):42, 2004.
  155. Giulio Tononi, Melanie Boly, Marcello Massimini, and Christof Koch. Integrated information theory: from consciousness to its physical substrate. Nature Reviews Neuroscience, 17(7):450-461, Jul 2016. ISSN 1471-0048. doi: 10.1038/nrn.2016.44. URL https://doi.org/10. 1038/nrn.2016. · DOI · Paper page
  156. Esmeralda G. Urquiza-Haas and Kurt Kotrschal. The mind behind anthropomorphic thinking: attribution of mental states to other species. Animal Behaviour, 109:167-176, 2015. · DOI · Paper page
  157. Ashish Vaswani et al. Attention is all you need. In Proceedings of the 31st International Conference on Neural Information Processing Systems, NIPS'17, NY, 2017.
  158. John Vervaeke and Leonardo Ferraro. Relevance, Meaning and the Cognitive Science of Wisdom. Springer Netherlands, Dordrecht, 2013a.
  159. Inman Harvey, Ann Cavoukian, George Tomko, Don Borrett, Hon Kwan, and Dimitrios Hatzinakos, editors, SmartData, NY, 2013b. Springer Nature.
  160. H. von Foerster. On self-organizing systems and their environments. In Self-Organizing Systems. Pergamon Press, 1960.
  161. Erich von Holst and Horst Mittelstaedt. Das reafferenzprinzip. Natur- wissenschaften, 37(20):464-476, Jan 1950. ISSN 1432-1904. doi: 10.1007/BF00622503. URL https://doi.org/10.1007/BF00622503. · DOI · Paper page
  162. David Wallace. The Emergent Multiverse: Quantum Theory according to the Everett Interpretation. Oxford University Press, 05 2012. ISBN 9780199546961. doi: 10.1093/acprof:oso/9780199546961.001.0001. URL https://doi.org/10.1093/acprof:oso/9780199546961.001. 0001. · DOI · Paper page
  163. P. Wang. Rigid Flexibility: The Logic of Intelligence. Applied Logic Series. Springer Nature, 2006.
  164. Pei Wang. On defining artificial intelligence. Journal of Artificial General Intelligence, 10(2):1-37, 2019.
  165. Pei Wang. A constructive explanation of consciousness. Journal of Artificial Intelligence and Consciousness, 07(02):257-275, 2020.
  166. Pei Wang. A Constructive Explanation of Consciousness and its Implemen- tation. World Scientific, 2023.
  167. Michael Wheeler. Martin Heidegger. In Edward N. Zalta, editor, The Stanford Encyclopedia of Philosophy. Stanford University, Fall 2020 edition, 2020.
  168. M. Wilson. Six views of embodied cognition. Psychonomic Bulletin & Review, 9(4):625-636, 2002.
  169. D.H. Wolpert and W.G. Macready. No free lunch theorems for opti- mization. IEEE Transactions on Evolutionary Computation, 1(1):67-82, 1997. doi: 10.1109/4235.585893. · DOI · Paper page
  170. Michael L. Wong, Carol E. Cleland, Daniel Arend, Stuart Bartlett, H. James Cleaves, Heather Demarest, Anirudh Prabhu, Jonathan I. Lunine, and Robert M. Hazen. On the roles of function and se- lection in evolving systems. Proceedings of the National Academy of Sciences, 120(43):e2310223120, 2023. doi: 10.1073/pnas.2310223120. URL https://www.pnas.org/doi/abs/10.1073/pnas.2310223120. · DOI
  171. Jason Yosinski, Jeff Clune, Yoshua Bengio, and Hod Lipson. How transferable are features in deep neural networks? In Proceedings of the 28th International Conference on Neural Information Processing Systems -Volume 2, NIPS'14, page 3320-3328, Cambridge, MA, USA, 2014. MIT Press.
  172. Eliezer Yudkowsky et al. Orthogonality thesis. https://www. lesswrong.com/w/orthogonality-thesis, 2025. Wiki page from LessWrong with multiple contributors. Accessed: 2025-03-18.
  173. Yichao Zhou and Jianyang Zeng. Massively parallel a* search on a gpu. Proceedings of the AAAI Conference on Artificial Intelligence, (1), 2015.
  174. J. Ziv and A. Lempel. A universal algorithm for sequential data compression. IEEE Transactions on Information Theory, 23(3):337-343, 1977. doi: 10.1109/TIT.1977.1055714. · DOI · Paper page

Cited by

Sorted by citations

Authors
Bennett, M. T.
Corresponding author
Bennett, Michael Timothy
Published
2025-05-21
OpenAlex
W7083678202
Cited by
15
References
0
Citations by year
2026: 12 · 2025: 3
Type
posted content
Language
en
Open access
Locations
  • ANU Open Research (Australian National University) (submittedVersion)
  • Thesis Commons (OSF Preprints) (submittedVersion)
  • The Australian National University
Topics
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Philosophy and Theoretical Science
  • Physical Sciences › Computer Science › Artificial Intelligence › Psychiatry, Mental Health, Neuroscience
  • Social Sciences › Arts and Humanities › History and Philosophy of Science › Cybernetics and Technology in Society
Keywords
artificial consciousness, qualia, abstraction layer, generalization, Bekenstein bound, adaptive systems, goal-directed behavior, natural selection, biological adaptation, valence

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review