The Intrinsic Cause-Effect Power of Discrete Dynamical Systems–From Elementary Cellular Automata to Adapting Animats
Open accessThe DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Abstract
Current approaches to characterize the complexity of dynamical systems usually rely on state-space trajectories. In this article instead we focus on causal structure, treating discrete dynamical systems as directed causal graphs—systems of elements implementing local update functions. This allows us to characterize the system’s intrinsic cause-effect structure by applying the mathematical and conceptual tools developed within the framework of integrated information theory (IIT). In particular, we assess the number of irreducible mechanisms (concepts) and the total amount of integrated conceptual information Φ specified by a system. We analyze: (i) elementary cellular automata (ECA); and (ii) small, adaptive logic-gate networks (“animats”), similar to ECA in structure but evolving by interacting with an environment. We show that, in general, an integrated cause-effect structure with many concepts and high Φ is likely to have high dynamical complexity. Importantly, while a dynamical analysis describes what is “happening” in a system from the extrinsic perspective of an observer, the analysis of its cause-effect structure reveals what a system “is” from its own intrinsic perspective, exposing its dynamical and evolutionary potential under many different scenarios.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures










Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Claim 4. Let S be a ring in state s.The cause-effect structure of s contains at most |S| distinctions, each of which is a first order distinction with φ d ≤ 1.”
From Dissociating Artificial Intelligence from Artificial Consciousness (2024) · cites this paper as [49]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“A system of n units has 2 n -1 possible distinctions with φ d = O(2 n ) ibits [49].”
From Dissociating Artificial Intelligence from Artificial Consciousness (2024) · cites this paper as [49]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In other words, the structure integrated information of a rich system can be as high as Φ = φ d + φ r = O(2 2 n ) ibits [49].”
From Dissociating Artificial Intelligence from Artificial Consciousness (2024) · cites this paper as [49]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“• Exactly one distinction, of 1 st order, with φ d ≤ 1 ibit.”
From Dissociating Artificial Intelligence from Artificial Consciousness (2024) · cites this paper as [49]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Said otherwise, consciousness is about being, not doing [1, 29, 55].”
From Integrated information theory (IIT) 4.0: Formulating the properties of phenomenal existence in physical terms (2023) · cites this paper as [55]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Theory of Self-Reproducing Automata
Schwartz, J. T., von Neumann, J., & Burks, A. W. (1967) · Mathematics of Computation · doi:10.2307/2005041 · Cited by 5,422
The Earth Mover's Distance as a Metric for Image Retrieval
Rubner, Y., Tomasi, C., & Guibas, L. J. (2000) · International Journal of Computer Vision · doi:10.1023/a:1026543900054 · Cited by 4,568 · cited 1×
“Distances in IIT are measured by the so-called earth mover’s distance (emd) [44,45].”
MethodDynamical Systems in Neuroscience: The Geometry of Excitability and Bursting
Izhikevich, E. M. (2006) · The MIT Press eBooks · doi:10.7551/mitpress/2526.001.0001 · Cited by 3,765
Modeling and Simulation of Genetic Regulatory Systems: A Literature Review
de Jong, H. (2002) · Journal of Computational Biology · doi:10.1089/10665270252833208 · Cited by 2,663
Evolutionary Dynamics: Exploring the Equations of Life
NOWAK, M. A. (2006) · doi:10.2307/j.ctvjghw98 · Cited by 2,438
Universality and complexity in cellular automata
Wolfram, S. (1984) · Physica D: Nonlinear Phenomena · doi:10.1016/0167-2789(84)90245-8 · Cited by 1,914 · cited 1×
“In this spirit, cellular automata have been classified according to whether their evolution for most initial states leads to fixed points, periodic cycles, or chaotic patterns associated with strange attractors [8,13] (Figure 1B).”
BackgroundGardner, M. (1970) · Scientific American · doi:10.1038/scientificamerican1070-120 · Cited by 1,663
Computation at the edge of chaos: Phase transitions and emergent computation
Langton, C. G. (1990) · Physica D: Nonlinear Phenomena · doi:10.1016/0167-2789(90)90064-v · Cited by 1,527 · cited 1×
“In Figure 5 we show the correlation between <ΦMax>, <#concepts>, and <ΣφMax> obtained from N = 5 ECA systems and three prominent measures [24], Langton’s λ parameter [25], the sensitivity measure μ [26], and the Z-parameter [27].”
MethodFrom the phenomenology to the mechanisms of consciousness: integrated information theory 3.0
Oizumi, M., Albantakis, L., & Tononi, G. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003588 · Cited by 1,128 · cited 9×
“The cause-effect structures of systems that implement these rules lack composition [17,18]: all sets of elements in these systems are reducible, meaning they do not have cause-effect power over and above the elementary mechanisms (φ = 0).”
BackgroundMethodInfluentialSelf-citationThe principles of collective animal behaviour
Sumpter, D. J. T. (2006) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2005.1733 · Cited by 1,020
Fast and robust Earth Mover's Distances
Pele, O., & Werman, M. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459199 · Cited by 805 · cited 2×
“EMD calculations within the IIT program were performed using the open source fast code of Pele and Werman [45].”
MethodCellular Automata Approaches to Biological Modeling
Ermentrout, G. B., & Edelstein-Keshet, L. (1993) · Journal of Theoretical Biology · doi:10.1006/jtbi.1993.1007 · Cited by 702
Measures of degeneracy and redundancy in biological networks
Tononi, G., Sporns, O., & Edelman, G. M. (1999) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.96.6.3257 · Cited by 632 · cited 1×
“Degeneracy here refers to different structures that perform the same function in a certain context [37,38].”
BackgroundSelf-citationTheory of cellular automata: A survey
Kari, J. (2005) · Theoretical Computer Science · doi:10.1016/j.tcs.2004.11.021 · Cited by 625 · cited 1×
“Among the oldest model systems for the study of natural computation are small discrete dynamical systems, cellular automata [10,42].”
BackgroundWhat is Life?: With Mind and Matter and Autobiographical Sketches
Schrödinger, E., & Penrose, R. (1992) · doi:10.1017/cbo9781139644129 · Cited by 568
The Dynamics of Active Categorical Perception in an Evolved Model Agent
Beer, R. D. (2003) · Adaptive Behavior · doi:10.1177/1059712303114001 · Cited by 508 · cited 1×
“(ACP) tasks, where moving blocks of different sizes have to be distinguished [19,32,33].”
BackgroundPredictability, Complexity, and Learning
Bialek, W., Nemenman, I., & Tishby, N. (2001) · Neural Computation · doi:10.1162/089976601753195969 · Cited by 504 · cited 1×
“In addition to the state entropy, in [19] we also assessed how the sensory-motor mutual information (ISMMI) [34] and predictive information (IPred) [35] of the animats as defined in [19,36] evolved during adaptation.”
BackgroundQuantifying causal emergence shows that macro can beat micro
Hoel, E. P., Albantakis, L., & Tononi, G. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1314922110 · Cited by 378 · cited 1×
“A mechanism is maximally selective if it is deterministic and non-degenerate, which means that its current state perfectly constrains the past and future state of the system [28].”
BackgroundSelf-citationStill, S., Sivak, D. A., Bell, A. J., & Crooks, G. E. (2012) · Physical Review Letters · doi:10.1103/physrevlett.109.120604 · Cited by 252 · cited 1×
“How living systems change their states in response to their environment can be seen as a form of natural computation [41].”
BackgroundUndecidability and intractability in theoretical physics
Wolfram, S. (1985) · Physical Review Letters · doi:10.1103/physrevlett.54.735 · Cited by 238 · cited 2×
“In many cases, the temporal evolution of CA is computationally irreducible [16], which makes it impossible to predict their dynamical behavior.”
BackgroundLife: An Introduction to Complex Systems Biology
Kaneko, K. (2006) · Understanding Complex Systems · doi:10.1007/978-3-540-32667-0 · Cited by 211
Tononi, G. (2015) · Scholarpedia · doi:10.4249/scholarpedia.4164 · Cited by 188 · cited 7×
“The cause-effect structures of systems that implement these rules lack composition [17,18]: all sets of elements in these systems are reducible, meaning they do not have cause-effect power over and above the elementary mechanisms (φ = 0).”
BackgroundMethodInfluentialSelf-citationThe Structure of the Elementary Cellular Automata Rule Space
Li, W., & Packard, N. H. (1990) · Cited by 166
Predictive information and explorative behavior of autonomous robots
Ay, N., Bertschinger, N., Der, R., Güttler, F., & Olbrich, E. (2008) · The European Physical Journal B · doi:10.1140/epjb/e2008-00175-0 · Cited by 165 · cited 5×
“In addition to the state entropy, in [19] we also assessed how the sensory-motor mutual information (ISMMI) [34] and predictive information (IPred) [35] of the animats as defined in [19,36] evolved during adaptation.”
BackgroundInfluentialUndecidability of CA Classification Schemes
Čulík, K., & Yü, S. (1988) · Complex Systems · Cited by 129
Integrated Information Increases with Fitness in the Evolution of Animats
Edlund, J. A., Chaumont, N., Hintze, A., Koch, C., Tononi, G., & Adami, C. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002236 · Cited by 124 · cited 1×
“In addition to the state entropy, in [19] we also assessed how the sensory-motor mutual information (ISMMI) [34] and predictive information (IPred) [35] of the animats as defined in [19,36] evolved during adaptation.”
BackgroundSelf-citationAlbantakis, L., Hintze, A., Koch, C., Adami, C., & Tononi, G. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003966 · Cited by 101 · cited 10×
“(ACP) tasks, where moving blocks of different sizes have to be distinguished [19,32,33].”
BackgroundMethodInfluentialSelf-citationA NONLINEAR DYNAMICS PERSPECTIVE OF WOLFRAM'S NEW KIND OF SCIENCE PART I: THRESHOLD OF COMPLEXITY
Chua, L. O., Yoon, S., & Dogaru, R. (2002) · International Journal of Bifurcation and Chaos · doi:10.1142/s0218127402006333 · Cited by 89 · cited 1×
“Nonlinearity is necessary, but not sufficient for class III and class IV behavior in ECA [21].”
BackgroundThe Evolution of Representation in Simple Cognitive Networks
Marstaller, L., Hintze, A., & Adami, C. (2013) · Neural Computation · doi:10.1162/neco_a_00475 · Cited by 70 · cited 2×
“The probability of an animat to be selected into the next generation was proportional to an exponential measure of the animat’s fitness (roulette wheel selection) [19,33].”
BackgroundOn the Computational Complexity of Finite Cellular Automata
Sutner, K. (1995) · Journal of Computer and System Sciences · doi:10.1006/jcss.1995.1009 · Cited by 69 · cited 1×
“Despite the simplicity of the rules, this classification is undecidable for many CA with infinite or very large numbers of cells [14,15].”
BackgroundASYMPTOTIC BEHAVIOR AND RATIOS OF COMPLEXITY IN CELLULAR AUTOMATA
Zenil, H., & VILLARREAL-ZAPATA, E. (2013) · International Journal of Bifurcation and Chaos · doi:10.1142/s0218127413501599 · Cited by 49
A full computation-relevant topological dynamics classification of elementary cellular automata
Schüle, M., & Stoop, R. (2012) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.4771662 · Cited by 38
A Phase Diagram for Elementary Cellular Automata
Binder, P. M. (1993) · Cited by 29
Guidelines for dynamics‐based parameterization of one‐dimensional cellular automata rule spaces
Oliveira, G. M. B., de Oliveira, P. P. B., & Omar, N. (2000) · Complexity · doi:10.1002/cplx.1021 · Cited by 20 · cited 1×
“In Figure 5 we show the correlation between <ΦMax>, <#concepts>, and <ΣφMax> obtained from N = 5 ECA systems and three prominent measures [24], Langton’s λ parameter [25], the sensitivity measure μ [26], and the Z-parameter [27].”
MethodOn generative morphological diversity of elementary cellular automata
Adamatzky, A., & Martínez, G. J. (2010) · Kybernetes · doi:10.1108/03684921011021282 · Cited by 19 · cited 1×
“Apart from rule-based measures and the classification of a rule’s long term behavior, a CA’s dynamical complexity can also be evaluated based on the morphological diversity [29] and Kolmogorov complexity [30] of its transient patterns.”
BackgroundA full computation-relevant topological dynamics classification of elementary cellular automata
Schüle, M., & Stoop, R. (2012) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-75357 · Cited by 17
Pavlic, T. P., Adams, A., Davies, P. C. W., & Walker, S. I. (2014) · Conference on Artificial Life (ALIFE) · doi:10.7551/978-0-262-32621-6-ch083 · Cited by 14 · cited 1×
“While the scientists studying cellular automata may observe intriguing patterns computed by the system, it has been pointed out that these patterns have no relevance for the CA itself in the absence of some kind of “global self-referential mechanism” [43].”
BackgroundNew aspects of symmetry of elementary cellular automata
Krawczyk, M. J. (2015) · Chaos Solitons & Fractals · doi:10.1016/j.chaos.2015.07.012 · Cited by 8 · cited 1×
“These additional symmetries between rules have recently been proposed in a numerical study by [23], which equates ECA rules if they show equivalent compressed state-to-state transition networks for finite ECA across different numbers of cells N.”
BackgroundLeveraging Evolutionary Search to Discover Self-Adaptive and Self-Organizing Cellular AutomataPreprint
Knoester, D. B., Goldsby, H. J., & Adami, C. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1405.4322 · Cited by 3
Arithmetic, A. (2010) · Alphascript Publishing eBooks · Cited by 1
Research works printed but not linked: 2
- Von Neumann, J. (1966). Essays on Cellular Automata, University of Illinois Press.
- Wuensche, A., and Lesser, M. (1992). The Global Dynamics of Cellular Automata: An Atlas of Basin of Attraction Fields of One-dimensional Cellular Automata, Addison-Wesley. Santa Fe Institute Studies in the Sciences of Complexity: Reference Volume I.
Cited by
Albantakis, L., Barbosa, L., Findlay, G., Grasso, M., Haun, A. M., Marshall, W., Mayner, W. G. P., Zaeemzadeh, A., Boly, M., Juel, B. E., et al. (2023) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1011465 · Cited by 292
“Said otherwise, consciousness is about being, not doing [1, 4, 36,66].”
Self-citationIs Target-Based Drug Discovery Efficient? Discovery and “Off-Target” Mechanisms of All Drugs
Sadri, A. (2023) · Journal of Medicinal Chemistry · doi:10.1021/acs.jmedchem.2c01737 · Cited by 162
Can the macro beat the micro? Integrated information across spatiotemporal scales
Hoel, E. P., Albantakis, L., Marshall, W., & Tononi, G. (2016) · Neuroscience of Consciousness · doi:10.1093/nc/niw012 · Cited by 140
“…these aspects are also essential for understanding how the causal structures of simulated organisms evolve in a simulated environment (Albantakis et al., 2014) and for the causal analysis and classification of discrete dynamical systems, such as cellular automata (Albantakis and Tononi, 2015).”
BackgroundInfluentialSelf-citationPyPhi: A toolbox for integrated information theory
Mayner, W. G. P., Marshall, W., Albantakis, L., Findlay, G., Marchman, R., & Tononi, G. (2018) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1006343 · Cited by 118
“Φ also serves as a general measure of complexity that captures to what extent a system is both integrated [6] and differentiated (informative) [14].”
Self-citationBlack-boxing and cause-effect power
Marshall, W., Albantakis, L., & Tononi, G. (2018) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1006114 · Cited by 73
“articular micro time-step and coarse grains with an output for each micro element are the extremes. 8 Theory Integrated information (Φ) measures the intrinsic cause-effect power of a physical system (Albantakis and Tononi, 2015; Oizumi et al., 2014) by evaluating five requirements: the system’s capacity to make a diff…”
BackgroundInfluentialSelf-citation
Metadata
- Authors
- Albantakis, L., & Tononi, G.
- Affiliations
- University of Wisconsin–Madison (US)
- Corresponding author
- Albantakis, Larissa
- Tononi, Giulio
- Venue
- Entropy
- Publisher
- MDPI AG
- Published
- 2015-07-31
- Volume
- 17
- Issue
- 8
- Pages
- 5472-5502
- ISSN
- 1099-4300 (ISSN-L)
- OpenAlex
- W1554794238
- Cited by
- 58
- References
- 40
- Citations by year
- 2025: 4 · 2024: 7 · 2023: 7 · 2022: 7 · 2021: 8 · 2020: 6 · 2019: 7 · 2018: 5 · 2017: 4 · 2016: 3
- FWCI
- 4.12
- Type
- journal article
- Language
- en
- Open access
- gold
- dx.doi.org
- Licence
- Locations
- Entropy (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Templeton World Charities Foundation (#TWCF 0067/AB41)
- Topics
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Cellular Automata and Applications
- Physical Sciences › Physics and Astronomy › Statistical and Nonlinear Physics › Complex Systems and Dynamics
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Philosophy of Biology and Scientific Explanation
- Keywords
- integrated information theory, causal structure, elementary cellular automata, animats, dynamical complexity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.