Integrated Information Increases with Fitness in the Evolution of Animats
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
One of the hallmarks of biological organisms is their ability to integrate disparate information sources to optimize their behavior in complex environments. How this capability can be quantified and related to the functional complexity of an organism remains a challenging problem, in particular since organismal functional complexity is not well-defined. We present here several candidate measures that quantify information and integration, and study their dependence on fitness as an artificial agent ("animat") evolves over thousands of generations to solve a navigation task in a simple, simulated environment. We compare the ability of these measures to predict high fitness with more conventional information-theoretic processing measures. As the animat adapts by increasing its "fit" to the world, information integration and processing increase commensurately along the evolutionary line of descent. We suggest that the correlation of fitness with information integration and with processing measures implies that high fitness requires both information processing as well as integration, but that information integration may be a better measure when the task requires memory. A correlation of measures of information integration (but also information processing) and fitness strongly suggests that these measures reflect the functional complexity of the animat, and that such measures can be used to quantify functional complexity even in the absence of fitness data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Intelligence without representation
Brooks, R. A. (1991) · Artificial Intelligence · doi:10.1016/0004-3702(91)90053-m · Cited by 4,853
Mapping the structural core of human cerebral cortex
Hagmann, P., Cammoun, L., Gigandet, X., Meuli, R., Honey, C. J., Wedeen, V. J., & Sporns, O. (2008) · PLoS Biology · doi:10.1371/journal.pbio.0060159 · Cited by 4,173
Hierarchical models of object recognition in cortex
Riesenhuber, M., & Poggio, T. (1999) · Nature Neuroscience · doi:10.1038/14819 · Cited by 3,309 · cited 1×
“Fundamentally, our Markov networks are related to the hierarchical temporal memory (HTM) model of neocortical function [59–61] and the HMAX algorithm [62], except that the organization of our stochastic Markov networks need not be strictly hierarchical because it is determined via genetic evolution rather than top-dow…”
BackgroundTononi, G., Sporns, O., & Edelman, G. M. (1994) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.91.11.5033 · Cited by 1,626 · cited 1×
“In this respect, measures of integrated information are a good candidate for a quantitative measure of consciousness, as advocated earlier [39,40,44,50].”
MethodSelf-citationConsciousness as integrated information: a provisional manifesto
Tononi, G. (2008) · The Biological Bulletin · doi:10.2307/25470707 · Cited by 1,529
Self-citationIntegrated information in discrete dynamical systems: motivation and theoretical framework
Balduzzi, D., & Tononi, G. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000091 · Cited by 419 · cited 10×
“In this respect, measures of integrated information are a good candidate for a quantitative measure of consciousness, as advocated earlier [39,40,44,50].”
BackgroundMethodInfluentialSelf-citationTowards a mathematical theory of cortical micro-circuits
George, D., & Hawkins, J. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000532 · Cited by 404
Practical Measures of Integrated Information for Time-Series Data
Barrett, A. B., & Seth, A. K. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1001052 · Cited by 225
A complexity measure for selective matching of signals by the brain.
Tononi, G., Sporns, O., & Edelman, G. M. (1996) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.93.8.3422 · Cited by 191 · cited 1×
“Furthermore, we plan to test whether animats evolve information matching [65], that is, whether the integrated informational structure generated by an adapted complex fits, or matches, the informational structure of its environment.”
BackgroundSelf-citation
Research works printed but not linked: 45
- R Badii, 1997, Complexity: Hierarchical structures and scaling in physics, volume 6 of Cambridge Nonlinear Science Series, 10.1017/CBO9780511524691 · DOI · Paper page
- C Adami, 2002, What is complexity?, Bioessays, 24, 1085, 10.1002/bies.10192 · DOI · Paper page
- C Adami, 2004, Information theory in molecular biology., Phys Life Rev, 1, 3, 10.1016/j.plrev.2004.01.002 · DOI · Paper page
- L Löfgren, 1977, Complexity of description of systems: A foundational study., Int J Gen Sys, 3, 197, 10.1080/03081077708934766 · doi:10.1080/03081077708934766
- F Papentin, 1980, On order and complexity i: General considerations., J theor Biol, 87, 421, 10.1016/0022-5193(80)90230-1 · DOI
- F Papentin, 1982, On order and complexity ii: Application to chemical and biochemical structures., J theor Biol, 95, 225, 10.1016/0022-5193(82)90241-7 · DOI
- RDK Thomas, 1993, The skeleton space: A finite set of organic designs., Evolution, 47, 341, 10.2307/2410056 · doi:10.2307/2410056
- RD Thomas, 2000, Evolutionary exploitation of design options by the first animals with hard skeletons., Science, 288, 1239, 10.1126/science.288.5469.1239 · DOI · Paper page
- D Soloveichik, 2006, Complexity of self-assembled shapes., SIAM J Comput, 36, 1544, 10.1137/S0097539704446712 · DOI · Paper page
- SE Ahnert, 2010, Self-assembly, modularity, and physical complexity., Phys Rev E, 82, 026117, 10.1103/PhysRevE.82.026117 · DOI · Paper page
- A Kolmogorov, 1965, Three approaches to the quantitative definition of information., Probl Inf Trans, 1, 4
- A Lempel, 1976, On the complexity of finite sequences., IEEE Trans Inform Theory, 22, 75, 10.1109/TIT.1976.1055501 · DOI · Paper page
- W Ebeling, 1980, On grammars, complexity, and information measures of biological macromolecules., Math Biosci, 52, 53, 10.1016/0025-5564(80)90004-8 · DOI
- M Gell-Mann, 1996, Information measures, effective complexity, and total information., Complexity, 2, 44, 10.1002/(SICI)1099-0526(199609/10)2:1<44::AID-CPLX10>3.0.CO;2-X · DOI · Paper page
- C Adami, 2000, Physical complexity of symbolic sequences., Physica D, 137, 62, 10.1016/S0167-2789(99)00179-7 · DOI
- DW McShea, 2000, Functional complexity in organisms: Parts as proxies., Biol Philos, 15, 641, 10.1023/A:1006695908715 · DOI
- JW Szostak, 2003, Functional information: Molecular messages., Nature, 423, 689, 10.1038/423689a · DOI
- RM Hazen, 2007, Functional information and the emergence of biocomplexity., Proc Natl Acad Sci U S A, 104, 8574, 10.1073/pnas.0701744104 · DOI · Paper page
- C Bennett, 1995, Universal computation and physical dynamics., Physica D, 86, 268, 10.1016/0167-2789(95)00107-F · DOI
- S Lloyd, 2001, Measures of complexity: A nonexhaustive list., IEEE Control Syst Mag N Y, 21, 7, 10.1109/MCS.2001.939938 · DOI · Paper page
- D Polani, 2009, Information: currency of life?, HFSP J, 3, 307, 10.2976/1.3171566 · DOI · Paper page
- O Rivoire, 2011, The value of information for populations in varying environments., J Stat Phys, 142, 1124, 10.1007/s10955-011-0166-2 · DOI · Paper page
- M Dehmer, 2011, A history of graph entropy measures., Inf Sci, 181, 57, 10.1016/j.ins.2010.08.041 · DOI · Paper page
- C Koch, 1999, Complexity and the nervous system., Science, 284, 96, 10.1126/science.284.5411.96 · DOI · Paper page
- R Lenski, 1991, Long-term experimental evolution in Escherichia coli. I. Adaptation and divergence during 2,000 generations., Am Nat, 138, 1315, 10.1086/285289 · DOI · Paper page
- MC Donaldson-Matasci, 2010, The fitness value of information., Oikos, 119, 219, 10.1111/j.1600-0706.2009.17781.x · DOI · Paper page
- W Bialek, 2001, Predictability, complexity, and learning., Neural Comput, 13, 2409, 10.1162/089976601753195969 · DOI · Paper page
- N Ay, 2008, Predictive information and explorative behavior of autonomous robots., Eur Phys J B, 63, 329, 10.1140/epjb/e2008-00175-0 · DOI · Paper page
- DJ Felleman, 1991, Distributed hierarchical processing in the primate cerebral cortex., Cereb Cortex, 1, 1, 10.1093/cercor/1.1.1 · DOI · Paper page
- D Slepian, 1973, Noiseless coding of correlated information sources., IEEE Trans Inform Theory, 19, 471, 10.1109/TIT.1973.1055037 · DOI · Paper page
- GC Rota, 1964, The number of partitions of a set., Am Math Mon, 7, 498, 10.2307/2312585 · doi:10.2307/2312585
- G Tononi, 2010, Information integration: its relevance to brain function and consciousness., Arch Ital Biol, 148, 299
- JJ Atick, 1992, Could information theory provide an ecological theory of sensory processing., Network, 3, 213, 10.1088/0954-898X_3_2_009 · DOI · Paper page
- JP Nadal, 1994, Nonlinear neurons in the low noise limit: A factorial code maximizes information transfer., Network, 5, 565, 10.1088/0954-898X_5_4_008 · doi:10.1088/0954-898x_5_4_008 · Paper page
- E Schneidman, 2003, Network information and connected correlations., Phys Rev Lett, 91, 238701, 10.1103/PhysRevLett.91.238701 · DOI · Paper page
- WJ McGill, 1954, Multivariate information transmission., Psychometrika, 19, 97, 10.1007/BF02289159 · DOI · Paper page
- M Lungarella, 2005, Methods for quantifying the informational structure of sensory and motor data., Neuroinformatics, 3, 243, 10.1385/NI:3:3:243 · DOI
- M Lungarella, 2006, Mapping information ow in sensorimotor networks., PLoS Comput Biol, 2, 1301, 10.1371/journal.pcbi.0020144 · DOI · Paper page
- N Ay, 2003, Temporal infomax leads to almost deterministic dynamical systems., Neurocomputing, 52-4, 461, 10.1016/S0925-2312(02)00732-4 · DOI
- N Ay, 2003, Dynamical properties of strongly interacting markov chains., Neural Netw, 16, 1483, 10.1016/S0893-6080(03)00190-4 · DOI
- AS Klyubin, 2007, Representations of space and time in the maximization of information ow in the perception-action loop., Neural Comput, 19, 2387, 10.1162/neco.2007.19.9.2387 · DOI
- A Hintze, 2008, Evolution of complex modular biological networks., PLoS Comput Biol, 4, e23, 10.1371/journal.pcbi.0040023 · DOI · Paper page
- C Adami, 2006, What do robots dream of?, Science, 314, 1093, 10.1126/science.1135929 · DOI
- RE Lenski, 2003, The evolutionary origin of complex features., Nature, 423, 139, 10.1038/nature01568 · DOI · Paper page
- G Hardin, 1960, The competitive exclusion principle., Science, 131, 1292, 10.1126/science.131.3409.1292 · DOI · Paper page
Cited by
Integrated information theory: from consciousness to its physical substrate
Tononi, G., Boly, M., Massimini, M., & Koch, C. (2016) · Nature Reviews Neuroscience · doi:10.1038/nrn.2016.44 · Cited by 1,727
Self-citationFrom the phenomenology to the mechanisms of consciousness: integrated information theory 3.0
Oizumi, M., Albantakis, L., & Tononi, G. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003588 · Cited by 1,128
Self-citationConsciousness: here, there and everywhere?
Tononi, G., & Koch, C. (2015) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2014.0167 · Cited by 811
Self-citationAnterior insular cortex and emotional awareness
Gu, X., Hof, P. R., Friston, K. J., & Fan, J. (2013) · Journal of Comparative Neurology · doi:10.1002/cne.23368 · Cited by 712
“This implies that emotion can be viewed as a form of interoceptive inference; that is, subjective feelings are based on the active interpretation of changes in the physiological conditions of the body (Seth et al., 2011).”
Schartner, M., Seth, A., Noirhomme, Q., Boly, M., Bruno, M.-A., Laureys, S., & Barrett, A. (2015) · PLOS ONE · doi:10.1371/journal.pone.0133532 · Cited by 287
“Properties of these measures have been explored on simple models, for instance neural network activity of artificial agents [9, 15].”
Background
Metadata
- Authors
- Edlund, J. A., Chaumont, N., Hintze, A., Koch, C., Tononi, G., & Adami, C.
- Venue
- PLoS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2011-10-20
- Volume
- 7
- Issue
- 10
- Pages
- e1002236
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- OpenAlex
- W1998567810
- Cited by
- 124
- References
- 9
- FWCI
- 4.73
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.