Information integration in large brain networks
Open accessThe DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
An outstanding problem in neuroscience is to understand how information is integrated across the many modules of the brain. While classic information-theoretic measures have transformed our understanding of feedforward information processing in the brain's sensory periphery, comparable measures for information flow in the massively recurrent networks of the rest of the brain have been lacking. To address this, recent work in information theory has produced a sound measure of network-wide "integrated information", which can be estimated from time-series data. But, a computational hurdle has stymied attempts to measure large-scale information integration in real brains. Specifically, the measurement of integrated information involves a combinatorial search for the informational "weakest link" of a network, a process whose computation time explodes super-exponentially with network size. Here, we show that spectral clustering, applied on the correlation matrix of time-series data, provides an approximate but robust solution to the search for the informational weakest link of large networks. This reduces the computation time for integrated information in large systems from longer than the lifespan of the universe to just minutes. We evaluate this solution in brain-like systems of coupled oscillators as well as in high-density electrocortigraphy data from two macaque monkeys, and show that the informational "weakest link" of the monkey cortex splits posterior sensory areas from anterior association areas. Finally, we use our solution to provide evidence in support of the long-standing hypothesis that information integration is maximized by networks with a high global efficiency, and that modular network structures promote the segregation of information.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Efficient behavior of small-world networks
Latora, V., & Marchiori, M. (2001) · Physical Review Letters · doi:10.1103/physrevlett.87.198701 · Cited by 5,119
Sparse coding with an overcomplete basis set: A strategy employed by V1?
Olshausen, B. A., & Field, D. J. (1997) · Vision Research · doi:10.1016/s0042-6989(97)00169-7 · Cited by 3,642
Bassett, D. S., & Bullmore, E. (2006) · The Neuroscientist · doi:10.1177/1073858406293182 · Cited by 2,600
Efficiency and Cost of Economical Brain Functional Networks
Achard, S., & Bullmore, E. (2007) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0030017 · Cited by 2,553
A whole brain fMRI atlas generated via spatially constrained spectral clustering
Craddock, R. C., James, G. A., Holtzheimer, P. E., Hu, X. P., & Mayberg, H. S. (2012) · Human Brain Mapping · doi:10.1002/hbm.21333 · Cited by 1,636 · cited 2×
“This procedure partitions the brain into functionally distinct sub-networks (38).”
Consciousness as integrated information: a provisional manifesto
Tononi, G. (2008) · The Biological Bulletin · doi:10.2307/25470707 · Cited by 1,529
Sporns, O., & Betzel, R. F. (2016) · Annual Review of Psychology · doi:10.1146/annurev-psych-122414-033634 · Cited by 1,334
Information Geometry and Its Applications
Amari, S.-I. (2016) · Applied Mathematical Sciences · doi:10.1007/978-4-431-55978-8 · Cited by 1,138
From the phenomenology to the mechanisms of consciousness: integrated information theory 3.0
Oizumi, M., Albantakis, L., & Tononi, G. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003588 · Cited by 1,128
Communication dynamics in complex brain networks
Avena-Koenigsberger, A., Misic, B., & Sporns, O. (2018) · Nature Reviews Neuroscience · doi:10.1038/nrn.2017.149 · Cited by 856
Integrated information in discrete dynamical systems: motivation and theoretical framework
Balduzzi, D., & Tononi, G. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000091 · Cited by 419 · cited 1×
“Normalized integrated information is simply ΦG divided by the following normalization factor K (33):”
Measuring information integration
Tononi, G., & Sporns, O. (2003) · BMC Neuroscience · doi:10.1186/1471-2202-4-31 · Cited by 294
Practical Measures of Integrated Information for Time-Series Data
Barrett, A. B., & Seth, A. K. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1001052 · Cited by 225 · cited 1×
“ture [11, 14], there have been a number of proposed solutions for finding more balanced and functionally meaningful partitions. Here, we use the solution originally suggested in [19] and also used in [15, 16], which is to find the bipartition that minimizes integrated information, normalized by the factor K: K min k H…”
Measuring Integrated Information from the Decoding Perspective
Oizumi, M., Amari, S.-I., Yanagawa, T., Fujii, N., & Tsuchiya, N. (2016) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1004654 · Cited by 184
Can the macro beat the micro? Integrated information across spatiotemporal scales
Hoel, E. P., Albantakis, L., Marshall, W., & Tononi, G. (2016) · Neuroscience of Consciousness · doi:10.1093/nc/niw012 · Cited by 140
Microgenetic Approach to the Conscious Mind
Bachmann, T. (2000) · Advances in Consciousness Research · doi:10.1075/aicr.25 · Cited by 137
Improved measures of integrated information
Tegmark, M. (2016) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1005123 · Cited by 128 · cited 1×
“Though such measures have been around for about a decade, they have faced serious theoretical issues, such as exceeding the total information in a network or falling below 0 bits (18).”
Cited by
Consciousness and complexity: a consilience of evidence
Sarasso, S., Casali, A. G., Casarotto, S., Rosanova, M., Sinigaglia, C., & Massimini, M. (2021) · Neuroscience of Consciousness · doi:10.1093/nc/niab023 · Cited by 171
“In the following years, these measures were further refined based on both theoretical and practical considerations (Barrett and Seth 2011; Toker and Sommer 2019).”
The integrated information theory of consciousness: A case of mistaken identity
Merker, B., Williford, K., & Rudrauf, D. (2022) · Behavioral and Brain Sciences · doi:10.1017/s0140525x21000881 · Cited by 49
Leveraging Nonhuman Primate Multisensory Neurons and Circuits in Assessing Consciousness Theory
Noel, J.-P., Ishizawa, Y., Patel, S. R., Eskandar, E. N., & Wallace, M. T. (2019) · The Journal of Neuroscience · doi:10.1523/jneurosci.0934-19.2019 · Cited by 30
“Regretably, computing this measure in 134 complex biological systems is impossible from a practical standpoint due to its combinatorial search problem 135 (but see [22, 23] for interesting approaches circumventing current computing limitations).”
BackgroundA measure centrality index for systematic empirical comparison of consciousness theories
Chis-Ciure, R., Melloni, L., & Northoff, G. (2024) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2024.105670 · Cited by 22
“…procedures: approximate factorizations (Tegmark, 2016), Queraynne ’ s algorithm (Hidaka and Oizumi, 2018; Kitazono et al., 2018), graph clustering (Toker and Sommer, 2019), shared transitions in Process Algebras (Bolognesi, 2019), and self-organized criticality (Aguilera, 2019; Aguilera and A. di…”
MethodFirst-person experience cannot rescue causal structure theories from the unfolding argument
Herzog, M. H., Schurger, A., & Doerig, A. (2022) · Consciousness and Cognition · doi:10.1016/j.concog.2021.103261 · Cited by 14
“…is that these measures index something else, like representational capacity or processing efficiency (Mediano et al., 2021; Merker et al., 2021; Toker & Sommer, 2019), that happens to be tightly coupled with human consciousness and/or is a necessary condition for consciousness, but is not…”
Background
Metadata
- Authors
- Toker, D., & Sommer, F. T.
- Venue
- PLOS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2019-02-07
- Volume
- 15
- Issue
- 2
- Pages
- e1006807
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- OpenAlex
- W2787079105
- Cited by
- 67
- References
- 17
- FWCI
- 4.33
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.