CoChat

Measuring Integrated Information from the Decoding Perspective

Open access
Oizumi, Masafumi, Amari, Shun-ichi, Yanagawa, Toru, Fujii, Naotaka, Tsuchiya, Naotsugu · 2016 · PLOS Computational Biology

The DOI matches its Crossref record; 47 of the 48 references it cites were found in a registry or an index.

Abstract

Accumulating evidence indicates that the capacity to integrate information in the brain is a prerequisite for consciousness. Integrated Information Theory (IIT) of consciousness provides a mathematical approach to quantifying the information integrated in a system, called integrated information, Φ. Integrated information is defined theoretically as the amount of information a system generates as a whole, above and beyond the amount of information its parts independently generate. IIT predicts that the amount of integrated information in the brain should reflect levels of consciousness. Empirical evaluation of this theory requires computing integrated information from neural data acquired from experiments, although difficulties with using the original measure Φ precludes such computations. Although some practical measures have been previously proposed, we found that these measures fail to satisfy the theoretical requirements as a measure of integrated information. Measures of integrated information should satisfy the lower and upper bounds as follows: The lower bound of integrated information should be 0 and is equal to 0 when the system does not generate information (no information) or when the system comprises independent parts (no integration). The upper bound of integrated information is the amount of information generated by the whole system. Here we derive the novel practical measure Φ* by introducing a concept of mismatched decoding developed from information theory. We show that Φ* is properly bounded from below and above, as required, as a measure of integrated information. We derive the analytical expression of Φ* under the Gaussian assumption, which makes it readily applicable to experimental data. Our novel measure Φ* can generally be used as a measure of integrated information in research on consciousness, and also as a tool for network analysis on diverse areas of biology.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1371/journal.pcbi.1004654

Cites

47 of 47 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig 1 Integrated information based on the concept of mismatched decoding. The figure shows a system with five neurons in which the arrows represent directed connectivity and the colors represent the states of the neurons (black: silence, white: firing, gray: unknown). The past states X t−τ are decoded given the present states X t. The “true” conditional distribution p(X t|X t−τ) is used for matched decoding, while a “false” conditional distribution q(X t|X t−τ) is used for mismatched decoding where the parts of a system M 1 and M 2 are assumed independent. The amount of information about the past states that can be extracted from the present states using matched and mismatched decoding is quantified by the mutual information I(X t−τ;X t) and the “hypothetical” mutual information I*(X t−τ;X t) for mismatched decoding, respectively. In this framework, integrated information, Φ*(X t−τ;X t), is defined as the difference between I(X t−τ;X t) and I*(X t−τ;X t).
Fig 1 Integrated information based on the concept of mismatched decoding. The figure shows a system with five neurons in which the arrows represent directed connectivity and the colors represent the states of the neurons (black: silence, white: firing, gray: unknown). The past states X t−τ are decoded given the present states X t. The “true” conditional distribution p(X t|X t−τ) is used for matched decoding, while a “false” conditional distribution q(X t|X t−τ) is used for mismatched decoding where the parts of a system M 1 and M 2 are assumed independent. The amount of information about the past states that can be extracted from the present states using matched and mismatched decoding is quantified by the mutual information I(X t−τ;X t) and the “hypothetical” mutual information I*(X t−τ;X t) for mismatched decoding, respectively. In this framework, integrated information, Φ*(X t−τ;X t), is defined as the difference between I(X t−τ;X t) and I*(X t−τ;X t).CC BY · PubMed Central
Fig 2 Exemplar time series when there is no information between the past and present states. The connection strength a and the strength of noise correlation c are set to 0 and 0.9, respectively in the linear regression model (Eq 13). I 1 and I 2 represent the mutual information in units 1 and 2. Because there is no connection, there is no information between the past and present states of the system: I 1 and I 2 are both 0. In this case, Φ* and ΦI are 0 as they should be, yet ΦH is positive.
Fig 2 Exemplar time series when there is no information between the past and present states. The connection strength a and the strength of noise correlation c are set to 0 and 0.9, respectively in the linear regression model (Eq 13). I 1 and I 2 represent the mutual information in units 1 and 2. Because there is no connection, there is no information between the past and present states of the system: I 1 and I 2 are both 0. In this case, Φ* and ΦI are 0 as they should be, yet ΦH is positive.CC BY · PubMed Central
Fig 3 Violation of theoretical requirements as a measure of integrated information. The behaviors of Φ*, ΦI, and ΦH are shown in the left, middle, and right panels, respectively, when the strength of noise correlation c is varied in a linear regression model (Eq 13). Red lines indicate the regime where the theoretical requirements are violated, and the blue lines indicate that the theoretical requirements are satisfied. Dotted black lines are drawn at 0. (A) Violation of the upper bound. The strength of connections a is set to 0. In this case, there is no information between the past and present states of the system but ΦH is not 0, i.e., ΦH violates the upper bound. (B) Violation of the lower bound. The strength of connections a is set to 0.4. At the right ends of the figures where c is 1, the two units in the system are perfectly correlated. ΦI is negative, i.e., ΦI violates the lower bound when the degree of correlation is high.
Fig 3 Violation of theoretical requirements as a measure of integrated information. The behaviors of Φ*, ΦI, and ΦH are shown in the left, middle, and right panels, respectively, when the strength of noise correlation c is varied in a linear regression model (Eq 13). Red lines indicate the regime where the theoretical requirements are violated, and the blue lines indicate that the theoretical requirements are satisfied. Dotted black lines are drawn at 0. (A) Violation of the upper bound. The strength of connections a is set to 0. In this case, there is no information between the past and present states of the system but ΦH is not 0, i.e., ΦH violates the upper bound. (B) Violation of the lower bound. The strength of connections a is set to 0.4. At the right ends of the figures where c is 1, the two units in the system are perfectly correlated. ΦI is negative, i.e., ΦI violates the lower bound when the degree of correlation is high.CC BY · PubMed Central
Fig 4 Exemplar time series when correlation is high. The strength of noise correlation c and the connection strength a are set to both 0.4 in the linear regression model (Eq 13). I 1 and I 2 represent the mutual information in unit 1 and 2, and I represents the mutual information in the whole system. In this case, the sum of the mutual information in the parts exceeds the mutual information in the whole system and ΦI is negative.
Fig 4 Exemplar time series when correlation is high. The strength of noise correlation c and the connection strength a are set to both 0.4 in the linear regression model (Eq 13). I 1 and I 2 represent the mutual information in unit 1 and 2, and I represents the mutual information in the whole system. In this case, the sum of the mutual information in the parts exceeds the mutual information in the whole system and ΦI is negative.CC BY · PubMed Central
Fig 5 Measures of integrated information and mutual information computed in monkey ECoG data. Time lag τ is varied from 1 to 500 ms. The behaviors of Φ* (red line), ΦI (green line), ΦH (blue line), and mutual information I (black line) are shown. ΦI and ΦH violate the theoretical requirements.
Fig 5 Measures of integrated information and mutual information computed in monkey ECoG data. Time lag τ is varied from 1 to 500 ms. The behaviors of Φ* (red line), ΦI (green line), ΦH (blue line), and mutual information I (black line) are shown. ΦI and ΦH violate the theoretical requirements.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 1

  1. Ay N. Information geometry on complexity and stochastic interaction. 2001. MPI MIS Preprint 95. Available: http://www.mis.mpg.de/publications/preprints/2001/prepr2001-95.html.

Cited by

See all 184

Metadata

Authors
Oizumi, M., Amari, S.-I., Yanagawa, T., Fujii, N., & Tsuchiya, N.
Affiliations
  • RIKEN Center for Brain Science (JP)
  • Japan Science and Technology Agency (JP)
Corresponding author
  • Oizumi, Masafumi
  • Tsuchiya, Naotsugu
Venue
PLOS Computational Biology
Published
2016-01-21
Volume
12
Issue
1
Pages
e1004654
ISSN
  • 1553-734X (ISSN-L)
  • 1553-7358
OpenAlex
W2242515881
Cited by
184
References
48
Citations by year
2026: 4 · 2025: 8 · 2024: 11 · 2023: 15 · 2022: 22 · 2021: 18 · 2020: 27 · 2019: 29 · 2018: 21 · 2017: 12 · 2016: 15
FWCI
36.18
Type
journal article
Language
en
Open access
Locations
  • PLoS Computational Biology (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • Monash University Research Portal (Monash University) (submittedVersion, cc-by)
  • RePEc: Research Papers in Economics (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
  • Figshare (submittedVersion, cc-by)
  • Institutional Repositories DataBase (IRDB) (submittedVersion)
  • arXiv (Cornell University)
Funders
  • Australian Research Council (DP130100194)
  • Japan Society for the Promotion of Science (26870860)
  • Japan Science and Technology Agency
  • Precursory Research for Embryonic Science and Technology
Topics
  • Social Sciences › Arts and Humanities › Philosophy › Philosophy and Theoretical Science
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Functional Brain Connectivity Studies
Keywords
integrated information, integrated information theory, consciousness, information decoding, mismatched decoding, neural network analysis, information integration
MeSH terms
Electrocorticography, Animals, Cerebral Cortex, Consciousness, Information Theory, Macaca, Models, Neurological, Normal Distribution, Computational Biology

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.