Exploration of synergistic and redundant information sharing in static and dynamical Gaussian systems
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
To fully characterize the information that two source variables carry about a third target variable, one must decompose the total information into redundant, unique, and synergistic components, i.e., obtain a partial information decomposition (PID). However, Shannon's theory of information does not provide formulas to fully determine these quantities. Several recent studies have begun addressing this. Some possible definitions for PID quantities have been proposed and some analyses have been carried out on systems composed of discrete variables. Here we present an in-depth analysis of PIDs on Gaussian systems, both static and dynamical. We show that, for a broad class of Gaussian systems, previously proposed PID formulas imply that (i) redundancy reduces to the minimum information provided by either source variable and hence is independent of correlation between sources, and (ii) synergy is the extra information contributed by the weaker source when the stronger source is known and can either increase or decrease with correlation between sources. We find that Gaussian systems frequently exhibit net synergy, i.e., the information carried jointly by both sources is greater than the sum of information carried by each source individually. Drawing from several explicit examples, we discuss the implications of these findings for measures of information transfer and information-based measures of complexity, both generally and within a neuroscience setting. Importantly, by providing independent formulas for synergy and redundancy applicable to continuous time-series data, we provide an approach to characterizing and quantifying information sharing amongst complex system variables.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Investigating causal relations by econometric models and cross-spectral methods
Granger, C. W. J. (1969) · Econometrica · doi:10.2307/1912791 · Cited by 22,989
Elements of Information Theory
Cover, T. M., & Thomas, J. A. (2005) · doi:10.1002/047174882x · Cited by 13,791
Investigating Causal Relations by Econometric Models and Cross-Spectral Methods
Granger, C. W. J. (2010) · Essays in Econometrics · doi:10.1017/cbo9780511753978.002 · Cited by 4,762
Integrated information in discrete dynamical systems: motivation and theoretical framework
Balduzzi, D., & Tononi, G. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000091 · Cited by 419 · cited 1×
“This is in the spirit of what the ‘Φ’ measures of integrated information [22, 23, 18] are supposed to capture (in some cases of high synergy ‘Φ’ measures are unsuccessful at doing this [24]).”
BackgroundAn information-theoretic primer on complexity, self-organization, and emergence
Prokopenko, M., Boschetti, F., & Ryan, A. J. (2009) · Complexity · doi:10.1002/cplx.20249 · Cited by 251
Practical Measures of Integrated Information for Time-Series Data
Barrett, A. B., & Seth, A. K. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1001052 · Cited by 225
Self-citation
Cited by
A Synergistic Core for Human Brain Evolution and Cognition
Luppi, A. I., Mediano, P. A. M., Rosas, F. E., Holland, N., Fryer, T. D., O’Brien, J. T., Rowe, J. B., Menon, D. K., Bor, D., & Stamatakis, E. A. (2022) · Nature Neuroscience · doi:10.1038/s41593-022-01070-0 · Cited by 314
Measuring integrated information: comparison of candidate measures in theory and simulation
Mediano, P., Seth, A., & Barrett, A. (2018) · Entropy · doi:10.3390/e21010017 · Cited by 145
“4, we use the minimum mutual information PID presented in [9]6.”
BackgroundMethodInfluentialSelf-citationMultivariate information theory uncovers synergistic subsystems of the human cerebral cortex
Varley, T. F., Pope, M., Faskowitz, J., & Sporns, O. (2023) · Communications Biology · doi:10.1038/s42003-023-04843-w · Cited by 101
Synergistic information transfer in the global system of financial markets
Scagliarini, T., Faes, L., Marinazzo, D., Stramaglia, S., & Mantegna, R. N. (2020) · Entropy · doi:10.3390/e22091000 · Cited by 16
Sampling bias corrections for discrete and Gaussian partial information decompositions
Lorenz, G. M., Engel, N. M., Koçillari, L., Celotto, M., Orsenigo, D., Curreli, S., Malerba, S. B., Engel, A. K., Kayser, C., Fellin, T., et al. (2026) · Patterns · doi:10.1016/j.patter.2026.101619 · Cited by 9
Continuity and additivity properties of information decompositions
Rauh, J., Banerjee, P. K., Olbrich, E., Montúfar, G., & Jost, J. (2023) · International Journal of Approximate Reasoning · doi:10.1016/j.ijar.2023.108979 · Cited by 7
Partial information decomposition for discrete target and continuous source random variables
Barà, C., Antonacci, Y., Iovino, M., Lazic, I., & Faes, L. (2025) · Physical Review E · doi:10.1103/58bg-5n9s · Cited by 6
Metadata
- Authors
- Barrett, A. B.
- Venue
- Physical Review E
- Publisher
- American Physical Society (APS)
- Published
- 2015-05-08
- Volume
- 91
- Issue
- 5
- Pages
- 052802-052802
- ISSN
- 1539-3755 (ISSN-L)
- 1550-2376
- OpenAlex
- W1899852503
- Cited by
- 227
- References
- 6
- FWCI
- 10.69
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.