When the Map Is Better Than the Territory
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
The causal structure of any system can be analyzed at a multitude of spatial and temporal scales. It has long been thought that while higher scale (macro) descriptions may be useful to observers, they are at best a compressed description and at worse leave out critical information and causal relationships. However, recent research applying information theory to causal analysis has shown that the causal structure of some systems can actually come into focus and be more informative at a macroscale. That is, a macroscale description of a system (a map) can be more informative than a fully detailed microscale description of the system (the territory). This has been called “causal emergence.” While causal emergence may at first seem counterintuitive, this paper grounds the phenomenon in a classic concept from information theory: Shannon’s discovery of the channel capacity. I argue that systems have a particular causal capacity, and that different descriptions of those systems take advantage of that capacity to various degrees. For some systems, only macroscale descriptions use the full causal capacity. These macroscales can either be coarse-grains, or may leave variables and states out of the model (exogenous, or “black boxed”) in various ways, which can improve the efficacy and informativeness via the same mathematical principles of how error-correcting codes take advantage of an information channel’s capacity. The causal capacity of a system can approach the channel capacity as more and different kinds of macroscales are considered. Ultimately, this provides a general framework for understanding how the causal structure of some systems cannot be fully captured by even the most detailed microscale description.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An introduction to cybernetics
Ashby, W. R. (1956) · doi:10.5962/bhl.title.5851 · Cited by 7,578
Special sciences (or: The disunity of science as a working hypothesis)
Fodor, J. A. (1974) · Synthese · doi:10.1007/bf00485230 · Cited by 1,815
Consciousness as integrated information: a provisional manifesto
Tononi, G. (2008) · The Biological Bulletin · doi:10.2307/25470707 · Cited by 1,529
Quantifying causal emergence shows that macro can beat micro
Hoel, E. P., Albantakis, L., & Tononi, G. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1314922110 · Cited by 378
Self-citationMeasuring information integration
Tononi, G., & Sporns, O. (2003) · BMC Neuroscience · doi:10.1186/1471-2202-4-31 · Cited by 294
Information Flows in Causal Networks
AY, N., & POLANI, D. (2008) · Advances in Complex Systems · doi:10.1142/s0219525908001465 · Cited by 287 · cited 2×
“Others have outlined similar metrics, such as the information-theoretic causal power in 2005 [11] and the information flow in 2008 [12], which was renamed “causal specificity” in 2015 [13].”
BackgroundCan the macro beat the micro? Integrated information across spatiotemporal scales
Hoel, E. P., Albantakis, L., Marshall, W., & Tononi, G. (2016) · Neuroscience of Consciousness · doi:10.1093/nc/niw012 · Cited by 140
Self-citationBlack-boxing and cause-effect power
Marshall, W., Albantakis, L., & Tononi, G. (2018) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1006114 · Cited by 73
Cited by
The global workspace needs metacognition
Shea, N., & Frith, C. D. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2019.04.007 · Cited by 130
“Confidence-involving computations have recently begun to gain prominence in artificial intelligence research [112]; (iv) coarse-graining and other kinds of simplification of the right kind enable better communication of the causal structure of systems than at the microscale [87].”
Collective intelligence: a unifying concept for integrating biology across scales and substrates
McMillen, P., & Levin, M. (2024) · Communications Biology · doi:10.1038/s42003-024-06037-4 · Cited by 122
Causal emergence from effective information: Neither causal nor emergent?
Dewhurst, J., & Philosophy Documentation Center (2021) · Thought: A Journal of Philosophy · doi:10.1002/tht3.489 · Cited by 12
Formalizing falsification for theories of consciousness across computational hierarchies
Hanson, J. R., & Walker, S. I. (2021) · Neuroscience of Consciousness · doi:10.1093/nc/niab014 · Cited by 16
Metadata
- Authors
- Hoel, E.
- Venue
- Entropy
- Publisher
- MDPI AG
- Published
- 2017-04-26
- Volume
- 19
- Issue
- 5
- Pages
- 188
- ISSN
- 1099-4300 (ISSN-L)
- OpenAlex
- W2570466542
- Cited by
- 97
- References
- 8
- FWCI
- 3.91
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.