The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Semantic information, autonomous agency and non-equilibrium statistical physics
Open accessAbstract
Shannon information theory provides various measures of so-called syntactic information, which reflect the amount of statistical correlation between systems. By contrast, the concept of ‘semantic information’ refers to those correlations which carry significance or ‘meaning’ for a given system. Semantic information plays an important role in many fields, including biology, cognitive science and philosophy, and there has been a long-standing interest in formulating a broadly applicable and formal theory of semantic information. In this paper, we introduce such a theory. We define semantic information as the syntactic information that a physical system has about its environment which is causally necessary for the system to maintain its own existence. ‘Causal necessity’ is defined in terms of counter-factual interventions which scramble correlations between the system and its environment, while ‘maintaining existence’ is defined in terms of the system's ability to keep itself in a low entropy state. We also use recent results in non-equilibrium statistical physics to analyse semantic information from a thermodynamic point of view. Our framework is grounded in the intrinsic dynamics of a system coupled to an environment, and is applicable to any physical system, living or otherwise. It leads to formal definitions of several concepts that have been intuitively understood to be related to semantic information, including ‘value of information’, ‘semantic content’ and ‘agency’.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Causality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653
Language, Thought, and Other Biological Categories: New Foundations for Realism
Millikan, R. G. (1984) · doi:10.7551/mitpress/4124.001.0001 · Cited by 4,758
Harnad, S. (1990) · Physica D: Nonlinear Phenomena · doi:10.1016/0167-2789(90)90087-6 · Cited by 4,235 · cited 1×
“It plays an important role in many fields, including biology [1–9], cognitive science [10–14], artificial intelligence [15–17], information theory [18–21] and philosophy [22–24].”
The information bottleneck method
Tishby, N., Pereira, F. C., & Bialek, W. (2000) · arXiv · doi:10.48550/arxiv.physics/0004057 · Cited by 2,626 · cited 1×
“One kind of approach—common in economics, game theory and statistics—begins by assuming an idealized system that pursues some externallyassigned goal, usually formulated as the optimization of an objective function, such as utility [37–41], distortion [36] or prediction error [19,42–44].”
Friston, K. J., & Stephan, K. E. (2007) · Synthese · doi:10.1007/s11229-007-9237-y · Cited by 673
Making Sense of Sense-Making: Reflections on Enactive and Extended Mind Theories
Thompson, E., & Stapleton, M. (2009) · Topoi · doi:10.1007/s11245-008-9043-2 · Cited by 501
Defining Agency: Individuality, Normativity, Asymmetry, and Spatio-temporality in Action
Barandiaran, X. E., Di Paolo, E., & Rohde, M. (2009) · Adaptive Behavior · doi:10.1177/1059712309343819 · Cited by 497
Enactive artificial intelligence: Investigating the systemic organization of life and mind
Froese, T., & Ziemke, T. (2009) · Artificial Intelligence · doi:10.1016/j.artint.2008.12.001 · Cited by 317
Information Flows in Causal Networks
AY, N., & POLANI, D. (2008) · Advances in Complex Systems · doi:10.1142/s0219525908001465 · Cited by 287 · cited 1×
“This approach is inspired by the framework of causal interventions [72,73], in which causal effects are measured by counter-factually intervening on one part of a system and then measuring the resulting changes in other parts of the system.”
Atlan, H. (1987) · Physica Scripta · doi:10.1088/0031-8949/36/3/032 · Cited by 100
The thermodynamic efficiency of computations made in cells across the range of life
Kempes, C. P., Wolpert, D., Cohen, Z., & Pérez-Mercader, J. (2017) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2016.0343 · Cited by 68
Self-citation
Cited by
Zhang, P., Xu, W., Gao, H., Niu, K., Xu, X., Qin, X., Yuan, C., Qin, Z., Zhao, H., Wei, J., et al. (2022) · Engineering · doi:10.1016/j.eng.2021.11.003 · Cited by 311
Levin, M. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02688 · Cited by 297
Less Data, More Knowledge: Building Next-Generation Semantic Communication Networks
Chaccour, C., Saad, W., Debbah, M., Han, Z., & Vincent Poor, H. (2025) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3412852 · Cited by 259
Semantic Communication: A Survey on Research Landscape, Challenges, and Future Directions
Getu, T. M., Kaddoum, G., & Bennis, M. (2024) · Proceedings of the IEEE · doi:10.1109/jproc.2024.3520707 · Cited by 110
Fundamental constraints to the logic of living systems
Solé, R., Kempes, C. P., Corominas-Murtra, B., De Domenico, M., Kolchinsky, A., Lachmann, M., Libby, E., Saavedra, S., Smith, E., & Wolpert, D. (2024) · Interface Focus · doi:10.1098/rsfs.2024.0010 · Cited by 34
Self-citation
Metadata
- Authors
- Kolchinsky, A., & Wolpert, D. H.
- Venue
- Interface Focus
- Publisher
- The Royal Society
- Published
- 2018-10-19
- Volume
- 8
- Issue
- 6
- Pages
- 20180041
- ISSN
- 2042-8898 (ISSN-L)
- 2042-8901
- OpenAlex
- W2896421293
- Cited by
- 164
- References
- 11
- FWCI
- 7.38
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.