The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Semantic information, autonomous agency and non-equilibrium statistical physics
Open accessAbstract
Shannon information theory provides various measures of so-called syntactic information, which reflect the amount of statistical correlation between systems. By contrast, the concept of ‘semantic information’ refers to those correlations which carry significance or ‘meaning’ for a given system. Semantic information plays an important role in many fields, including biology, cognitive science and philosophy, and there has been a long-standing interest in formulating a broadly applicable and formal theory of semantic information. In this paper, we introduce such a theory. We define semantic information as the syntactic information that a physical system has about its environment which is causally necessary for the system to maintain its own existence. ‘Causal necessity’ is defined in terms of counter-factual interventions which scramble correlations between the system and its environment, while ‘maintaining existence’ is defined in terms of the system's ability to keep itself in a low entropy state. We also use recent results in non-equilibrium statistical physics to analyse semantic information from a thermodynamic point of view. Our framework is grounded in the intrinsic dynamics of a system coupled to an environment, and is applicable to any physical system, living or otherwise. It leads to formal definitions of several concepts that have been intuitively understood to be related to semantic information, including ‘value of information’, ‘semantic content’ and ‘agency’.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Causality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653
Language, Thought, and Other Biological Categories: New Foundations for Realism
Millikan, R. G. (1984) · doi:10.7551/mitpress/4124.001.0001 · Cited by 4,758
Harnad, S. (1990) · Physica D: Nonlinear Phenomena · doi:10.1016/0167-2789(90)90087-6 · Cited by 4,235 · cited 1×
“It plays an important role in many fields, including biology [1–9], cognitive science [10–14], artificial intelligence [15–17], information theory [18–21] and philosophy [22–24].”
Stochastic thermodynamics, fluctuation theorems and molecular machines
Seifert, U. (2012) · Reports on Progress in Physics · doi:10.1088/0034-4885/75/12/126001 · Cited by 3,300
Mind in life: biology, phenomenology, and the sciences of mind
(2008) · Choice Reviews Online · doi:10.5860/choice.45-2543 · Cited by 2,696
The information bottleneck method
Tishby, N., Pereira, F. C., & Bialek, W. (2000) · arXiv · doi:10.48550/arxiv.physics/0004057 · Cited by 2,626 · cited 1×
“One kind of approach—common in economics, game theory and statistics—begins by assuming an idealized system that pursues some externallyassigned goal, usually formulated as the optimization of an objective function, such as utility [37–41], distortion [36] or prediction error [19,42–44].”
Friston, K. J., & Stephan, K. E. (2007) · Synthese · doi:10.1007/s11229-007-9237-y · Cited by 673
Making Sense of Sense-Making: Reflections on Enactive and Extended Mind Theories
Thompson, E., & Stapleton, M. (2009) · Topoi · doi:10.1007/s11245-008-9043-2 · Cited by 501
Defining Agency: Individuality, Normativity, Asymmetry, and Spatio-temporality in Action
Barandiaran, X. E., Di Paolo, E., & Rohde, M. (2009) · Adaptive Behavior · doi:10.1177/1059712309343819 · Cited by 497
Enactive artificial intelligence: Investigating the systemic organization of life and mind
Froese, T., & Ziemke, T. (2009) · Artificial Intelligence · doi:10.1016/j.artint.2008.12.001 · Cited by 317
Cited by
Zhang, P., Xu, W., Gao, H., Niu, K., Xu, X., Qin, X., Yuan, C., Qin, Z., Zhao, H., Wei, J., et al. (2022) · Engineering · doi:10.1016/j.eng.2021.11.003 · Cited by 311
Levin, M. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02688 · Cited by 297
Less Data, More Knowledge: Building Next-Generation Semantic Communication Networks
Chaccour, C., Saad, W., Debbah, M., Han, Z., & Vincent Poor, H. (2025) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3412852 · Cited by 259
Semantic Communication: A Survey on Research Landscape, Challenges, and Future Directions
Getu, T. M., Kaddoum, G., & Bennis, M. (2024) · Proceedings of the IEEE · doi:10.1109/jproc.2024.3520707 · Cited by 110
Fundamental constraints to the logic of living systems
Solé, R., Kempes, C. P., Corominas-Murtra, B., De Domenico, M., Kolchinsky, A., Lachmann, M., Libby, E., Saavedra, S., Smith, E., & Wolpert, D. (2024) · Interface Focus · doi:10.1098/rsfs.2024.0010 · Cited by 34
Self-citationThe Multiple Paths to Multiple Life
Kempes, C. P., & Krakauer, D. C. (2021) · Journal of Molecular Evolution · doi:10.1007/s00239-021-10016-2 · Cited by 33
Causal composition: Structural differences among dynamically equivalent systems
Albantakis, L., & Tononi, G. (2019) · Entropy · doi:10.3390/e21100989 · Cited by 30
Recurrent neural networks in synthetic cells: a route to autonomous molecular agents?
Braccini, M., Collinson, E., Roli, A., Fellermann, H., & Stano, P. (2023) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2023.1210334 · Cited by 18
Social scale and collective computation: does information processing limit rate of growth in scale?
Kohler, T. A., Bird, D., & Wolpert, D. H. (2022) · Journal of Social Computing · doi:10.23919/jsc.2021.0020 · Cited by 16
Self-citationScience-Driven Societal Transformation, Part I: Worldview
(2020) · doi:10.3390/su12176881 · Cited by 13
Thermodynamics of Duplication Thresholds in Synthetic Protocell Systems
Corominas-Murtra, B. (2019) · Life · doi:10.3390/life9010009 · Cited by 13
The Informational Substrate of Chemical Evolution: Implications for Abiogenesis
de la Escosura, A. (2019) · Life · doi:10.3390/life9030066 · Cited by 9
“Interestingly, using non-equilibrium statistical physics to analyze semantic information from a thermodynamic point of view, Kolchinsky and Wolper have developed a computational approach to evaluate the content of semantic information in different physical systems [67].”
MethodTowards a Possible Definition of Consciousness
Vitas, M. (2025) · BioSystems · doi:10.1016/j.biosystems.2025.105526 · Cited by 9
On the positive role of noise and error in complex systems
Roli, A., Braccini, M., & Stano, P. (2024) · Systems · doi:10.3390/systems12090338 · Cited by 5
Decomposing information into copying versus transformation
Kolchinsky, A., & Corominas-Murtra, B. (2020) · Journal of The Royal Society Interface · doi:10.1098/rsif.2019.0623 · Cited by 5
Self-citation
Metadata
- Authors
- Kolchinsky, A., & Wolpert, D. H.
- Venue
- Interface Focus
- Publisher
- The Royal Society
- Published
- 2018-10-19
- Volume
- 8
- Issue
- 6
- Pages
- 20180041
- ISSN
- 2042-8898 (ISSN-L)
- 2042-8901
- OpenAlex
- W2896421293
- Cited by
- 164
- References
- 13
- FWCI
- 7.38
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.