The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Thermodynamics of Prediction
Open accessAbstract
A system responding to a stochastic driving signal can be interpreted as computing, by means of its dynamics, an implicit model of the environmental variables. The system's state retains information about past environmental fluctuations, and a fraction of this information is predictive of future ones. The remaining nonpredictive information reflects model complexity that does not improve predictive power, and thus represents the ineffectiveness of the model. We expose the fundamental equivalence between this model inefficiency and thermodynamic inefficiency, measured by dissipation. Our results hold arbitrarily far from thermodynamic equilibrium and are applicable to a wide range of systems, including biomolecular machines. They highlight a profound connection between the effective use of information and efficient thermodynamic operation: any system constructed to keep memory about its environment and to operate with maximal energetic efficiency has to be predictive.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
On Information and Sufficiency
Kullback, S., & Leibler, R. A. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729694 · Cited by 20,193
Jeffreys, H., Moran, P. A. P., & Chatfield, C. (1922) · Nature · doi:10.1093/oso/9780198503682.001.0001 · Cited by 7,878
Lodish, H. F. (1986) · Cited by 5,650
Nonequilibrium Equality for Free Energy Differences
Jarzynski, C. (1997) · Physical Review Letters · doi:10.1103/physrevlett.78.2690 · Cited by 5,293
Irreversibility and heat generation in the computing process
Landauer, R. (1961) · IBM Journal of Research and Development · doi:10.1147/rd.53.0183 · Cited by 4,980
Crooks, G. E. (1999) · Physical Review E · doi:10.1103/physreve.60.2721 · Cited by 2,607
Self-citationProbability of second law violations in shearing steady states
Evans, D. J., Cohen, E. G. D., & Morriss, G. P. (1993) · Physical Review Letters · doi:10.1103/physrevlett.71.2401 · Cited by 1,686
Liphardt, J., Dumont, S., Smith, S. B., Tinoco, I., & Bustamante, C. (2002) · Science · doi:10.1126/science.1071152 · Cited by 1,243
Verification of the Crooks fluctuation theorem and recovery of RNA folding free energies
Collin, D., Ritort, F., Jarzynski, C., Smith, S. B., Tinoco, I., & Bustamante, C. (2005) · Nature · doi:10.1038/nature04061 · Cited by 1,049
Crooks, G. E. (1998) · Journal of Statistical Physics · doi:10.1023/a:1023208217925 · Cited by 1,026
Self-citationEqualities and Inequalities: Irreversibility and the Second Law of Thermodynamics at the Nanoscale
Jarzynski, C. (2011) · Annual Review of Condensed Matter Physics · doi:10.1146/annurev-conmatphys-062910-140506 · Cited by 1,012
Inferring statistical complexity
Crutchfield, J. P., & Young, K. (1989) · Physical Review Letters · doi:10.1103/physrevlett.63.105 · Cited by 1,002
Free energy reconstruction from nonequilibrium single-molecule pulling experiments
Hummer, G., & Szabo, A. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.071034098 · Cited by 983
(1987) · International Journal of Biochemistry · doi:10.1016/0020-711x(87)90149-2 · Cited by 598
Predictability, Complexity, and Learning
Bialek, W., Nemenman, I., & Tishby, N. (2001) · Neural Computation · doi:10.1162/089976601753195969 · Cited by 504
The dripping faucet as a model chaotic system
Shaw, R. (1984) · Medical Entomology and Zoology · Cited by 472
Biophysics searching for principles
Bialek, W. S. (2012) · Cited by 416
Regularities unseen, randomness observed: Levels of entropy convergence
Crutchfield, J. P., & Feldman, D. P. (2003) · Chaos: An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.1530990 · Cited by 368
A rotary molecular motor that can work at near 100% efficiency
Kinosita, K., Yasuda, R., Noji, H., & Adachi, K. (2000) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2000.0589 · Cited by 285
Staddon, J. E. R. (1982) · Medical Entomology and Zoology · Cited by 257
Metabolic cost as a unifying principle governing neuronal biophysics.
Hasenstaub, A., Otte, S., Callaway, E., & Sejnowski, T. J. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0914886107 · Cited by 246
An information-theoretic approach to curiosity-driven reinforcement learning
Still, S., & Precup, D. (2012) · Theory in Biosciences · doi:10.1007/s12064-011-0142-z · Cited by 165
Self-citationImparato, A., Peliti, L., Pesce, G., Rusciano, G., & Sasso, A. (2007) · Physical Review E · doi:10.1103/physreve.76.050101 · Cited by 140
Physics of bio-molecules and cells. Physique des biomolécules et des cellules
Flyvbjerg, H., David, F., Ormos, P., & David, F. (2002) · Springer eBooks · doi:10.1007/3-540-45701-1 · Cited by 107
Cappello, G., Pierobon, P., Symonds, C., Busoni, L., Christof, J., Gebhardt, J. C. M., Rief, M., & Prost, J. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0706653104 · Cited by 89
Information-theoretic approach to interactive learning
Still, S. (2009) · Europhysics Letters (EPL) · doi:10.1209/0295-5075/85/28005 · Cited by 72
Self-citationA general framework for non-equilibrium phenomena: the master equation and its formal consequences
Gaveau, B., & Schulman, L. S. (1997) · Physics Letters A · doi:10.1016/s0375-9601(97)00185-0 · Cited by 71
Beyond Boltzmann-Gibbs statistics: Maximum entropy hyperensembles out of equilibrium
Crooks, G. E. (2007) · Physical Review E · doi:10.1103/physreve.75.041119 · Cited by 66
Self-citation
Cited by
Parrondo, J. M. R., Horowitz, J. M., & Sagawa, T. (2015) · Nature Physics · doi:10.1038/nphys3230 · Cited by 1,258
Information processing and the second law of thermodynamics: an inclusive, Hamiltonian approach
Deffner, S., & Jarzynski, C. (2013) · Physical Review X · doi:10.1103/physrevx.3.041003 · Cited by 231
Information and efficiency in the nervous system-a synthesis.
Sengupta, B., Stemmler, M. B., & Friston, K. J. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003157 · Cited by 212
Am i self-conscious? (or does self-organization entail self-consciousness?)
Friston, K. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.00579 · Cited by 197
Sentience and the Origins of Consciousness: From Cartesian Duality to Markovian Monism
Friston, K. J., Wiese, W., & Hobson, J. A. (2020) · Entropy · doi:10.3390/e22050516 · Cited by 186
Metadata
- Authors
- Still, S., Sivak, D. A., Bell, A. J., & Crooks, G. E.
- Venue
- Physical Review Letters
- Publisher
- American Physical Society (APS)
- Published
- 2012-09-19
- Volume
- 109
- Issue
- 12
- Pages
- 120604-120604
- ISSN
- 0031-9007 (ISSN-L)
- 1079-7114
- OpenAlex
- W1776857128
- Cited by
- 252
- References
- 29
- FWCI
- 10.70
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.