Statistical Thermodynamics of Natural Images
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
The scale invariance of natural images suggests an analogy to the statistical mechanics of physical systems at a critical point. Here we examine the distribution of pixels in small image patches and show how to construct the corresponding thermodynamics. We find evidence for criticality in a diverging specific heat, which corresponds to large fluctuations in how "surprising" we find individual images, and in the quantitative form of the entropy vs energy. We identify special image configurations as local energy minima and show that average patches within each basin are interpretable as lines and edges in all orientations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Neural networks and physical systems with emergent collective computational abilities.
Hopfield, J. J. (1982) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.79.8.2554 · Cited by 19,270 · cited 1×
“One consequence is that the approach toward typicality in the sense of information theory [15] will be much slower than one would find away from the critical point, which may be related to difficulties in compressing large natural images, or even in estimating their entropy (see, for example, Ref…”
BackgroundNewman (2005) · doi:10.1080/00107510500052444 · Cited by 5,749
The Evolutionary Fate and Consequences of Duplicate Genes
Lynch, M., & Conery, J. S. (2000) · Science · doi:10.1126/science.290.5494.1151 · Cited by 4,988
Spin Glass Theory and Beyond: An Introduction to the Replica Method and Its Applications
Mezard, M., Parisi, G., & Virasoro, M. (1986) · World Scientific Lecture Notes in Physics · doi:10.1142/0271 · Cited by 3,653
Natural Image Statistics and Neural Representation
Simoncelli, E. P., & Olshausen, B. A. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.1193 · Cited by 2,460 · cited 1×
“I. INTRODUCTION From the familiar faces of our friends and family to objects of almost every size in environments of every type, the world that we see is full of structure.”
BackgroundThe effect of linkage on limits to artificial selection
Hill, W. G., & Robertson, A. (1966) · Genetical Research · doi:10.1017/s0016672300010156 · Cited by 1,823
Are Biological Systems Poised at Criticality?
Mora, T., & Bialek, W. (2011) · Journal of Statistical Physics · doi:10.1007/s10955-011-0229-4 · Cited by 734
Self-citationIntraspecific variation in symbiont genomes: bottlenecks and the aphid-buchnera association
Funk, D. J., Wernegreen, J. J., & Moran, N. A. (2001) · Genetics · doi:10.1093/genetics/157.2.477 · Cited by 131
Barton, N. H. (2009) · Cold Spring Harbor Symposia on Quantitative Biology · doi:10.1101/sqb.2009.74.030 · Cited by 68
Bialek, W. (2007) · Les Houches - Ecole d’Ete de Physique Theorique · doi:10.1007/3-540-45701-1_12 · Cited by 16 · cited 1×
“I. INTRODUCTION From the familiar faces of our friends and family to objects of almost every size in environments of every type, the world that we see is full of structure.”
BackgroundSelf-citation
Cited by
Are Biological Systems Poised at Criticality?
Mora, T., & Bialek, W. (2011) · Journal of Statistical Physics · doi:10.1007/s10955-011-0229-4 · Cited by 734
“Despite all our concerns, Zipf’s law is, in a certain precise sense, a signature of criticality [ 80 ].”
BackgroundSelf-citationGong, Z., Zhong, P., & Hu, W. (2019) · IEEE Access · doi:10.1109/access.2019.2917620 · Cited by 277
Inverse statistical problems: from the inverse Ising problem to data science
Nguyen, H. C., Zecchina, R., & Berg, J. (2017) · Advances in Physics · doi:10.1080/00018732.2017.1341604 · Cited by 258
High-order social interactions in groups of mice
Shemesh, Y., Sztainberg, Y., Forkosh, O., Shlapobersky, T., Chen, A., & Schneidman, E. (2013) · eLife · doi:10.7554/elife.00759 · Cited by 213
Evolution of Brains and Computers: The Roads Not Taken
Solé, R., & Seoane, L. F. (2022) · Entropy · doi:10.3390/e24050665 · Cited by 14
“[63] derived effective statistical physics of natural images, and found that edge-detecting filters (such as the ones in the retina and early layers of CNN) are the simplest, most salient features.”
Background
Metadata
- Authors
- Stephens, G. J., Mora, T., Tkačik, G., & Bialek, W.
- Venue
- Physical Review Letters
- Publisher
- American Physical Society (APS)
- Published
- 2013-01-02
- Volume
- 110
- Issue
- 1
- Pages
- 018701-018701
- ISSN
- 0031-9007 (ISSN-L)
- 1079-7114
- OpenAlex
- W1864265793
- Cited by
- 78
- References
- 10
- FWCI
- 6.15
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.