The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Entropy estimation of symbol sequences
Open accessAbstract
We discuss algorithms for estimating the Shannon entropy h of finite symbol sequences with long range correlations. In particular, we consider algorithms which estimate h from the code lengths produced by some compression algorithm. Our interest is in describing their convergence with sequence length, assuming no limits for the space and time complexities of the compression algorithms. A scaling law is proposed for extrapolation from finite sample lengths. This is applied to sequences of dynamical systems in non-trivial chaotic regimes, a 1-D cellular automaton, and to written English texts.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb00917.x · Cited by 48,949
On Information and Sufficiency
Kullback, S., & Leibler, R. A. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729694 · Cited by 20,193
A universal algorithm for sequential data compression
Ziv, J., & Lempel, A. (1977) · IEEE Transactions on Information Theory · doi:10.1109/tit.1977.1055714 · Cited by 5,456
Quantitative universality for a class of nonlinear transformations
Feigenbaum, M. J. (1978) · Journal of Statistical Physics · doi:10.1007/bf01020332 · Cited by 3,589
Compression of individual sequences via variable-rate coding
Ziv, J., & Lempel, A. (1978) · IEEE Transactions on Information Theory · doi:10.1109/tit.1978.1055934 · Cited by 3,432
On the Complexity of Finite Sequences
Lempel, A., & Ziv, J. (1976) · IEEE Transactions on Information Theory · doi:10.1109/tit.1976.1055501 · Cited by 2,717
Prediction and Entropy of Printed English
Shannon, C. E. (1951) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1951.tb01366.x · Cited by 2,686
Intermittent transition to turbulence in dissipative dynamical systems
Pomeau, Y., & Manneville, P. (1980) · Communications in Mathematical Physics · doi:10.1007/bf01197757 · Cited by 2,015
A philosophical essay on probabilities
(1952) · Journal of the Franklin Institute · doi:10.1016/0016-0032(52)90656-x · Cited by 1,136
Bell, T., Cleary, J. G., & Witten, I. H. (1990) · Cited by 988
Cited by
Causality detection based on information-theoretic approaches in time series analysis
HLAVACKOVASCHINDLER, K., PALUS, M., VEJMELKA, M., & BHATTACHARYA, J. (2007) · Physics Reports · doi:10.1016/j.physrep.2006.12.004 · Cited by 800
Equitability, mutual information, and the maximal information coefficient
Kinney, J. B., & Atwal, G. S. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1309933111 · Cited by 667
A review of symbolic analysis of experimental data
Daw, C. S., Finney, C. E. A., & Tracy, E. R. (2003) · Review of Scientific Instruments · doi:10.1063/1.1531823 · Cited by 591
Meyer, P. E., Lafitte, F., & Bontempi, G. (2008) · BMC Bioinformatics · doi:10.1186/1471-2105-9-461 · Cited by 510
Regularities unseen, randomness observed: Levels of entropy convergence
Crutchfield, J. P., & Feldman, D. P. (2003) · Chaos: An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.1530990 · Cited by 368
Hausser, J., & Strimmer, K. (2008) · arXiv (Cornell University) · doi:10.48550/arxiv.0811.3579 · Cited by 356
Heart rate variability in bipolar mania and schizophrenia
Henry, B. L., Minassian, A., Paulus, M. P., Geyer, M. A., & Perry, W. (2010) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2009.07.011 · Cited by 197
Authorship Attribution for Neural Text Generation
Uchendu, A., Le, T., Shu, K., & Lee, D. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.673 · Cited by 120
Complexity and Entropy in Legal Language
Friedrich, R. (2021) · Frontiers in Physics · doi:10.3389/fphy.2021.671882 · Cited by 19
Metadata
- Authors
- Schürmann, T., & Grassberger, P.
- Venue
- Chaos: An Interdisciplinary Journal of Nonlinear Science
- Publisher
- AIP Publishing
- Published
- 1996-09-01
- Volume
- 6
- Issue
- 3
- Pages
- 414-427
- ISSN
- 1054-1500 (ISSN-L)
- 1089-7682
- OpenAlex
- W2018891628
- Cited by
- 319
- References
- 33
- FWCI
- 1.92
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.