The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Entropy and the species accumulation curve: a novel entropy estimator via discovery rates of new species
Abstract
Summary: Estimating Shannon entropy and its exponential from incomplete samples is a central objective of many research fields. However, empirical estimates of Shannon entropy and its exponential depend strongly on sample size and typically exhibit substantial bias. This work uses a novel method to obtain an accurate, low‐bias analytic estimator of entropy, based on species frequency counts. Our estimator does not require prior knowledge of the number of species. We show that there is a close relationship between Shannon entropy and the species accumulation curve, which depicts the cumulative number of observed species as a function of sample size. We reformulate entropy in terms of the expected discovery rates of new species with respect to sample size, that is, the successive slopes of the species accumulation curve. Our estimator is obtained by applying slope estimators derived from an improved Good‐Turing frequency formula. Our method is also applied to estimate mutual information. Extensive simulations from theoretical models and real surveys show that if sample size is not unreasonably small, the resulting entropy estimator is nearly unbiased. Our estimator generally outperforms previous methods in terms of bias and accuracy (low mean squared error) especially when species richness is large and there is a large fraction of undetected species in samples. We discuss the extension of our approach to estimate Shannon entropy for multiple incidence data. The use of our estimator in constructing an integrated rarefaction and extrapolation curve of entropy (or mutual information) as a function of sample size or sample coverage (an aspect of sample completeness) is also discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Estimation of entropy and mutual information
Paninski, L. (2003) · Neural Computation · doi:10.1162/089976603321780272 · Cited by 1,442
Cited by
Chao, A., Gotelli, N. J., Hsieh, T. C., Sander, E. L., Ma, K. H., Colwell, R. K., & Ellison, A. M. (2014) · Ecological Monographs · doi:10.1890/13-0133.1 · Cited by 4,256
Self-citationChao, A., Chiu, C.-H., & Jost, L. (2014) · Annual Review of Ecology, Evolution, and Systematics · doi:10.1146/annurev-ecolsys-120213-091540 · Cited by 1,089
Self-citationMore than one million barriers fragment Europe’s rivers
Belletti, B., Garcia de Leaniz, C., Jones, J., Bizzi, S., Börger, L., Segura, G., Castelletti, A., van de Bund, W., Aarestrup, K., Barry, J., et al. (2020) · Nature · doi:10.1038/s41586-020-3005-2 · Cited by 709
Estimating diversity and entropy profiles via discovery rates of new species
Chao, A., & Jost, L. (2015) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12349 · Cited by 307
Self-citationentropart: An R Package to Measure and Partition Diversity
Marcon, E., & Hérault, B. (2015) · Journal of Statistical Software · doi:10.18637/jss.v067.i08 · Cited by 303
Metadata
- Authors
- Chao, A., Wang, Y. T., & Jost, L.
- Venue
- Methods in Ecology and Evolution
- Publisher
- Wiley
- Published
- 2013-10-16
- Volume
- 4
- Issue
- 11
- Pages
- 1091-1100
- ISSN
- 2041-210X (ISSN-L)
- OpenAlex
- W2106235393
- Cited by
- 169
- References
- 1
- FWCI
- 6.71
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Entropy and the species accumulation curve: a novel entropy estimator via discovery rates of new species. https://app.cochat.ai/papers/10.1111/2041-210x.12108
- The paper
- Chao, A., Wang, Y. T., & Jost, L. (2013). Entropy and the species accumulation curve: a novel entropy estimator via discovery rates of new species. Methods in Ecology and Evolution. https://doi.org/10.1111/2041-210x.12108
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.