The DOI matches its Crossref record; 74 of the 74 references it cites were found in a registry or an index.
The concepts of bias, precision and accuracy, and their use in testing the performance of species richness estimators, with a literature review of estimator performance
Abstract
The purpose of this review is to clarify the concepts of bias, precision and accuracy as they are commonly defined in the biostatistical literature, with our focus on the use of these concepts in quantitatively testing the performance of point estimators (specifically species richness estimators). We first describe the general concepts underlying bias, precision and accuracy, and then describe a number of commonly used unscaled and scaled performance measures of bias, precision and accuracy (e.g. mean error, variance, standard deviation, mean square error, root mean square error, mean absolute error, and all their scaled counterparts) which may be used to evaluate estimator performance. We also provide mathematical formulas and a worked example for most performance measures. Since every measure of estimator performance should be viewed as suggestive, not prescriptive, we also mention several other performance measures that have been used by biostatisticians or ecologists. We then outline several guidelines of how to test the performance of species richness estimators: the detailed description of data simulation models and resampling schemes, the use of real and simulated data sets on as many different estimators as possible, mathematical expressions for all estimators and performance measures, and the presentation of results for each scaled performance measure in numerical tables with increasing levels of sampling effort. We finish with a literature review of promising new research related to species richness estimation, and summarize the results of 14 studies that compared estimator performance, which confirm that with most data sets, non‐parametric estimators (mostly the Chao and jackknife estimators) perform better than other estimators, e.g. curve models or fitting species‐abundance distributions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Model selection and multimodel inference: a practical information-theoretic approach.
Guthery, F. S., Burnham, K. P., & Anderson, D. R. (2003) · The Journal of Wildlife Management · doi:10.2307/3802723 · Cited by 41,495
Biometry: The Principles and Practice of Statistics in Biological Research
Sokal, R. R., & Rohlf, F. J. (1969) · Cited by 20,963
Parry, G. D. R., Johnson, M. S., Bell, R. M., Edwards, R. W., & Wathern, P. (1984) · Planning and Ecology · doi:10.1007/978-1-4899-3045-3_3 · Cited by 7,591
Program MARK: survival estimation from populations of marked animals
White, G. C., & Burnham, K. P. (1999) · Bird Study · doi:10.1080/00063659909477239 · Cited by 7,499
Bootstrap Methods and their Application
Davison, A. C., & Hinkley, D. V. (1997) · doi:10.1017/cbo9780511802843 · Cited by 7,350
Gotelli, N. J., & Colwell, R. K. (2001) · Ecology Letters · doi:10.1046/j.1461-0248.2001.00230.x · Cited by 6,420
Efron, B., & Tibshirani, R. (1986) · Statistical Science · doi:10.1214/ss/1177013815 · Cited by 6,033
Casella, G., & Berger, R. (2024) · Chapman & Hall/CRC eBooks · doi:10.1201/9781003456285 · Cited by 5,711
Bootstrap Methods and Their Application
Loughin, T. M., Davison, A. C., & Hinkley, D. V. (1999) · Journal of the American Statistical Association · doi:10.2307/2669707 · Cited by 5,418
Estimating terrestrial biodiversity through extrapolation
Colwell, R. K., & Coddington, J. A. (1994) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.1994.0091 · Cited by 4,530
An Introduction to the Theory of Statistics
(1911) · Nature · doi:10.1038/087345a0 · Cited by 4,394
Lohrli, A. (1985) · Notes and Queries · doi:10.1093/notesj/32.3.377-a · Cited by 4,352
Ziegel, E. R., Lehmann, E. L., & Casella, G. (1999) · Technometrics · doi:10.2307/1270597 · Cited by 4,203
Model Selection and Inference: A Practical Information-Theoretic Approach
Strawderman, R. L., Burnham, K. P., & Anderson, D. R. (2000) · Journal of the American Statistical Association · doi:10.2307/2669574 · Cited by 4,194
Randomization, Bootstrap and Monte Carlo Methods in Biology
Manly, B. F. J. (2018) · Chapman & Hall/CRC eBooks · doi:10.1201/9781315273075 · Cited by 4,194
THE POPULATION FREQUENCIES OF SPECIES AND THE ESTIMATION OF POPULATION PARAMETERS
GOOD, I. J. (1953) · Biometrika · doi:10.1093/biomet/40.3-4.237 · Cited by 3,437
Burnham, K. P., & Anderson, D. R. (1998) · doi:10.1007/978-1-4757-2917-7 · Cited by 3,387
A leisurely look at the bootstrap, the jackknife, and cross-validation
Efron, B., & Gong, G. (1983) · The American Statistician · doi:10.1080/00031305.1983.10483087 · Cited by 3,229
Statistical inference from capture data on closed animal populations
Otis, D. L., Burnham, K. P., White, G. C., & Anderson, D. R. (1978) · Wildlife Monographs · Cited by 2,442
Statistical Ecology: A Primer on Methods and Computing.
French, D. D., Ludwig, J. A., & Reynolds, J. F. (1989) · The Journal of Applied Ecology · doi:10.2307/2403729 · Cited by 2,121
Null Hypothesis Testing: Problems, Prevalence, and an Alternative
Anderson, D. R., Burnham, K. P., & Thompson, W. L. (2000) · The Journal of Wildlife Management · doi:10.2307/3803199 · Cited by 1,930
Randomization, Bootstrap and Monte Carlo Methods in Biology.
Kemp, A. W., & Manly, B. F. J. (1997) · Biometrics · doi:10.2307/2533527 · Cited by 1,927
INTERPOLATING, EXTRAPOLATING, AND COMPARING INCIDENCE-BASED SPECIES ACCUMULATION CURVES
Colwell, R. K., Mao, C. X., & Chang, J. (2004) · Ecology · doi:10.1890/03-0557 · Cited by 1,788
Estimating the Number of Classes via Sample Coverage
Chao, A., & Lee, S.-M. (1992) · Journal of the American Statistical Association · doi:10.1080/01621459.1992.10475194 · Cited by 1,455
Statistics and Partitioning of Species Diversity, and Similarity among Multiple Communities
Lande, R. (1996) · Oikos · doi:10.2307/3545743 · Cited by 1,409
Lehmann, E. L. (1983) · Springer eBooks · doi:10.1007/978-1-4757-2769-2 · Cited by 1,356
Immunocompetence, ornamentation, and viability of male barn swallows (Hirundo rustica)
Saino, N., Bolzern, A. M., & Møller, A. P. (1997) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.94.2.549 · Cited by 1,355
Counting the Uncountable: Statistical Approaches to Estimating Microbial Diversity
Hughes, J. B., Hellmann, J. J., Ricketts, T. H., & Bohannan, B. J. M. (2001) · Applied and Environmental Microbiology · doi:10.1128/aem.67.10.4399-4406.2001 · Cited by 1,296
Encyclopedia of Statistical Sciences.
Aspinall, L. J., Kotz, S., & Johnson, N. L. (1983) · Applied Statistics · doi:10.2307/2347959 · Cited by 1,258
Survival in small intestinal adenocarcinoma
Zar, N., Holmberg, L., Wilander, E., & Rastad, J. (1996) · European Journal of Cancer · doi:10.1016/s0959-8049(96)00244-4 · Cited by 1,243
Statistical ecology: a primer on Methods and Computing
McCulloch, C. E. (1989) · Mathematical Biosciences · doi:10.1016/0025-5564(89)90036-9 · Cited by 1,215
Kullback-Leibler information as a basis for strong inference in ecological studies
Burnham, K. P., & Anderson, D. R. (2001) · Wildlife Research · doi:10.1071/wr99107 · Cited by 926
Measuring and Monitoring Biological Diversity: Standard Methods for Mammals
Wilson, D. E., Cole, F. R., Nichols, J. D., Rudran, R., & Foster, M. S. (1996) · Cited by 903
West, M. J. (1999) · Trends in Neurosciences · doi:10.1016/s0166-2236(98)01362-9 · Cited by 827
The Use of Species Accumulation Functions for the Prediction of Species Richness
SoberónM., J., & LlorenteB, J. (1993) · Conservation Biology · doi:10.1046/j.1523-1739.1993.07030480.x · Cited by 821
Estimating the Number of Species: A Review
Bunge, J., & Fitzpatrick, M. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10594330 · Cited by 763
Introduction to The Theory of Statistics.
Theobald, C. M., & Larson, H. J. (1974) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2345153 · Cited by 762
Encyclopedia of Statistical Sciences
(2004) · Wiley eBooks · doi:10.1002/0471667196 · Cited by 724
Analysis and Management of Animal Populations: Modeling, Estimation and Decision Making
Williams, B. K., Nichols, J. D., & Conroy, M. J. (2002) · Cited by 637
THE ANT FAUNA OF A TROPICAL RAIN FOREST: ESTIMATING SPECIES RICHNESS THREE DIFFERENT WAYS
Longino, J. T., Coddington, J., & Colwell, R. K. (2002) · Ecology · doi:10.1890/0012-9658(2002)083[0689:tafoat]2.0.co;2 · Cited by 588
ESTIMATING SPECIES RICHNESS: THE IMPORTANCE OF HETEROGENEITY IN SPECIES DETECTABILITY
Boulinier, T., Nichols, J. D., Sauer, J. R., Hines, J. E., & Pollock, K. H. (1998) · Ecology · doi:10.1890/0012-9658(1998)079[1018:esrtio]2.0.co;2 · Cited by 552
Unified Maximum Likelihood Estimates for Closed Capture–Recapture Models Using Mixtures
Pledger, S. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00434.x · Cited by 539
Rare species in communities of tropical insect herbivores: pondering the mystery of singletons
Novotný, V., & Basset, Y. (2000) · Oikos · doi:10.1034/j.1600-0706.2000.890316.x · Cited by 510
Angus, J. E. (1991) · Technometrics · doi:10.1080/00401706.1991.10484898 · Cited by 405
ESTIMATING SPECIES RICHNESS: SENSITIVITY TO SAMPLE COVERAGE AND INSENSITIVITY TO SPATIAL PATTERNS
Brose, U., Martinez, N. D., & Williams, R. J. (2003) · Ecology · doi:10.1890/02-0558 · Cited by 383
International Encyclopedia of Statistics
J., J. E. (1979) · Technometrics · doi:10.1080/00401706.1979.10489790 · Cited by 299
Comparative performance of species richness estimation methods
WALTHER, B. A., & MORAND, S. (1998) · Parasitology · doi:10.1017/s0031182097002230 · Cited by 298
Self-citationNonparametric MLE under Two Closed Capture-Recapture Models with Heterogeneity
Norris, J. L., & Pollock, K. H. (1996) · Biometrics · doi:10.2307/2532902 · Cited by 240
Sampling Effort and Parasite Species Richness
Walther, B. A., Cotgreave, P., Price, R. D., Gregory, R. D., & Clayton, D. H. (1995) · Parasitology Today · doi:10.1016/0169-4758(95)80047-6 · Cited by 232
Self-citationBIAS, PRECISION, AND ACCURACY OF FOUR MEASURES OF SPECIES RICHNESS
Hellmann, J. J., & Fowler, G. W. (1999) · Ecological Applications · doi:10.1890/1051-0761(1999)009[0824:bpaaof]2.0.co;2 · Cited by 230
Geographical Information Systems and Computer Cartography
Jones, C. B. (2014) · Routledge eBooks · doi:10.4324/9781315846231 · Cited by 204
Fitting species–accumulation functions and assessing regional land use impacts on avian diversity
Flather, C. (1996) · Journal of Biogeography · doi:10.1046/j.1365-2699.1996.00980.x · Cited by 204
Species richness estimators: how many species can dance on the head of a pin?
O'HARA, R. B. (2005) · Journal of Animal Ecology · doi:10.1111/j.1365-2656.2005.00940.x · Cited by 196
An overview of closed capture-recapture models
Chao, A. (2001) · Journal of Agricultural, Biological, and Environmental Statistics · doi:10.1198/108571101750524670 · Cited by 192
A comparison of species diversity estimators
Mouillot, D., & Leprêtre, A. (1999) · Population Ecology · doi:10.1007/s101440050024 · Cited by 166
Sampling strategies for the assessment of tree species diversity
Gimaret-Carpentier, C., Pélissier, R., Pascal, J., & Houllier, F. (1998) · Journal of Vegetation Science · doi:10.2307/3237115 · Cited by 144
ESTIMATION OF SPECIES RICHNESS: MIXTURE MODELS, THE ROLE OF RARE SPECIES, AND INFERENTIAL CHALLENGES
Mao, C. X., & Colwell, R. K. (2005) · Ecology · doi:10.1890/04-1078 · Cited by 141
New approaches to analyzing microbial biodiversity data
Bohannan, B. J. M., & Hughes, J. (2003) · Current Opinion in Microbiology · doi:10.1016/s1369-5274(03)00055-9 · Cited by 139
On the Use of Some Methods for the Estimation of Species Richness
Baltanás, Á., & Baltanás, Á. (1992) · Oikos · doi:10.2307/3545566 · Cited by 137
COMDYN: software to study the dynamics of animal communities using a capture—recapture approach
Hines, J. E., Boulinier, T., Nichols, J. D., Sauer, J. R., & Pollock, K. H. (1999) · Bird Study · doi:10.1080/00063659909477247 · Cited by 136
Estimating the Species Accumulation Curve Using Mixtures
Mao, C. X., Colwell, R. K., & Jing, C. (2005) · Biometrics · doi:10.1111/j.1541-0420.2005.00316.x · Cited by 136
Estimating the richness of species with variable mobility
Brose, U., & Martinez, N. D. (2004) · Oikos · doi:10.1111/j.0030-1299.2004.12884.x · Cited by 118
MELO, A. S., Pereira, R. A. S., dos Santos, A. J., et al. (2003) · Oikos · doi:10.1034/j.1600-0706.2003.11893.x · Cited by 108
Geographical information systems and computer cartography
(1998) · Choice Reviews Online · doi:10.5860/choice.35-3885 · Cited by 100
Estimating marine species richness: an evaluation of six extrapolative techniques
Foggo, A., Attrill, M. J., Frost, M. T., & Rowden, A. A. (2003) · Marine Ecology Progress Series · doi:10.3354/meps248015 · Cited by 93
Non-parametric MLE for Poisson species abundance models allowing for heterogeneity between species
Norris, J. L., & Pollock, K. H. (1998) · Environmental and Ecological Statistics · doi:10.1023/a:1009659922745 · Cited by 81
On the estimation of species richness based on the accumulation of previously unrecorded species
Cam, E., Nichols, J. D., Sauer, J. R., & Hines, J. E. (2002) · Ecography · doi:10.1034/j.1600-0587.2002.250112.x · Cited by 79
Measures of species diversity in ecology: an evaluation
Hubálek, Z. (2000) · Folia Zoologica · Cited by 74
The net result: evaluating species richness extrapolation techniques for littoral pond invertebrates
Foggo, A., Rundle, S. D., & Bilton, D. T. (2003) · Freshwater Biology · doi:10.1046/j.1365-2427.2003.01124.x · Cited by 73
Estimating species richness of pitfall catches by non-parametric estimators
Brose, U. (2002) · Pedobiologia · doi:10.1078/0031-4056-00117 · Cited by 64
Modelling heterogeneity of survival in band-recovery data using mixtures
Pledger, S., & Schwarz, C. J. (2002) · Journal of Applied Statistics · doi:10.1080/02664760120108737 · Cited by 58
Martin, J., Gaston, A. J., & Hitier, S. (1995) · Oikos · doi:10.2307/3546045 · Cited by 54
Effects of measurement error on catch-effort estimation
Gould, W., Stefanski, L. A., & Pollock, K. H. (1997) · Canadian Journal of Fisheries and Aquatic Sciences · doi:10.1139/f96-328 · Cited by 23
Diaz-Frances, E., & Gorostiza, L. G. (2002) · Journal of Agricultural Biological and Environmental Statistics · doi:10.1198/108571102294 · Cited by 14
Cited by
Seven Shortfalls that Beset Large-Scale Knowledge of Biodiversity
Hortal, J., de Bello, F., Diniz-Filho, J. A. F., Lewinsohn, T. M., Lobo, J. M., & Ladle, R. J. (2015) · Annual Review of Ecology, Evolution, and Systematics · doi:10.1146/annurev-ecolsys-112414-054400 · Cited by 1,743
Tobler, M. W., Carrillo‐Percastegui, S. E., Leite Pitman, R., Mares, R., & Powell, G. (2008) · Animal Conservation · doi:10.1111/j.1469-1795.2008.00169.x · Cited by 869
Multidimensional biases, gaps and uncertainties in global plant occurrence information
Meyer, C., Weigelt, P., & Kreft, H. (2016) · Ecology Letters · doi:10.1111/ele.12624 · Cited by 572
Fifty thousand years of Arctic vegetation and megafaunal diet
Willerslev, E., Davison, J., Moora, M., Zobel, M., Coissac, E., Edwards, M. E., Lorenzen, E. D., Vestergård, M., Gussarova, G., Haile, J., et al. (2014) · Nature · doi:10.1038/nature12921 · Cited by 569
Clement, N. D., MacDonald, D., & Simpson, A. H. R. W. (2014) · Knee Surgery, Sports Traumatology, Arthroscopy · doi:10.1007/s00167-013-2776-5 · Cited by 481
Metadata
- Authors
- Walther, B. A., & Moore, J. L.
- Venue
- Ecography
- Publisher
- Wiley
- Published
- 2005-10-03
- Volume
- 28
- Issue
- 6
- Pages
- 815-829
- ISSN
- 0906-7590 (ISSN-L)
- 1600-0587
- OpenAlex
- W2114075052
- Cited by
- 847
- References
- 74
- FWCI
- 14.00
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.