The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
An Empirical Test of Bootstrapping as a Method for Assessing Confidence in Phylogenetic Analysis
Abstract
Bootstrapping is a common method for assessing confidence in phylogenetic analyses. Although bootstrapping was first applied in phylogenetics to assess the repeatability of a given result, bootstrap results are commonly interpreted as a measure of the probability that a phylogenetic estimate represents the true phylogeny. Here we use computer simulations and a laboratory-generated phylogeny to test bootstrapping results of parsimony analyses, both as measures of repeatability (i.e., the probability of repeating a result given a new sample of characters) and accuracy (i.e., the probability that a result represents the true phylogeny). Our results indicate that any given bootstrap proportion provides an unbiased but highly imprecise measure of repeatability, unless the actual probability of replicating the relevant result is nearly one. The imprecision of the estimate is great enough to render the estimate virtually useless as a measure of repeatability. Under conditions thought to be typical of most phylogenetic analyses, however, bootstrap proportions in majority-rule consensus trees provide biased but highly conservative estimates of the probability of correctly inferring the corresponding clades. Specifically, under conditions of equal rates of change, symmetric phylogenies, and internodal change of ≤20% of the characters, bootstrap proportions of ≥70% usually correspond to a probability of ≥95% that the corresponding clade is real. However, under conditions of very high rates of internodal change (approaching randomization of the characters among taxa) or highly unequal rates of change among taxa, bootstrap proportions >50% are overestimates of accuracy.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
CONFIDENCE LIMITS ON PHYLOGENIES: AN APPROACH USING THE BOOTSTRAP
Felsenstein, J. (1985) · Evolution · doi:10.1111/j.1558-5646.1985.tb00420.x · Cited by 44,647
Bootstrap methods: another look at the jackknife
Efron, B. (1979) · The Annals of Statistics · doi:10.1214/aos/1176344552 · Cited by 17,602
The Jackknife, the Bootstrap and Other Resampling Plans
Efron, B. (1982) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611970319 · Cited by 8,120
Better Bootstrap Confidence Intervals
Efron, B. (1987) · Journal of the American Statistical Association · doi:10.1080/01621459.1987.10478410 · Cited by 3,364
Cases in which Parsimony or Compatibility Methods will be Positively Misleading
Felsenstein, J. (1978) · Systematic Biology · doi:10.1093/sysbio/27.4.401 · Cited by 2,896
Cases in which parsimony or compatibility methods will be positively misleading.
Felsenstein, J. (1978) · Systematic Zoology · doi:10.2307/2412923 · Cited by 2,230
Signal, Noise, and Reliability in Molecular Phylogenetic Analyses
Hillis, D. M., & Huelsenbeck, J. P. (1992) · Journal of Heredity · doi:10.1093/oxfordjournals.jhered.a111190 · Cited by 1,287
Self-citation(1992) · Molecular Biology and Evolution · doi:10.1093/oxfordjournals.molbev.a040725 · Cited by 431
Is there Something Wrong with the Bootstrap on Phylogenies? A Reply to Hillis and Bull
Felsenstein, J., & Kishino, H. (1993) · Systematic Biology · doi:10.1093/sysbio/42.2.193 · Cited by 369
Experimental Phylogenetics: Generation of a Known Phylogeny
Hillis, D. M., Bull, J. J., White, M. E., Badgett, M. R., & Molineux, I. J. (1992) · Science · doi:10.1126/science.1736360 · Cited by 305
Self-citation
Cited by
Items 101–124 of 124
Wijayawardene, N. N., Crous, P. W., Kirk, P. M., Hawksworth, D. L., Boonmee, S., Braun, U., Dai, D.-Q., D’souza, M. J., Diederich, P., Dissanayake, A., et al. (2014) · Fungal Diversity · doi:10.1007/s13225-014-0309-2 · Cited by 266
Two novel aflatoxin-producing Aspergillus species from Argentinean peanuts
Pildain, M. B., Frisvad, J. C., Vaamonde, G., Cabral, D., Varga, J., & Samson, R. A. (2008) · INTERNATIONAL JOURNAL OF SYSTEMATIC AND EVOLUTIONARY MICROBIOLOGY · doi:10.1099/ijs.0.65123-0 · Cited by 264
PELLEGRINO, K. C. M., RODRIGUES, M. T., WAITE, A. N., MORANDO, M., YASSUDA, Y. Y., & SITES, J. W. (2005) · Biological Journal of the Linnean Society · doi:10.1111/j.1095-8312.2005.00472.x · Cited by 264
Incongruence in the phylogenomics era
Steenwyk, J. L., Li, Y., Zhou, X., Shen, X.-X., & Rokas, A. (2023) · Nature Reviews Genetics · doi:10.1038/s41576-023-00620-x · Cited by 259
Polyphasic taxonomy of Aspergillus section Fumigati and its teleomorph Neosartorya
Samson, R. A., Hong, S., Peterson, S. W., Frisvad, J. C., & Varga, J. (2007) · Studies in Mycology · doi:10.3114/sim.2007.59.14 · Cited by 259
Ontogeny Discombobulates Phylogeny: Paedomorphosis and Higher-Level Salamander Relationships
Wiens, J. J., Bonett, R. M., Chippindale, P. T., & Anderson, F. (. (2005) · Systematic Biology · doi:10.1080/10635150590906037 · Cited by 258
Phylogenetic lineages in Pseudocercospora
Crous, P. W., Braun, U., Hunter, G. C., Wingfield, M. J., Verkley, G. J. M., Shin, H.-D., Nakashima, C., & Groenewald, J. Z. (2013) · Studies in Mycology · doi:10.3114/sim0005 · Cited by 255
Bargues, M. D., Vigo, M., Horak, P., Dvorak, J., Patzner, R. A., Pointier, J. P., Jackiewicz, M., Meier-Brook, C., & Mas-Coma, S. (2001) · Infection, Genetics and Evolution · doi:10.1016/s1567-1348(01)00019-3 · Cited by 252
Branch-length prior influences Bayesian posterior probability of phylogeny.
Yang, Z., & Rannala, B. (2005) · Systematic Biology · doi:10.1080/10635150590945313 · Cited by 228
Simmonds, P. (2006) · Journal of Virology · doi:10.1128/jvi.01076-06 · Cited by 204
Population structure of Anopheles gambiae in Africa
Lehmann, T. (2003) · Journal of Heredity · doi:10.1093/jhered/esg024 · Cited by 191
High species diversity in Colletotrichum associated with citrus diseases in Europe
Guarnaccia, V., Groenewald, J. Z., Polizzi, G., & Crous, P. W. (2017) · Persoonia - Molecular Phylogeny and Evolution of Fungi · doi:10.3767/persoonia.2017.39.02 · Cited by 134
Argue, D., Groves, C. P., Lee, M. S. Y., & Jungers, W. L. (2017) · Journal of Human Evolution · doi:10.1016/j.jhevol.2017.02.006 · Cited by 123
Shastri, P. S., Shankarnarayan, S. A., Oberoi, J., Rudramurthy, S. M., Wattal, C., & Chakrabarti, A. (2020) · Journal of Critical Care · doi:10.1016/j.jcrc.2020.01.004 · Cited by 103
Characterization of Human Endogenous Retroviral Elements in the Blood of HIV-1-Infected Individuals
Contreras-Galindo, R., Kaplan, M. H., Contreras-Galindo, A. C., Gonzalez-Hernandez, M. J., Ferlenghi, I., Giusti, F., Lorenzo, E., Gitlin, S. D., Dosik, M. H., Yamamura, Y., et al. (2012) · Journal of Virology · doi:10.1128/jvi.00602-11 · Cited by 103
Bayha, K. M., Dawson, M. N., Collins, A. G., Barbeitos, M. S., & Haddock, S. H. D. (2010) · Integrative and Comparative Biology · doi:10.1093/icb/icq074 · Cited by 102
Diverse species of Colletotrichum associated with grapevine anthracnose in China
Yan, J.-Y., Jayawardena, M. M. R. S., Goonasekara, I. D., Wang, Y., Zhang, W., Liu, M., Huang, J.-B., Wang, Z.-Y., Shang, J.-J., Peng, Y.-L., et al. (2015) · Fungal Diversity · doi:10.1007/s13225-014-0310-9 · Cited by 100
Molecular phylogeny of the benthic shallow-water octopuses (Cephalopoda: Octopodinae)
Guzik, M. T., Norman, M. D., & Crozier, R. H. (2005) · Molecular Phylogenetics and Evolution · doi:10.1016/j.ympev.2005.05.009 · Cited by 86
Human Endogenous Retrovirus Type K (HERV-K) Particles Package and Transmit HERV-K–Related Sequences
Contreras-Galindo, R., Kaplan, M. H., Dube, D., Gonzalez-Hernandez, M. J., Chan, S., Meng, F., Dai, M., Omenn, G. S., Gitlin, S. D., & Markovitz, D. M. (2015) · Journal of Virology · doi:10.1128/jvi.00544-15 · Cited by 64
Ekman, S., & Blaalid, R. (2011) · Systematic Biology · doi:10.1093/sysbio/syr022 · Cited by 51
Novel point mutations in the ERG11 gene in clinical isolates of azole resistant Candida species
Silva, D. B. D. S., Rodrigues, L. M. C., Almeida, A. A. D., Oliveira, K. M. P. D., & Grisolia/, A. B. (2016) · Memórias do Instituto Oswaldo Cruz · doi:10.1590/0074-02760150400 · Cited by 42
Species diversity of Pseudocercospora from Far East Asia
Nakashima, C., Motohashi, K., Chen, C.-Y., Groenewald, J. Z., & Crous, P. W. (2016) · Mycological Progress · doi:10.1007/s11557-016-1231-7 · Cited by 38
Application of the hierarchical bootstrap to multi-level data in neuroscience
Saravanan, V., Berman, G. J., & Sober, S. J. (2020) · arXiv · doi:10.48550/arxiv.2007.07797 · Cited by 26
Identification of a new species,Candida subhashii, as a cause of peritonitis
Adam, H., Groenewald, M., Mohan, S., Richardson, S., Bunn, U., Gibas, C. F. C., Poutanen, S., & Sigler, L. (2009) · Medical Mycology · doi:10.1080/13693780802380545 · Cited by 25
Metadata
- Authors
- Hillis, D. M., & Bull, J. J.
- Venue
- Systematic Biology
- Publisher
- Oxford University Press (OUP)
- Published
- 1993-06-01
- Volume
- 42
- Issue
- 2
- Pages
- 182-192
- ISSN
- 1063-5157 (ISSN-L)
- 1076-836X
- OpenAlex
- W1982447955
- Cited by
- 3,631
- References
- 16
- FWCI
- 10.74
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.