The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Bootstrap confidence levels for phylogenetic trees.
Open accessAbstract
Evolutionary trees are often estimated from DNA or RNA sequence data. How much confidence should we have in the estimated trees? In 1985, Felsenstein [Felsenstein, J. (1985) Evolution 39, 783-791] suggested the use of the bootstrap to answer this question. Felsenstein's method, which in concept is a straightforward application of the bootstrap, is widely used, but has been criticized as biased in the genetics literature. This paper concerns the use of the bootstrap in the tree problem. We show that Felsenstein's method is not biased, but that it can be corrected to better agree with standard ideas of confidence levels and hypothesis testing. These corrections can be made by using the more elaborate bootstrap method presented here, at the expense of considerably more computation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
CONFIDENCE LIMITS ON PHYLOGENIES: AN APPROACH USING THE BOOTSTRAP
Felsenstein, J. (1985) · Evolution · doi:10.1111/j.1558-5646.1985.tb00420.x · Cited by 44,647
Kimura, M. (1980) · Journal of Molecular Evolution · doi:10.1007/bf01731581 · Cited by 29,778
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1993) · doi:10.1007/978-1-4899-4541-9 · Cited by 21,230
Self-citationSavitzky-Golay Smoothing Filters
Press, W. H., & Teukolsky, S. A. (1990) · Computers in Physics · doi:10.1063/1.4822961 · Cited by 11,670
An Empirical Test of Bootstrapping as a Method for Assessing Confidence in Phylogenetic Analysis
Hillis, D. M., & Bull, J. J. (1993) · Systematic Biology · doi:10.1093/sysbio/42.2.182 · Cited by 3,631
An Empirical Test of Bootstrapping as a Method for Assessing Confidence in Phylogenetic Analysis
Hillis, D. M., & Bull, J. J. (1993) · Systematic Biology · doi:10.2307/2992540 · Cited by 3,423
Better Bootstrap Confidence Intervals
Efron, B. (1987) · Journal of the American Statistical Association · doi:10.1080/01621459.1987.10478410 · Cited by 3,364
Self-citationAn Introduction to the Bootstrap.
Kimber, A., Efron, B., & Tibshirani, R. J. (1994) · The Statistician · doi:10.2307/2348146 · Cited by 1,245
Self-citationIs there Something Wrong with the Bootstrap on Phylogenies? A Reply to Hillis and Bull
Felsenstein, J., & Kishino, H. (1993) · Systematic Biology · doi:10.1093/sysbio/42.2.193 · Cited by 369
Phylogeny of the malarial genus Plasmodium, derived from rRNA gene sequences.
Escalante, A. A., & Ayala, F. J. (1994) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.91.24.11373 · Cited by 316
Cited by
Application of Phylogenetic Networks in Evolutionary Studies
Huson, D. H., & Bryant, D. (2006) · Molecular Biology and Evolution · doi:10.1093/molbev/msj030 · Cited by 8,830
FastTree: Computing Large Minimum Evolution Trees with Profiles instead of a Distance Matrix
Price, M. N., Dehal, P. S., & Arkin, A. P. (2009) · Molecular Biology and Evolution · doi:10.1093/molbev/msp077 · Cited by 5,602
Ultrafast Approximation for Phylogenetic Bootstrap
Minh, B. Q., Nguyen, M. A. T., & von Haeseler, A. (2013) · Molecular Biology and Evolution · doi:10.1093/molbev/mst024 · Cited by 4,844
An approximately unbiased test of phylogenetic tree selection
Shimodaira, H. (2002) · Systematic Biology · doi:10.1080/10635150290069913 · Cited by 2,791
Approximate likelihood-ratio test for branches: A fast, accurate, and powerful alternative
Anisimova, M., & Gascuel, O. (2006) · Systematic Biology · doi:10.1080/10635150600755453 · Cited by 2,693
Pvclust: an R package for assessing the uncertainty in hierarchical clustering
Suzuki, R., & Shimodaira, H. (2006) · Bioinformatics · doi:10.1093/bioinformatics/btl117 · Cited by 2,451
CONSEL: for assessing the confidence of phylogenetic tree selection
Shimodaira, H., & Hasegawa, M. (2001) · Bioinformatics · doi:10.1093/bioinformatics/17.12.1246 · Cited by 2,041
Markov Chasin Monte Carlo Algorithms for the Bayesian Analysis of Phylogenetic Trees
Larget, B., & Simon, D. L. (1999) · Molecular Biology and Evolution · doi:10.1093/oxfordjournals.molbev.a026160 · Cited by 1,617
Bayesian Estimation of Ancestral Character States on Phylogenies
Pagel, M., Meade, A., & Barker, D. (2004) · Systematic Biology · doi:10.1080/10635150490522232 · Cited by 1,370
Anisimova, M., Gil, M., Dufayard, J.-F., Dessimoz, C., & Gascuel, O. (2011) · Systematic Biology · doi:10.1093/sysbio/syr041 · Cited by 1,291
Horizontal gene transfer in prokaryotes: Quantification and classification
Koonin, E. V., Makarova, K. S., & Aravind, L. (2001) · Annual Review of Microbiology · doi:10.1146/annurev.micro.55.1.709 · Cited by 1,126
Alfaro, M. E. (2003) · Molecular Biology and Evolution · doi:10.1093/molbev/msg028 · Cited by 1,121
Inconsistency of Phylogenetic Estimates from Concatenated Data under Coalescence
Kubatko, L. S., & Degnan, J. H. (2007) · Systematic Biology · doi:10.1080/10635150601146041 · Cited by 1,034
Huelsenbeck, J. P., & Rannala, B. (2004) · Systematic Biology · doi:10.1080/10635150490522629 · Cited by 897
SNAP: predict effect of non-synonymous polymorphisms on function
Bromberg, Y., & Rost, B. (2007) · Nucleic Acids Research · doi:10.1093/nar/gkm238 · Cited by 863
Potential Applications and Pitfalls of Bayesian Inference of Phylogeny
Huelsenbeck, J. P., Larget, B., Miller, R. E., & Ronquist, F. (2002) · Systematic Biology · doi:10.1080/10635150290102366 · Cited by 812
Whittaker, C. A., & Hynes, R. O. (2002) · Molecular Biology of the Cell · doi:10.1091/mbc.e02-05-0259 · Cited by 753
Molecular phylogenetics: principles and practice
Yang, Z., & Rannala, B. (2012) · Nature Reviews Genetics · doi:10.1038/nrg3186 · Cited by 752
Renewing Felsenstein’s phylogenetic bootstrap in the era of big data
Lemoine, F., Domelevo Entfellner, J.-B., Wilkinson, E., Correia, D., Dávila Felipe, M., De Oliveira, T., & Gascuel, O. (2018) · Nature · doi:10.1038/s41586-018-0043-0 · Cited by 700
Reliability of Bayesian Posterior Probabilities and Bootstrap Frequencies in Phylogenetics
Erixon, P., Svennblad, B., Britton, T., & Oxelman, B. (2003) · Systematic Biology · doi:10.1080/10635150390235485 · Cited by 697
Sulaiman, I. M., Fayer, R., Bern, C., Gilman, R. H., Trout, J. M., Schantz, P. M., Das, P., Lal, A. A., & Xiao, L. (2003) · Emerging Infectious Diseases · doi:10.3201/eid0911.030084 · Cited by 692
Extensive introgression in a malaria vector species complex revealed by phylogenomics
Fontaine, M. C., Pease, J. B., Steele, A., Waterhouse, R. M., Neafsey, D. E., Sharakhov, I. V., Jiang, X., Hall, A. B., Catteruccia, F., Kakani, E., et al. (2015) · Science · doi:10.1126/science.1258524 · Cited by 650
Simon, C., Buckley, T. R., Frati, F., Stewart, J. B., & Beckenbach, A. T. (2006) · Annual Review of Ecology, Evolution, and Systematics · doi:10.1146/annurev.ecolsys.37.091305.110018 · Cited by 648
Overcredibility of molecular phylogenies obtained by Bayesian phylogenetics
Suzuki, Y., Glazko, G. V., & Nei, M. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.212646199 · Cited by 647
Phylogeny estimation: traditional and Bayesian approaches
Holder, M., & Lewis, P. O. (2003) · Nature Reviews Genetics · doi:10.1038/nrg1044 · Cited by 638
Geometry of the Space of Phylogenetic Trees
Billera, L. J., Holmes, S. P., & Vogtmann, K. (2001) · Advances in Applied Mathematics · doi:10.1006/aama.2001.0759 · Cited by 611
Self-citationRubin, C., Recker, R., Cullen, D., Ryaby, J., McCabe, J., & McLeod, K. (2004) · Journal of Bone and Mineral Research · doi:10.1359/jbmr.0301251 · Cited by 592
Genetic Diversity within Cryptosporidium parvum and Related Cryptosporidium Species
Xiao, L., Morgan, U. M., Limor, J., Escalante, A., Arrowood, M., Shulaw, W., Thompson, R. C. A., Fayer, R., & Lal, A. A. (1999) · Applied and Environmental Microbiology · doi:10.1128/aem.65.8.3386-3391.1999 · Cited by 592
Genome-Wide Transcript Profiles in Aging and Calorically Restricted Drosophila melanogaster
Pletcher, S. D., Macdonald, S. J., Marguerie, R., Certa, U., Stearns, S. C., Goldstein, D. B., & Partridge, L. (2002) · Current Biology · doi:10.1016/s0960-9822(02)00808-4 · Cited by 571
Reeb, V., Lutzoni, F., & Roux, C. (2004) · Molecular Phylogenetics and Evolution · doi:10.1016/j.ympev.2004.04.012 · Cited by 530
Comparison of Bayesian and Maximum Likelihood Bootstrap Measures of Phylogenetic Reliability
Douady, C. J. (2003) · Molecular Biology and Evolution · doi:10.1093/molbev/msg042 · Cited by 512
Inferring confidence sets of possibly misspecified gene trees
Strimmer, K., & Rambaut, A. (2002) · Proceedings of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rspb.2001.1862 · Cited by 499
Bootstrapping cluster analysis: Assessing the reliability of conclusions from microarray experiments
Kerr, M. K., & Churchill, G. A. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.161273698 · Cited by 474
Wagner, C. E., Keller, I., Wittwer, S., Selz, O. M., Mwaiko, S., Greuter, L., Sivasundar, A., & Seehausen, O. (2013) · Molecular Ecology · doi:10.1111/mec.12023 · Cited by 441
The Interrelationships of Proseriata (Platyhelminthes: Seriata) Tested with Molecules and Morphology
Littlewood, D. T. J., Curini-Galletti, M., & Herniou, E. A. (2000) · Molecular Phylogenetics and Evolution · doi:10.1006/mpev.2000.0802 · Cited by 436
Analysing Six Types of Protein–Protein Interfaces
Ofran, Y., & Rost, B. (2003) · Journal of Molecular Biology · doi:10.1016/s0022-2836(02)01223-8 · Cited by 412
Escalante, A. A., Freeland, D. E., Collins, W. E., & Lal, A. A. (1998) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.95.14.8124 · Cited by 374
How Meaningful Are Bayesian Support Values?
Simmons, M. P., Pickett, K. M., & Miya, M. (2004) · Molecular Biology and Evolution · doi:10.1093/molbev/msh014 · Cited by 373
Developmental barcoding of whole mouse via homing CRISPR
Kalhor, R., Kalhor, K., Mejia, L., Leeper, K., Graveline, A., Mali, P., & Church, G. M. (2018) · Science · doi:10.1126/science.aat9804 · Cited by 363
Brain activity at rest: a multiscale hierarchical functional organization
Doucet, G., Naveau, M., Petit, L., Delcroix, N., Zago, L., Crivello, F., Jobard, G., Tzourio-Mazoyer, N., Mazoyer, B., Mellet, E., et al. (2011) · Journal of Neurophysiology · doi:10.1152/jn.00895.2010 · Cited by 319
Voss, R. S., & Jansa, S. A. (2009) · Bulletin of the American Museum of Natural History · doi:10.1206/322.1 · Cited by 347
Bayesian inference of character evolution
RONQUIST, F. (2004) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2004.07.002 · Cited by 335
Applying the Bootstrap in Phylogeny Reconstruction
Soltis, P. S., & Soltis, D. E. (2003) · Statistical Science · doi:10.1214/ss/1063994980 · Cited by 331
Preserving the Information Content of Species: Genetic Diversity, Phylogeny, and Conservation Worth
Crozier, R. H. (1997) · Annual Review of Ecology and Systematics · doi:10.1146/annurev.ecolsys.28.1.243 · Cited by 322
Phylogenetic Analysis of the Complete Genome of 18 Norwalk-like Viruses
Katayama, K., Shirato-Horikoshi, H., Kojima, S., Kageyama, T., Oka, T., Hoshino, F. B., Fukushi, S., Shinohara, M., Uchida, K., Suzuki, Y., et al. (2002) · Virology · doi:10.1006/viro.2002.1568 · Cited by 315
Troubleshooting Molecular Phylogenetic Analyses
Sanderson, M. J., & Shaffer, H. B. (2002) · Annual Review of Ecology and Systematics · doi:10.1146/annurev.ecolsys.33.010802.150509 · Cited by 315
Pagourelias, E. D., Mirea, O., Duchenne, J., Van Cleemput, J., Delforge, M., Bogaert, J., Kuznetsova, T., & Voigt, J.-U. (2017) · Circulation: Cardiovascular Imaging · doi:10.1161/circimaging.116.005588 · Cited by 306
Comparing Bootstrap and Posterior Probability Values in the Four-Taxon Case
Cummings, M. P., Handley, S. A., Myers, D. S., Reed, D. L., Rokas, A., & Winka, K. (2003) · Systematic Biology · doi:10.1080/10635150309311 · Cited by 305
Vitt, U. A., Hsueh, A. J. W., & Hsueh, A. J. W. (2001) · Molecular Endocrinology · doi:10.1210/me.15.5.681 · Cited by 304
A single evolutionary innovation drives the deep evolution of symbiotic N2-fixation in angiosperms
Werner, G. D. A., Cornwell, W. K., Sprent, J. I., Kattge, J., & Kiers, E. T. (2014) · Nature Communications · doi:10.1038/ncomms5087 · Cited by 289
Statistics and Truth in Phylogenomics
Kumar, S., Filipski, A. J., Battistuzzi, F. U., Kosakovsky Pond, S. L., & Tamura, K. (2012) · Molecular Biology and Evolution · doi:10.1093/molbev/msr202 · Cited by 287
Phylogenetic Tree Construction Using Markov Chain Monte Carlo
Li, S., Pearl, D. K., & Doss, H. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10474227 · Cited by 284
Molecular Evolution: A Statistical Approach
Yang, Z. (2014) · doi:10.1093/acprof:oso/9780199602605.001.0001 · Cited by 273
Determining the statistical significance of relative weights.
Tonidandel, S., LeBreton, J. M., & Johnson, J. W. (2009) · Psychological Methods · doi:10.1037/a0017735 · Cited by 267
Global Biogeography of Reef Fishes: A Hierarchical Quantitative Delineation of Regions
Kulbicki, M., Parravicini, V., Bellwood, D. R., Arias-Gonzàlez, E., Chabanet, P., Floeter, S. R., Friedlander, A., McPherson, J., Myers, R. E., Vigliola, L., et al. (2013) · PLoS ONE · doi:10.1371/journal.pone.0081847 · Cited by 262
Branch-length prior influences Bayesian posterior probability of phylogeny.
Yang, Z., & Rannala, B. (2005) · Systematic Biology · doi:10.1080/10635150590945313 · Cited by 228
Horizontal Gene Transfer Contributes to the Evolution of Arthropod Herbivory
Wybouw, N., Pauchet, Y., Heckel, D. G., & Van Leeuwen, T. (2016) · Genome Biology and Evolution · doi:10.1093/gbe/evw119 · Cited by 209
Embeddings from protein language models predict conservation and variant effects
(2021) · doi:10.1007/s00439-021-02411-y · Cited by 174
Molecular phylogeny of the benthic shallow-water octopuses (Cephalopoda: Octopodinae)
Guzik, M. T., Norman, M. D., & Crozier, R. H. (2005) · Molecular Phylogenetics and Evolution · doi:10.1016/j.ympev.2005.05.009 · Cited by 86
Application of the hierarchical bootstrap to multi-level data in neuroscience
Saravanan, V., Berman, G. J., & Sober, S. J. (2020) · arXiv · doi:10.48550/arxiv.2007.07797 · Cited by 26
Metadata
- Authors
- Efron, B., Halloran, E., & Holmes, S.
- Venue
- Proceedings of the National Academy of Sciences
- Published
- 1996-07-09
- Volume
- 93
- Issue
- 14
- Pages
- 7085-7090
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- OpenAlex
- W2019032222
- Cited by
- 696
- References
- 14
- FWCI
- 2.85
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.