The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Accuracy of taxonomy prediction for 16S rRNA and fungal ITS sequences
Open accessAbstract
Prediction of taxonomy for marker gene sequences such as 16S ribosomal RNA (rRNA) is a fundamental task in microbiology. Most experimentally observed sequences are diverged from reference sequences of authoritatively named organisms, creating a challenge for prediction methods. I assessed the accuracy of several algorithms using cross-validation by identity, a new benchmark strategy which explicitly models the variation in distances between query sequences and the closest entry in a reference database. When the accuracy of genus predictions was averaged over a representative range of identities with the reference database (100%, 99%, 97%, 95% and 90%), all tested methods had ≤50% accuracy on the currently-popular V4 region of 16S rRNA. Accuracy was found to fall rapidly with identity; for example, better methods were found to have V4 genus prediction accuracy of ∼100% at 100% identity but ∼50% at 97% identity. The relationship between identity and taxonomy was quantified as the probability that a rank is the lowest shared by a pair of sequences with a given pair-wise identity. With the V4 region, 95% identity was found to be a twilight zone where taxonomy is highly ambiguous because the probabilities that the lowest shared rank between pairs of sequences is genus, family, order or class are approximately equal.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Basic local alignment search tool
Altschul, S. F., Gish, W., Miller, W., Myers, E. W., & Lipman, D. J. (1990) · Journal of Molecular Biology · doi:10.1006/jmbi.1990.9999 · Cited by 98,669
DADA2: High–resolution sample inference from Illumina amplicon data
Callahan, B. J., McMurdie, P. J., Rosen, M. J., Han, A. W., Johnson, A. J. A., & Holmes, S. P. (2016) · Nature Methods · doi:10.1038/nmeth.3869 · Cited by 35,698
QIIME allows analysis of high-throughput community sequencing data
Caporaso, J. G., Kuczynski, J., Stombaugh, J., Bittinger, K., Bushman, F. D., Costello, E. K., Fierer, N., Peña, A. G., Goodrich, J. K., Gordon, J. I., et al. (2010) · Nature Methods · doi:10.1038/nmeth.f.303 · Cited by 34,887
RAxML version 8: a tool for phylogenetic analysis and post-analysis of large phylogenies
Stamatakis, A. (2014) · Bioinformatics · doi:10.1093/bioinformatics/btu033 · Cited by 32,291
An introduction to ROC analysis
Fawcett, T. (2006) · Pattern Recognition Letters · doi:10.1016/j.patrec.2005.10.010 · Cited by 21,879
Search and clustering orders of magnitude faster than BLAST
Edgar, R. C. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq461 · Cited by 20,826
Self-citationNaïve Bayesian Classifier for Rapid Assignment of rRNA Sequences into the New Bacterial Taxonomy
Wang, Q., Garrity, G. M., Tiedje, J. M., & Cole, J. R. (2007) · Applied and Environmental Microbiology · doi:10.1128/aem.00062-07 · Cited by 19,885
Schloss, P. D., Westcott, S. L., Ryabin, T., Hall, J. R., Hartmann, M., Hollister, E. B., Lesniewski, R. A., Oakley, B. B., Parks, D. H., Robinson, C. J., et al. (2009) · Applied and Environmental Microbiology · doi:10.1128/aem.01541-09 · Cited by 19,549
UPARSE: highly accurate OTU sequences from microbial amplicon reads
Edgar, R. C. (2013) · Nature Methods · doi:10.1038/nmeth.2604 · Cited by 16,707
Self-citationGreengenes, a Chimera-Checked 16S rRNA Gene Database and Workbench Compatible with ARB
DeSantis, T. Z., Hugenholtz, P., Larsen, N., Rojas, M., Brodie, E. L., Keller, K., Huber, T., Dalevi, D., Hu, P., & Andersen, G. L. (2006) · Applied and Environmental Microbiology · doi:10.1128/aem.03006-05 · Cited by 10,891
Database resources of the National Center for Biotechnology Information: update
Wheeler, D. L. (2004) · Nucleic Acids Research · doi:10.1093/nar/gkh073 · Cited by 10,641
Global patterns of 16S rRNA diversity at a depth of millions of sequences per sample
Caporaso, J. G., Lauber, C. L., Walters, W. A., Berg-Lyons, D., Lozupone, C. A., Turnbaugh, P. J., Fierer, N., & Knight, R. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1000080107 · Cited by 9,711
Kozich, J. J., Westcott, S. L., Baxter, N. T., Highlander, S. K., & Schloss, P. D. (2013) · Applied and Environmental Microbiology · doi:10.1128/aem.01043-13 · Cited by 7,112
STACKEBRANDT, E., & GOEBEL, B. M. (1994) · International Journal of Systematic and Evolutionary Microbiology · doi:10.1099/00207713-44-4-846 · Cited by 7,083
Pruesse, E., Quast, C., Knittel, K., Fuchs, B. M., Ludwig, W., Peplies, J., & Glockner, F. O. (2007) · Nucleic Acids Research · doi:10.1093/nar/gkm864 · Cited by 6,668
Bokulich, N. A., Kaehler, B. D., Rideout, J. R., Dillon, M., Bolyen, E., Knight, R., Huttley, G. A., & Gregory Caporaso, J. (2018) · Microbiome · doi:10.1186/s40168-018-0470-z · Cited by 5,881
McDonald, D., Price, M. N., Goodrich, J., Nawrocki, E. P., DeSantis, T. Z., Probst, A., Andersen, G. L., Knight, R., & Hugenholtz, P. (2012) · The ISME Journal · doi:10.1038/ismej.2011.139 · Cited by 5,064
The SILVA and “All-species Living Tree Project (LTP)” taxonomic frameworks
Yilmaz, P., Parfrey, L. W., Yarza, P., Gerken, J., Pruesse, E., Quast, C., Schweer, T., Peplies, J., Ludwig, W., & Glöckner, F. O. (2014) · Nucleic Acids Research · doi:10.1093/nar/gkt1209 · Cited by 3,952
Towards a unified paradigm for sequence‐based identification of fungi
Kõljalg, U., Nilsson, R. H., Abarenkov, K., Tedersoo, L., Taylor, A. F. S., Bahram, M., Bates, S. T., Bruns, T. D., Bengtsson‐Palme, J., Callaghan, T. M., et al. (2013) · Molecular Ecology · doi:10.1111/mec.12481 · Cited by 3,586
The human microbiome: at the interface of health and disease
Cho, I., & Blaser, M. J. (2012) · Nature Reviews Genetics · doi:10.1038/nrg3182 · Cited by 3,449
A framework for human microbiome research
The Human Microbiome Project Consortium (2012) · Nature · doi:10.1038/nature11209 · Cited by 2,650
Yarza, P., Yilmaz, P., Pruesse, E., Glöckner, F. O., Ludwig, W., Schleifer, K.-H., Whitman, W. B., Euzéby, J., Amann, R., & Rosselló-Móra, R. (2014) · Nature Reviews Microbiology · doi:10.1038/nrmicro3330 · Cited by 2,589
The RDP (Ribosomal Database Project)
Maidak, B. L., Olsen, G. J., Larsen, N., Overbeek, R., McCaughey, M. J., & Woese, C. R. (1997) · Nucleic Acids Research · doi:10.1093/nar/25.1.109 · Cited by 2,017
Handelsman, J., Rondon, M. R., Brady, S. F., Clardy, J., & Goodman, R. M. (1998) · Chemistry & Biology · doi:10.1016/s1074-5521(98)90108-9 · Cited by 1,998
Twilight zone of protein sequence alignments
Rost, B. (1999) · Protein Engineering, Design and Selection · doi:10.1093/protein/12.2.85 · Cited by 1,833
UNOISE2: improved error-correction for Illumina 16S and ITS amplicon sequencing
Edgar, R. C. (2016) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/081257 · Cited by 1,809
Self-citationThe RDP-II (Ribosomal Database Project)
Maidak, B. L. (2001) · Nucleic Acids Research · doi:10.1093/nar/29.1.173 · Cited by 1,176
Matsen, F. A., Kodner, R. B., & Armbrust, E. V. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-538 · Cited by 1,050
Exploring Microbial Diversity and Taxonomy Using SSU rRNA Hypervariable Tag Sequencing
Huse, S. M., Dethlefsen, L., Huber, J. A., Welch, D. M., Relman, D. A., & Sogin, M. L. (2008) · PLoS Genetics · doi:10.1371/journal.pgen.1000255 · Cited by 1,001
SINTAX: a simple non-Bayesian taxonomy classifier for 16S and ITS sequences
Edgar, R. C. (2016) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/074161 · Cited by 973
Self-citationUpdating the 97% identity threshold for 16S ribosomal RNA OTUs
Edgar, R. C. (2018) · Bioinformatics · doi:10.1093/bioinformatics/bty113 · Cited by 723
Self-citationImpact of training sets on classification of high-throughput bacterial 16s rRNA gene surveys
Werner, J. J., Koren, O., Hugenholtz, P., DeSantis, T. Z., Walters, W. A., Caporaso, J. G., Angenent, L. T., Knight, R., & Ley, R. E. (2012) · The ISME Journal · doi:10.1038/ismej.2011.82 · Cited by 607
Phymm and PhymmBL: metagenomic phylogenetic classification with interpolated Markov models
Brady, A., & Salzberg, S. L. (2009) · Nature Methods · doi:10.1038/nmeth.1358 · Cited by 537
Human Microbiome in Health and Disease
Pflughoeft, K. J., & Versalovic, J. (2012) · Annual Review of Pathology: Mechanisms of Disease · doi:10.1146/annurev-pathol-011811-132421 · Cited by 529
Database resources of the National Center for Biotechnology Information
Sayers, E. W., Barrett, T., Benson, D. A., Bolton, E., Bryant, S. H., Canese, K., Chetvernin, V., Church, D. M., DiCuccio, M., Federhen, S., et al. (2012) · Nucleic Acids Research · doi:10.1093/nar/gkr1184 · Cited by 523
Bengtsson‐Palme, J., Hartmann, M., Eriksson, K. M., Pal, C., Thorell, K., Larsson, D. G. J., & Nilsson, R. H. (2015) · Molecular Ecology Resources · doi:10.1111/1755-0998.12399 · Cited by 459
Resistance and resilience of the forest soil microbiome to logging-associated compaction
Hartmann, M., Niklaus, P. A., Zimmermann, S., Schmutz, S., Kremer, J., Abarenkov, K., Lüscher, P., Widmer, F., & Frey, B. (2014) · The ISME Journal · doi:10.1038/ismej.2013.141 · Cited by 391
Nilsson, R. H., Tedersoo, L., Ryberg, M., Kristiansson, E., Hartmann, M., Unterseher, M., Porter, T. M., Bengtsson-Palme, J., Walker, D. M., de Sousa, F., et al. (2015) · Microbes and environments · doi:10.1264/jsme2.me14121 · Cited by 271
Self-citationMoran, M. A. (2015) · Science · doi:10.1126/science.aac8455 · Cited by 261
Accuracy of microbial community diversity estimated by closed- and open-reference OTUs
Edgar, R. C. (2017) · PeerJ · doi:10.7717/peerj.3889 · Cited by 225
Self-citationGao, X., Lin, H., Revanna, K., & Dong, Q. (2017) · BMC Bioinformatics · doi:10.1186/s12859-017-1670-4 · Cited by 220
Lan, Y., Wang, Q., Cole, J. R., & Rosen, G. L. (2012) · PLoS ONE · doi:10.1371/journal.pone.0032491 · Cited by 219
Taxonomy annotation and guide tree errors in 16S rRNA databases
Edgar, R. (2018) · PeerJ · doi:10.7717/peerj.5030 · Cited by 215
Self-citationSequence-based classification and identification of Fungi.
Hibbett, D. S., Abarenkov, K., Kõljalg, U., Öpik, M., Chai, B., Cole, J. R., Wang, Q., Crous, P. W., Robert, V., Helgason, T., et al. (2018) · PubMed · doi:10.3852/16-130 · Cited by 207
Deshpande, V., Wang, Q., Greenfield, P., Charleston, M., Porras-Alfaro, A., Kuske, C. R., Cole, J. R., Midgley, D. J., & Tran-Dinh, N. (2016) · Mycologia · doi:10.3852/14-293 · Cited by 204
Sun, Y., Cai, Y., Huse, S. M., Knight, R., Farmerie, W. G., Wang, X., & Mai, V. (2012) · Briefings in Bioinformatics · doi:10.1093/bib/bbr009 · Cited by 170
SPINGO: a rapid species-classifier for microbial amplicon sequences
Allard, G., Ryan, F. J., Jeffery, I. B., & Claesson, M. J. (2015) · BMC Bioinformatics · doi:10.1186/s12859-015-0747-1 · Cited by 159
Howard, M. M., Bell, T. H., & Kao‐Kniffin, J. (2017) · FEMS Microbiology Letters · doi:10.1093/femsle/fnx092 · Cited by 116
Unbiased probabilistic taxonomic classification for DNA barcoding
Somervuo, P. J., Koskela, S., Pennanen, J., Nilsson, R. H., & Ovaskainen, O. (2016) · Bioinformatics · doi:10.1093/bioinformatics/btw346 · Cited by 97
Gut microbiota and allogeneic transplantation
Wang, W., Xu, S., Ren, Z., Jiang, J., & Zheng, S. (2015) · Journal of Translational Medicine · doi:10.1186/s12967-015-0640-8 · Cited by 92
Chaudhary, N., Sharma, A. K., Agarwal, P. C., Gupta, A., & Sharma, V. K. (2015) · PLoS ONE · doi:10.1371/journal.pone.0116106 · Cited by 84
Analysis of 16S rRNA environmental sequences using MEGAN
Mitra, S., Stärk, M., & Huson, D. H. (2011) · BMC Genomics · doi:10.1186/1471-2164-12-s3-s17 · Cited by 84
Thiéry, O., Vasar, M., Jairus, T., Davison, J., Roux, C. P., Kivistik, P. A., Metspalu, A., Milani, L. A., Saks, Ü., Moora, M., et al. (2016) · Molecular Ecology · doi:10.1111/mec.13655 · Cited by 59
Trade-offs between microbiome diversity and productivity in a stratified microbial mat
Bernstein, H. C., Brislawn, C., Renslow, R. S., Dana, K. L., Morton, B. R., Lindemann, S. R., Song, H., Atci, E., Beyenal, H., Fredrickson, J. K., et al. (2016) · The ISME Journal · doi:10.1038/ismej.2016.133 · Cited by 28
microclass: an R-package for 16S taxonomy classification
Liland, K. H., Vinje, H., & Snipen, L. G. (2017) · BMC Bioinformatics · doi:10.1186/s12859-017-1583-2 · Cited by 24
Cited by
RESCRIPt: Reproducible sequence taxonomy reference database management
(2021) · doi:10.1371/journal.pcbi.1009581 · Cited by 983
Boers, S. A., Jansen, R., & Hays, J. P. (2019) · European Journal of Clinical Microbiology & Infectious Diseases · doi:10.1007/s10096-019-03520-3 · Cited by 283
Identifying biases and their potential solutions in human microbiome studies
Nearing, J. T., Comeau, A. M., & Langille, M. G. I. (2021) · Microbiome · doi:10.1186/s40168-021-01059-0 · Cited by 240
Legrand, T. P. R. A., Wynne, J. W., Weyrich, L. S., & Oxley, A. P. A. (2020) · Reviews in Aquaculture · doi:10.1111/raq.12375 · Cited by 265
Fang, G.-Y., Chai, L.-J., Zhong, X.-Z., & Jiang, Y.-J. (2021) · International Journal of Food Microbiology · doi:10.1016/j.ijfoodmicro.2021.109070 · Cited by 91
Metadata
- Authors
- Edgar, R. C.
- Venue
- PeerJ
- Publisher
- PeerJ
- Published
- 2018-04-18
- Volume
- 6
- Pages
- e4652
- ISSN
- 2167-8359 (ISSN-L)
- OpenAlex
- W2802266517
- Cited by
- 319
- References
- 55
- FWCI
- 11.22
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.