The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
De novo clustering methods outperform reference-based methods for assigning 16S rRNA gene sequences to operational taxonomic units
Open accessAbstract
Background. 16S rRNA gene sequences are routinely assigned to operational taxonomic units (OTUs) that are then used to analyze complex microbial communities. A number of methods have been employed to carry out the assignment of 16S rRNA gene sequences to OTUs leading to confusion over which method is optimal. A recent study suggested that a clustering method should be selected based on its ability to generate stable OTU assignments that do not change as additional sequences are added to the dataset. In contrast, we contend that the quality of the OTU assignments, the ability of the method to properly represent the distances between the sequences, is more important. Methods. Our analysis implemented six de novo clustering algorithms including the single linkage, complete linkage, average linkage, abundance-based greedy clustering, distance-based greedy clustering, and Swarm and the open and closed-reference methods. Using two previously published datasets we used the Matthew’s Correlation Coefficient (MCC) to assess the stability and quality of OTU assignments. Results. The stability of OTU assignments did not reflect the quality of the assignments. Depending on the dataset being analyzed, the average linkage and the distance and abundance-based greedy clustering methods generated OTUs that were more likely to represent the actual distances between sequences than the open and closed-reference methods. We also demonstrated that for the greedy algorithms VSEARCH produced assignments that were comparable to those produced by USEARCH making VSEARCH a viable free and open source alternative to USEARCH. Further interrogation of the reference-based methods indicated that when USEARCH or VSEARCH were used to identify the closest reference, the OTU assignments were sensitive to the order of the reference sequences because the reference sequences can be identical over the region being considered. More troubling was the observation that while both USEARCH and VSEARCH have a high level of sensitivity to detect reference sequences, the specificity of those matches was poor relative to the true best match. Discussion. Our analysis calls into question the quality and stability of OTU assignments generated by the open and closed-reference methods as implemented in current version of QIIME. This study demonstrates that de novo methods are the optimal method of assigning sequences into OTUs and that the quality of these assignments needs to be assessed for multiple methods to identify the optimal clustering method for a particular dataset.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
QIIME allows analysis of high-throughput community sequencing data
Caporaso, J. G., Kuczynski, J., Stombaugh, J., Bittinger, K., Bushman, F. D., Costello, E. K., Fierer, N., Peña, A. G., Goodrich, J. K., Gordon, J. I., et al. (2010) · Nature Methods · doi:10.1038/nmeth.f.303 · Cited by 34,887
Search and clustering orders of magnitude faster than BLAST
Edgar, R. C. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq461 · Cited by 20,826
Naïve Bayesian Classifier for Rapid Assignment of rRNA Sequences into the New Bacterial Taxonomy
Wang, Q., Garrity, G. M., Tiedje, J. M., & Cole, J. R. (2007) · Applied and Environmental Microbiology · doi:10.1128/aem.00062-07 · Cited by 19,885
Schloss, P. D., Westcott, S. L., Ryabin, T., Hall, J. R., Hartmann, M., Hollister, E. B., Lesniewski, R. A., Oakley, B. B., Parks, D. H., Robinson, C. J., et al. (2009) · Applied and Environmental Microbiology · doi:10.1128/aem.01541-09 · Cited by 19,549
Self-citationUPARSE: highly accurate OTU sequences from microbial amplicon reads
Edgar, R. C. (2013) · Nature Methods · doi:10.1038/nmeth.2604 · Cited by 16,707
UCHIME improves sensitivity and speed of chimera detection
Edgar, R. C., Haas, B. J., Clemente, J. C., Quince, C., & Knight, R. (2011) · Bioinformatics · doi:10.1093/bioinformatics/btr381 · Cited by 15,114
A new method for non-parametric multivariate analysis of variance
Anderson, M. J. (2001) · Austral Ecology · doi:10.1111/j.1442-9993.2001.01070.pp.x · Cited by 13,828
Structure, function and diversity of the healthy human microbiome
The Human Microbiome Project Consortium (2012) · Nature · doi:10.1038/nature11234 · Cited by 11,726
Predictive functional profiling of microbial communities using 16S rRNA marker gene sequences
Langille, M. G. I., Zaneveld, J., Caporaso, J. G., McDonald, D., Knights, D., Reyes, J. A., Clemente, J. C., Burkepile, D. E., Vega Thurber, R. L., Knight, R., et al. (2013) · Nature Biotechnology · doi:10.1038/nbt.2676 · Cited by 9,116
Kozich, J. J., Westcott, S. L., Baxter, N. T., Highlander, S. K., & Schloss, P. D. (2013) · Applied and Environmental Microbiology · doi:10.1128/aem.01043-13 · Cited by 7,112
Self-citationPruesse, E., Quast, C., Knittel, K., Fuchs, B. M., Ludwig, W., Peplies, J., & Glockner, F. O. (2007) · Nucleic Acids Research · doi:10.1093/nar/gkm864 · Cited by 6,668
Comparison of the predicted and observed secondary structure of T4 phage lysozyme
Matthews, B. W. (1975) · Biochimica et Biophysica Acta (BBA) - Protein Structure · doi:10.1016/0005-2795(75)90109-9 · Cited by 5,399 · cited 2×
“We were able to synthesize the relationship between OTU assignments and the distances between sequences using the Matthew’s correlation coefficient (MCC; Matthews, 1975).”
MethodReducing the Effects of PCR Amplification and Sequencing Artifacts on 16S rRNA-Based Studies
Schloss, P. D., Gevers, D., & Westcott, S. L. (2011) · PLoS ONE · doi:10.1371/journal.pone.0027310 · Cited by 2,112
Self-citationPyrosequencing enumerates and contrasts soil microbial diversity
Roesch, L. F. W., Fulthorpe, R. R., Riva, A., Casella, G., Hadwin, A. K. M., Kent, A. D., Daroub, S. H., Camargo, F. A. O., Farmerie, W. G., & Triplett, E. W. (2007) · The ISME Journal · doi:10.1038/ismej.2007.53 · Cited by 1,852
Ironing out the wrinkles in the rare biosphere through improved OTU clustering
Huse, S. M., Welch, D. M., Morrison, H. G., & Sogin, M. L. (2010) · Environmental Microbiology · doi:10.1111/j.1462-2920.2010.02193.x · Cited by 1,346
Hamady, M., Lozupone, C., & Knight, R. (2010) · The ISME Journal · doi:10.1038/ismej.2009.97 · Cited by 1,099
Defining seasonal marine microbial community dynamics
Gilbert, J. A., Steele, J. A., Caporaso, J. G., Steinbrück, L., Reeder, J., Temperton, B., Huse, S., McHardy, A. C., Knight, R., Joint, I., et al. (2012) · The ISME Journal · doi:10.1038/ismej.2011.107 · Cited by 1,042
Swarm: robust and fast clustering method for amplicon-based studies
Mahé, F., Rognes, T., Quince, C., de Vargas, C., & Dunthorn, M. (2014) · PeerJ · doi:10.7717/peerj.593 · Cited by 978
Dynamic Documents with R and knitr
Xie, Y. (2016) · Chapman & Hall/CRC eBooks · doi:10.1201/b15166 · Cited by 746
Schloss, P. D., & Westcott, S. L. (2011) · Applied and Environmental Microbiology · doi:10.1128/aem.02810-10 · Cited by 726
Self-citationAdvancing Our Understanding of the Human Microbiome Using QIIME
Navas-Molina, J. A., Peralta-Sánchez, J. M., González, A., McMurdie, P. J., Vázquez-Baeza, Y., Xu, Z., Ursell, L. K., Lauber, C., Zhou, H., Song, S. J., et al. (2013) · Methods in Enzymology · doi:10.1016/b978-0-12-407863-5.00019-8 · Cited by 609
Rideout, J. R., He, Y., Navas-Molina, J. A., Walters, W. A., Ursell, L. K., Gibbons, S. M., Chase, J., McDonald, D., Gonzalez, A., Robbins-Pianka, A., et al. (2014) · PeerJ · doi:10.7717/peerj.545 · Cited by 548
Seamless R and C++ Integration with Rcpp
Eddelbuettel, D. (2013) · Springer eBooks · doi:10.1007/978-1-4614-6868-4 · Cited by 452
Schloss, P. D. (2010) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000844 · Cited by 392
Self-citationKim, M., Morrison, M., & Yu, Z. (2011) · Journal of Microbiological Methods · doi:10.1016/j.mimet.2010.10.020 · Cited by 355
ESPRIT: estimating species richness using large collections of 16S rRNA pyrosequences
Sun, Y., Cai, Y., Liu, L., Yu, F., Farrell, M. L., McKendree, W., & Farmerie, W. (2009) · Nucleic Acids Research · doi:10.1093/nar/gkp285 · Cited by 303
Schubert, A. M., Sinani, H., & Schloss, P. D. (2015) · mBio · doi:10.1128/mbio.00974-15 · Cited by 276
Self-citationA Comparison of Methods for Clustering 16S rRNA Sequences into OTUs
Chen, W., Zhang, C. K., Cheng, Y., Zhang, S., & Zhao, H. (2013) · PLoS ONE · doi:10.1371/journal.pone.0070837 · Cited by 207
The jsonlite Package: A Practical and Consistent Mapping Between JSON Data and R Objects
Ooms, J. C. L. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1403.2805 · Cited by 172
He, Y., Caporaso, J. G., Jiang, X.-T., Sheng, H.-F., Huse, S. M., Rideout, J. R., Edgar, R. C., Kopylova, E., Walters, W. A., Knight, R., et al. (2015) · Microbiome · doi:10.1186/s40168-015-0081-x · Cited by 171
Sun, Y., Cai, Y., Huse, S. M., Knight, R., Farmerie, W. G., Wang, X., & Mai, V. (2012) · Briefings in Bioinformatics · doi:10.1093/bib/bbr009 · Cited by 170
Cai, Y., & Sun, Y. (2011) · Nucleic Acids Research · doi:10.1093/nar/gkr349 · Cited by 163
Stabilization of the murine gut microbiome following weaning
Schloss, P. D., Schubert, A. M., Zackular, J. P., Iverson, K. D., Young, V. B., & Petrosino, J. F. (2012) · Gut Microbes · doi:10.4161/gmic.21008 · Cited by 156
Self-citationDistribution-Based Clustering: Using Ecology To Refine the Operational Taxonomic Unit
Preheim, S. P., Perrotta, A. R., Martín-Platero, A. M., Gupta, A., & Alm, E. J. (2013) · Applied and Environmental Microbiology · doi:10.1128/aem.00342-13 · Cited by 154
Manipulation of the Gut Microbiota Reveals Role in Colon Tumorigenesis
Zackular, J. P., Baxter, N. T., Chen, G., & Schloss, P. D. (2015) · mSphere · doi:10.1128/msphere.00001-15 · Cited by 127
Self-citationKoeppel, A. F., & Wu, M. (2013) · Nucleic Acids Research · doi:10.1093/nar/gkt241 · Cited by 123
Limits to robustness and reproducibility in the demarcation of operational taxonomic units
Schmidt, T., Rodrigues, J. F. M., & von Mering, C. (2014) · Environmental Microbiology · doi:10.1111/1462-2920.12610 · Cited by 114
Ecological Consistency of SSU rRNA-Based Operational Taxonomic Units at a Global Scale
Schmidt, T., Rodrigues, J. F. M., & von Mering, C. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003594 · Cited by 101
Comparing clustering and pre-processing in taxonomy analysis
Bonder, M. J., Abeln, S., Zaura, E., & Brandt, B. W. (2012) · Bioinformatics · doi:10.1093/bioinformatics/bts552 · Cited by 99
He, Y., Caporaso, J. G., Jiang, X., Sheng, H.-F., Huse, S. M., Rideout, J. R., Edgar, R. C., Kopylova, E., Walters, W. A., Knight, R. D., et al. (2015) · Microbiome · doi:10.1186/s40168-015-0098-1 · Cited by 97
Alignment and clustering of phylogenetic markers - implications for microbial diversity studies
White, J. R., Navlakha, S., Nagarajan, N., Ghodsi, M., Kingsford, C., & Pop, M. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-152 · Cited by 87
Secondary structure improves OTU assignments of 16S rRNA gene sequences
Schloss, P. D. (2012) · The ISME Journal · doi:10.1038/ismej.2012.102 · Cited by 85
Self-citationBarriuso, J., Valverde, J. R., & Mellado, R. P. (2011) · BMC Bioinformatics · doi:10.1186/1471-2105-12-473 · Cited by 78
Shade, A. L., Klimowicz, A. K., Spear, R. N., Linske, M., Donato, J. J., Hogan, C. S., McManus, P. S., & Handelsman, J. (2013) · Applied and Environmental Microbiology · doi:10.1128/aem.02017-13 · Cited by 58
Unraveling the outcome of 16S rDNA-based taxonomy analysis through mock data and simulations
May, A., Abeln, S., Crielaard, W., Heringa, J., & Brandt, B. W. (2014) · Bioinformatics · doi:10.1093/bioinformatics/btu085 · Cited by 36
Cited by
VSEARCH: a versatile open source tool for metagenomics
(2016) · doi:10.7717/peerj.2584 · Cited by 10,773
Exact sequence variants should replace operational taxonomic units in marker-gene data analysis
Callahan, B. J., McMurdie, P. J., & Holmes, S. P. (2017) · The ISME Journal · doi:10.1038/ismej.2017.119 · Cited by 3,300
RESCRIPt: Reproducible sequence taxonomy reference database management
(2021) · doi:10.1371/journal.pcbi.1009581 · Cited by 983
The fecal metabolome as a functional readout of the gut microbiome
Zierer, J., Jackson, M. A., Kastenmüller, G., Mangino, M., Long, T., Telenti, A., Mohney, R. P., Small, K. S., Bell, J. T., Steves, C. J., et al. (2018) · Nature Genetics · doi:10.1038/s41588-018-0135-7 · Cited by 733
Microplastic pollution increases gene exchange in aquatic ecosystems
Arias-Andres, M., Klümper, U., Rojas-Jimenez, K., & Grossart, H.-P. (2018) · Environmental Pollution · doi:10.1016/j.envpol.2018.02.058 · Cited by 662
Metadata
- Authors
- Westcott, S. L., & Schloss, P. D.
- Venue
- PeerJ
- Publisher
- PeerJ
- Published
- 2015-12-08
- Volume
- 3
- Pages
- e1487
- ISSN
- 2167-8359 (ISSN-L)
- OpenAlex
- W1846216853
- Cited by
- 296
- References
- 46
- FWCI
- 14.54
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.