Comparing bioinformatic pipelines for microbial 16S rRNA amplicon sequencing
Open accessThe DOI matches its Crossref record; 31 of the 32 references it cites were found in a registry or an index.
Abstract
Microbial amplicon sequencing studies are an important tool in biological and biomedical research. Widespread 16S rRNA gene microbial surveys have shed light on the structure of many ecosystems inhabited by bacteria, including the human body. However, specialized software and algorithms are needed to convert raw sequencing data into biologically meaningful information (i.e. tables of bacterial counts). While different bioinformatic pipelines are available in a rapidly changing and improving field, users are often unaware of limitations and biases associated with individual pipelines and there is a lack of agreement regarding best practices. Here, we compared six bioinformatic pipelines for the analysis of amplicon sequence data: three OTU-level flows (QIIME-uclust, MOTHUR, and USEARCH-UPARSE) and three ASV-level (DADA2, Qiime2-Deblur, and USEARCH-UNOISE3). We tested workflows with different quality control options, clustering algorithms, and cutoff parameters on a mock community as well as on a large (N = 2170) recently published fecal sample dataset from the multi-ethnic HELIUS study. We assessed the sensitivity, specificity, and degree of consensus of the different outputs. DADA2 offered the best sensitivity, at the expense of decreased specificity compared to USEARCH-UNOISE3 and Qiime2-Deblur. USEARCH-UNOISE3 showed the best balance between resolution and specificity. OTU-level USEARCH-UPARSE and MOTHUR performed well, but with lower specificity than ASV-level pipelines. QIIME-uclust produced large number of spurious OTUs as well as inflated alpha-diversity measures and should be avoided in future studies. This study provides guidance for researchers using amplicon sequencing to gain biological insights.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures









Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Different analysis methods were used including DNA extraction techniques, primers and hypervariable regions, bioinformatic pipelines, matching databases and clustering cut-offs which may have influenced the outcomes observed.(77-80)”
From Association Between Sex Hormone Levels and Gut Microbiota Composition and Diversity—A Systematic Review (2022) · cites this paper as [77]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
DADA2: High–resolution sample inference from Illumina amplicon data
Callahan, B. J., McMurdie, P. J., Rosen, M. J., Han, A. W., Johnson, A. J. A., & Holmes, S. P. (2016) · Nature Methods · doi:10.1038/nmeth.3869 · Cited by 35,698
QIIME allows analysis of high-throughput community sequencing data
Caporaso, J. G., Kuczynski, J., Stombaugh, J., Bittinger, K., Bushman, F. D., Costello, E. K., Fierer, N., Peña, A. G., Goodrich, J. K., Gordon, J. I., et al. (2010) · Nature Methods · doi:10.1038/nmeth.f.303 · Cited by 34,887
Reproducible, interactive, scalable and extensible microbiome data science using QIIME 2
Bolyen, E., Rideout, J. R., Dillon, M. R., Bokulich, N. A., Abnet, C. C., Al-Ghalith, G. A., Alexander, H., Alm, E. J., Arumugam, M., Asnicar, F., et al. (2019) · Nature Biotechnology · doi:10.1038/s41587-019-0209-9 · Cited by 23,742 · cited 1×
“Qiime2 [8] is the successor platform to QIIME.”
Backgroundphyloseq: An R Package for Reproducible Interactive Analysis and Graphics of Microbiome Census Data
McMurdie, P. J., & Holmes, S. (2013) · PLoS ONE · doi:10.1371/journal.pone.0061217 · Cited by 21,322
Search and clustering orders of magnitude faster than BLAST
Edgar, R. C. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq461 · Cited by 20,826
Schloss, P. D., Westcott, S. L., Ryabin, T., Hall, J. R., Hartmann, M., Hollister, E. B., Lesniewski, R. A., Oakley, B. B., Parks, D. H., Robinson, C. J., et al. (2009) · Applied and Environmental Microbiology · doi:10.1128/aem.01541-09 · Cited by 19,549
UPARSE: highly accurate OTU sequences from microbial amplicon reads
Edgar, R. C. (2013) · Nature Methods · doi:10.1038/nmeth.2604 · Cited by 16,707 · cited 1×
“Both the UPARSE [18] and the UNOISE3 [10] pipelines are implemented in USEARCH [5].”
Methodggplot2: Elegant Graphics for Data Analysis
Wickham, H. (2009) · doi:10.1007/978-0-387-98141-3 · Cited by 14,447
VSEARCH: a versatile open source tool for metagenomics
(2016) · doi:10.7717/peerj.2584 · Cited by 10,773
Kozich, J. J., Westcott, S. L., Baxter, N. T., Highlander, S. K., & Schloss, P. D. (2013) · Applied and Environmental Microbiology · doi:10.1128/aem.01043-13 · Cited by 7,112 · cited 1×
“5) with 515F and 806R primers designed for dual indexing [16] and the V2 Illumina kit (2x250 bp paired-end reads).”
BackgroundQuality-filtering vastly improves diversity estimates from Illumina amplicon sequencing
Bokulich, N. A., Subramanian, S., Faith, J. J., Gevers, D., Gordon, J. I., Knight, R., Mills, D. A., & Caporaso, J. G. (2013) · Nature Methods · doi:10.1038/nmeth.2276 · Cited by 4,401
The Human Intestinal Microbiome in Health and Disease
Lynch, S. V., & Pedersen, O. (2016) · New England Journal of Medicine · doi:10.1056/nejmra1600266 · Cited by 3,637
Exact sequence variants should replace operational taxonomic units in marker-gene data analysis
Callahan, B. J., McMurdie, P. J., & Holmes, S. P. (2017) · The ISME Journal · doi:10.1038/ismej.2017.119 · Cited by 3,300 · cited 2×
“The other three (Qiime2-Deblur, DADA2, and USEARCH-UNOISE3) attempt to reconstruct the exact biological sequences present in the sample, so-called Amplicon Sequence Variants (ASVs) [9].”
BackgroundVennDiagram: a package for the generation of highly-customizable Venn and Euler diagrams in R
Chen, H., & Boutros, P. C. (2011) · BMC Bioinformatics · doi:10.1186/1471-2105-12-35 · Cited by 3,131
Deblur Rapidly Resolves Single-Nucleotide Community Sequence Patterns
Amir, A., McDonald, D., Navas-Molina, J. A., Kopylova, E., Morton, J. T., Zech Xu, Z., Kightley, E. P., Thompson, L. R., Hyde, E. R., Gonzalez, A., et al. (2017) · mSystems · doi:10.1128/msystems.00191-16 · Cited by 1,881
UNOISE2: improved error-correction for Illumina 16S and ITS amplicon sequencing
Edgar, R. C. (2016) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/081257 · Cited by 1,809
Error filtering, pair assembly and error correction for next-generation sequencing reads
Edgar, R. C., & Flyvbjerg, H. (2015) · Bioinformatics · doi:10.1093/bioinformatics/btv401 · Cited by 1,275
The Third Revolution in Sequencing Technology
van Dijk, E. L., Jaszczyszyn, Y., Naquin, D., & Thermes, C. (2018) · Trends in Genetics · doi:10.1016/j.tig.2018.05.008 · Cited by 1,057 · cited 1×
“Rapid progress in DNA sequencing technology has provided ever-increasing outputs coupled with lowered costs, facilitating an explosion in amplicon sequencing studies [3].”
BackgroundVisualization of a Correlation Matrix [R package corrplot version 0.84]
Wei, T., & Šimko, V. (2017) · Cited by 726
Deschasaux, M., Bouter, K. E., Prodan, A., Levin, E., Groen, A. K., Herrema, H., Tremaroli, V., Bakker, G. J., Attaye, I., Pinto-Sietsma, S.-J., et al. (2018) · Nature Medicine · doi:10.1038/s41591-018-0160-1 · Cited by 695
Self-citationSequence-specific error profile of Illumina sequencers
Nakamura, K., Oshima, T., Morimoto, T., Ikeda, S., Yoshikawa, H., Shiwa, Y., Ishikawa, S., Linak, M. C., Hirai, A., Takahashi, H., et al. (2011) · Nucleic Acids Research · doi:10.1093/nar/gkr344 · Cited by 600 · cited 2×
“Examples of such patterns are “GGC” triplets or inverted repeats (more than 8 bases long) located upstream of the respective position [29].”
BackgroundRideout, J. R., He, Y., Navas-Molina, J. A., Walters, W. A., Ursell, L. K., Gibbons, S. M., Chase, J., McDonald, D., Gonzalez, A., Robbins-Pianka, A., et al. (2014) · PeerJ · doi:10.7717/peerj.545 · Cited by 548
BAIRD, D. J., & HAJIBABAEI, M. (2012) · Molecular Ecology · doi:10.1111/j.1365-294x.2012.05519.x · Cited by 502
Westcott, S. L., & Schloss, P. D. (2017) · mSphere · doi:10.1128/mspheredirect.00073-17 · Cited by 420
Nearing, J. T., Douglas, G. M., Comeau, A. M., & Langille, M. G. I. (2018) · PeerJ · doi:10.7717/peerj.5364 · Cited by 355
UCHIME2: improved chimera prediction for amplicon sequencing
Edgar, R. C. (2016) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/074252 · Cited by 351 · cited 1×
“The final set of ASVs undergoes chimera filtering using the UCHIME2 [23] algorithm in de novo mode.”
MethodCohort profile: the Healthy Life in an Urban Setting (HELIUS) study in Amsterdam, The Netherlands
Snijder, M. B., Galenkamp, H., Prins, M., Derks, E. M., Peters, R. J. G., Zwinderman, A. H., & Stronks, K. (2017) · BMJ Open · doi:10.1136/bmjopen-2017-017873 · Cited by 274
Self-citationMobini, R., Tremaroli, V., Ståhlman, M., Karlsson, F., Levin, M., Ljungberg, M., Sohlin, M., Bertéus Forslund, H., Perkins, R., Bäckhed, F., et al. (2017) · Diabetes, Obesity and Metabolism · doi:10.1111/dom.12861 · Cited by 263
Self-citationAccuracy of microbial community diversity estimated by closed- and open-reference OTUs
Edgar, R. C. (2017) · PeerJ · doi:10.7717/peerj.3889 · Cited by 225
Almeida, A., Mitchell, A., Tarkowska, A., & Finn, R. D. (2018) · GigaScience · doi:10.1093/gigascience/giy054 · Cited by 144
Cited by
Primer, Pipelines, Parameters: Issues in 16S rRNA Gene Sequencing
Abellan-Schneyder, I., Matchado, M. S., Reitmeier, S., Sommer, A., Sewald, Z., Baumbach, J., List, M., & Neuhaus, K. (2021) · mSphere · doi:10.1128/msphere.01202-20 · Cited by 498
Straub, D., Blackwell, N., Langarica-Fuentes, A., Peltzer, A., Nahnsen, S., & Kleindienst, S. (2020) · Frontiers in Microbiology · doi:10.3389/fmicb.2020.550420 · Cited by 393
“, 2017), or OTU clustering to error-correcting ASV methods (Nearing et al., 2018; Prodan et al., 2020).”
BackgroundChiarello, M., McCauley, M., Villéger, S., & Jackson, C. R. (2022) · PLOS ONE · doi:10.1371/journal.pone.0264443 · Cited by 225
“From these studies, the main weakness of OTU-based approaches appears to be in the accurate detection of alpha diversity, as OTUs often overestimate bacterial richness when compared to ASVs, whereas estimates of beta diversity estimates are typically more congruent between methodologies [15, 19, 21, 22].”
BackgroundMethodResultInfluentialCornell, C. R., Zhang, Y., Ning, D., Xiao, N., Wagle, P., Xiao, X., & Zhou, J. (2023) · The ISME Journal · doi:10.1038/s41396-023-01521-x · Cited by 229
“Reads were then processed using USEARCH-UNOISE3 [77, 78] which has been shown to have a good balance between resolution and speci fi city for amplicon sequencing process [79].”
MethodAn Introduction to Next Generation Sequencing Bioinformatic Analysis in Gut Microbiome Studies
Gao, B., Chi, L., Zhu, Y., Shi, X., Tu, P., Li, B., Yin, J., Gao, N., Shen, W., & Schnabl, B. (2021) · Biomolecules · doi:10.3390/biom11040530 · Cited by 163
Metadata
- Authors
- Prodan, A., Tremaroli, V., Brolin, H., Zwinderman, A. H., Nieuwdorp, M., & Levin, E.
- Affiliations
- Amsterdam University Medical Centers (NL)
- University of Gothenburg (SE)
- Corresponding author
- Prodan, Andrei
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2020-01-16
- Volume
- 15
- Issue
- 1
- Pages
- e0227434
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC6964864
- OpenAlex
- W2999369378
- Cited by
- 462
- References
- 32
- Citations by year
- 2026: 51 · 2025: 64 · 2024: 66 · 2023: 84 · 2022: 91 · 2021: 80 · 2020: 25
- FWCI
- 22.69
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Pure Amsterdam UMC (publishedVersion, cc-by)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Funders
- Hartstichting (016.146.327)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
- Physical Sciences › Environmental Science › Ecology › Microbial Community Ecology and Physiology
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gut microbiota and health
- Keywords
- 16S rRNA amplicon sequencing, OTU clustering, amplicon sequence variants, DADA2, mothur, mock communities, fecal microbiota, HELIUS study, alpha diversity, sensitivity and specificity, quality control
- MeSH terms
- Algorithms, Bacteria, DNA, Bacterial, Feces, Humans, RNA, Ribosomal, 16S, Software, Sequence Analysis, RNA, Computational Biology, Datasets as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.