The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Denoising the Denoisers: an independent evaluation of microbiome sequence error-correction approaches
Open accessAbstract
High-depth sequencing of universal marker genes such as the 16S rRNA gene is a common strategy to profile microbial communities. Traditionally, sequence reads are clustered into operational taxonomic units (OTUs) at a defined identity threshold to avoid sequencing errors generating spurious taxonomic units. However, there have been numerous bioinformatic packages recently released that attempt to correct sequencing errors to determine real biological sequences at single nucleotide resolution by generating amplicon sequence variants (ASVs). As more researchers begin to use high resolution ASVs, there is a need for an in-depth and unbiased comparison of these novel “denoising” pipelines. In this study, we conduct a thorough comparison of three of the most widely-used denoising packages (DADA2, UNOISE3, and Deblur) as well as an open-reference 97% OTU clustering pipeline on mock, soil, and host-associated communities. We found from the mock community analyses that although they produced similar microbial compositions based on relative abundance, the approaches identified vastly different numbers of ASVs that significantly impact alpha diversity metrics. Our analysis on real datasets using recommended settings for each denoising pipeline also showed that the three packages were consistent in their per-sample compositions, resulting in only minor differences based on weighted UniFrac and Bray–Curtis dissimilarity. DADA2 tended to find more ASVs than the other two denoising pipelines when analyzing both the real soil data and two other host-associated datasets, suggesting that it could be better at finding rare organisms, but at the expense of possible false positives. The open-reference OTU clustering approach identified considerably more OTUs in comparison to the number of ASVs from the denoising pipelines in all datasets tested. The three denoising approaches were significantly different in their run times, with UNOISE3 running greater than 1,200 and 15 times faster than DADA2 and Deblur, respectively. Our findings indicate that, although all pipelines result in similar general community structure, the number of ASVs/OTUs and resulting alpha-diversity metrics varies considerably and should be considered when attempting to identify rare organisms from possible background noise.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Basic local alignment search tool
Altschul, S. F., Gish, W., Miller, W., Myers, E. W., & Lipman, D. J. (1990) · Journal of Molecular Biology · doi:10.1006/jmbi.1990.9999 · Cited by 98,669
DADA2: High–resolution sample inference from Illumina amplicon data
Callahan, B. J., McMurdie, P. J., Rosen, M. J., Han, A. W., Johnson, A. J. A., & Holmes, S. P. (2016) · Nature Methods · doi:10.1038/nmeth.3869 · Cited by 35,698
QIIME allows analysis of high-throughput community sequencing data
Caporaso, J. G., Kuczynski, J., Stombaugh, J., Bittinger, K., Bushman, F. D., Costello, E. K., Fierer, N., Peña, A. G., Goodrich, J. K., Gordon, J. I., et al. (2010) · Nature Methods · doi:10.1038/nmeth.f.303 · Cited by 34,887
Cutadapt removes adapter sequences from high-throughput sequencing reads
Martin, M. (2011) · EMBnet.journal · doi:10.14806/ej.17.1.200 · Cited by 33,889
vegan: Community Ecology Package
Oksanen, J., Simpson, G. L., Blanchet, F. G., Kindt, R., Legendre, P., Minchin, P. R., O'Hara, R. B., Solymos, P., Stevens, M. H. H., Szoecs, E., et al. (2001) · CRAN: Contributed Packages · doi:10.32614/cran.package.vegan · Cited by 22,615
Search and clustering orders of magnitude faster than BLAST
Edgar, R. C. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq461 · Cited by 20,826
UCHIME improves sensitivity and speed of chimera detection
Edgar, R. C., Haas, B. J., Clemente, J. C., Quince, C., & Knight, R. (2011) · Bioinformatics · doi:10.1093/bioinformatics/btr381 · Cited by 15,114
ggplot2: Elegant Graphics for Data Analysis
Wickham, H. (2009) · doi:10.1007/978-0-387-98141-3 · Cited by 14,447
Greengenes, a Chimera-Checked 16S rRNA Gene Database and Workbench Compatible with ARB
DeSantis, T. Z., Hugenholtz, P., Larsen, N., Rojas, M., Brodie, E. L., Keller, K., Huber, T., Dalevi, D., Hu, P., & Andersen, G. L. (2006) · Applied and Environmental Microbiology · doi:10.1128/aem.03006-05 · Cited by 10,891
VSEARCH: a versatile open source tool for metagenomics
(2016) · doi:10.7717/peerj.2584 · Cited by 10,773
Pruesse, E., Quast, C., Knittel, K., Fuchs, B. M., Ludwig, W., Peplies, J., & Glockner, F. O. (2007) · Nucleic Acids Research · doi:10.1093/nar/gkm864 · Cited by 6,668
The diversity and biogeography of soil bacterial communities
Fierer, N., & Jackson, R. B. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0507535103 · Cited by 5,711
PEAR: a fast and accurate Illumina Paired-End reAd mergeR
Zhang, J., Kobert, K., Flouri, T., & Stamatakis, A. (2014) · Bioinformatics · doi:10.1093/bioinformatics/btt593 · Cited by 4,497
Ribosomal Database Project: data and tools for high throughput rRNA analysis
Cole, J. R., Wang, Q., Fish, J. A., Chai, B., McGarrell, D. M., Sun, Y., Brown, C. T., Porras-Alfaro, A., Kuske, C. R., & Tiedje, J. M. (2014) · Nucleic Acids Research · doi:10.1093/nar/gkt1244 · Cited by 4,367
Towards a unified paradigm for sequence‐based identification of fungi
Kõljalg, U., Nilsson, R. H., Abarenkov, K., Tedersoo, L., Taylor, A. F. S., Bahram, M., Bates, S. T., Bruns, T. D., Bengtsson‐Palme, J., Callaghan, T. M., et al. (2013) · Molecular Ecology · doi:10.1111/mec.12481 · Cited by 3,586
Exact sequence variants should replace operational taxonomic units in marker-gene data analysis
Callahan, B. J., McMurdie, P. J., & Holmes, S. P. (2017) · The ISME Journal · doi:10.1038/ismej.2017.119 · Cited by 3,300
Deblur Rapidly Resolves Single-Nucleotide Community Sequence Patterns
Amir, A., McDonald, D., Navas-Molina, J. A., Kopylova, E., Morton, J. T., Zech Xu, Z., Kightley, E. P., Thompson, L. R., Hyde, E. R., Gonzalez, A., et al. (2017) · mSystems · doi:10.1128/msystems.00191-16 · Cited by 1,881
UNOISE2: improved error-correction for Illumina 16S and ITS amplicon sequencing
Edgar, R. C. (2016) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/081257 · Cited by 1,809
Analyzing and minimizing PCR amplification bias in Illumina sequencing libraries
Aird, D., Ross, M. G., Chen, W.-S., Danielsson, M., Fennell, T., Russ, C., Jaffe, D. B., Nusbaum, C., & Gnirke, A. (2011) · Genome Biology · doi:10.1186/gb-2011-12-2-r18 · Cited by 1,174
GNU Parallel: The Command-Line Power Tool.
Tange, O. (2011) · ;login:: the magazine of USENIX & SAGE · Cited by 905
Microbiome Helper: a Custom and Streamlined Workflow for Microbiome Research
Comeau, A. M., Douglas, G. M., & Langille, M. G. I. (2017) · mSystems · doi:10.1128/msystems.00127-16 · Cited by 679
Self-citationAllali, I., Arnold, J. W., Roach, J., Cadenas, M. B., Butz, N., Hassan, H. M., Koci, M., Ballou, A., Mendoza, M., Ali, R., et al. (2017) · BMC Microbiology · doi:10.1186/s12866-017-1101-8 · Cited by 298
SEPP: SATé-Enabled Phylogenetic Placement
MIRARAB, S., NGUYEN, N., & WARNOW, T. (2011) · Biocomputing 2012 · doi:10.1142/9789814366496_0024 · Cited by 251
Accuracy of microbial community diversity estimated by closed- and open-reference OTUs
Edgar, R. C. (2017) · PeerJ · doi:10.7717/peerj.3889 · Cited by 225
GNU Parallel 20150322 ('Hellwig')
Tange, O. (2015) · Zenodo · doi:10.5281/zenodo.16303 · Cited by 215
Plummer, E. L., & Twin, J. (2015) · Journal of Proteomics & Bioinformatics · doi:10.4172/jpb.1000381 · Cited by 143
Multi-omics differentially classify disease state and treatment outcome in pediatric Crohn’s disease
Douglas, G. M., Hansen, R., Jones, C. M. A., Dunn, K. A., Comeau, A., Bielawski, J. P., Tayler, R., El-Omar, E. M., Russell, R. K., Hold, G. L., et al. (2018) · Microbiome · doi:10.1186/s40168-018-0398-3 · Cited by 124
Self-citationModerate Exercise Has Limited but Distinguishable Effects on the Mouse Microbiome
Lamoureux, E., Grandy, S. A., & Langille, M. G. I. (2017) · mSystems · doi:10.1128/msystems.00006-17 · Cited by 96
Self-citationmockrobiota: a Public Resource for Microbiome Bioinformatics Benchmarking
Bokulich, N. A., Rideout, J. R., Mercurio, W. G., Shiffer, A., Wolfe, B. E., Maurice, C. F., Dutton, R. J., Turnbaugh, P. J., Knight, R. D., & Caporaso, J. G. (2016) · mSystems · doi:10.1128/msystems.00062-16 · Cited by 91
Wong, R. G., Wu, J. R., & Gloor, G. B. (2016) · PLoS ONE · doi:10.1371/journal.pone.0161196 · Cited by 82
Yurgel, S. N., Douglas, G. M., Comeau, A., Mammoliti, M., Dusault, A., Percival, D. C., & Langille, M. G. I. (2017) · Phytobiomes Journal · doi:10.1094/pbiomes-03-17-0012-r · Cited by 63
Self-citation
Cited by
Estaki, M., Jiang, L., Bokulich, N. A., McDonald, D., González, A., Kosciolek, T., Martino, C., Zhu, Q., Birmingham, A., Vázquez‐Baeza, Y., et al. (2020) · Current Protocols in Bioinformatics · doi:10.1002/cpbi.100 · Cited by 565
Comparing bioinformatic pipelines for microbial 16S rRNA amplicon sequencing
Prodan, A., Tremaroli, V., Brolin, H., Zwinderman, A. H., Nieuwdorp, M., & Levin, E. (2020) · PLOS ONE · doi:10.1371/journal.pone.0227434 · Cited by 462
Straub, D., Blackwell, N., Langarica-Fuentes, A., Peltzer, A., Nahnsen, S., & Kleindienst, S. (2020) · Frontiers in Microbiology · doi:10.3389/fmicb.2020.550420 · Cited by 393
Curry, K. D., Wang, Q., Nute, M. G., Tyshaieva, A., Reeves, E., Soriano, S., Wu, Q., Graeber, E., Finzer, P., Mendling, W., et al. (2022) · Nature Methods · doi:10.1038/s41592-022-01520-4 · Cited by 380
Pérez-Cobas, A. E., Gomez-Valero, L., & Buchrieser, C. (2020) · Microbial Genomics · doi:10.1099/mgen.0.000409 · Cited by 314
Metadata
- Authors
- Nearing, J. T., Douglas, G. M., Comeau, A. M., & Langille, M. G. I.
- Venue
- PeerJ
- Publisher
- PeerJ
- Published
- 2018-08-08
- Volume
- 6
- Pages
- e5364
- ISSN
- 2167-8359 (ISSN-L)
- OpenAlex
- W2787925891
- Cited by
- 355
- References
- 32
- FWCI
- 12.79
- Type
- journal article
- Language
- en
- Open access
- gold
- Funders
- Terry Fox Research Institute (TFRI)
- NSERC Alexander Graham Bell Canada Graduate Scholarship
- NSERC Discovery Grant
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.