The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
NG-Tax, a highly accurate and validated pipeline for analysis of 16S rRNA amplicons from complex biomes
Open accessAbstract
Background: Massive high-throughput sequencing of short, hypervariable segments of the 16S ribosomal RNA (rRNA) gene has transformed the methodological landscape describing microbial diversity within and across complex biomes. However, several studies have shown that the methodology rather than the biological variation is responsible for the observed sample composition and distribution. This compromises meta-analyses, although this fact is often disregarded. Results: To facilitate true meta-analysis of microbiome studies, we developed NG-Tax, a pipeline for 16S rRNA gene amplicon sequence analysis that was validated with different mock communities and benchmarked against QIIME as a frequently used pipeline. The microbial composition of 49 independently amplified mock samples was characterized by sequencing two variable 16S rRNA gene regions, V4 and V5-V6, in three separate sequencing runs on Illumina’s HiSeq2000 platform. This allowed for the evaluation of important causes of technical bias in taxonomic classification: 1) run-to-run sequencing variation, 2) PCR–error, and 3) region/primer specific amplification bias. Despite the short read length (~140 nt) and all technical biases, the average specificity of the taxonomic assignment for the phylotypes included in the mock communities was 97.78%. On average 99.95% and 88.43% of the reads could be assigned to at least family or genus level, respectively, while assignment to ‘spurious genera’ represented on average only 0.21% of the reads per sample. Analysis of α- and β-diversity confirmed conclusions guided by biology rather than the aforementioned methodological aspects, which was not achieved with QIIME. Conclusions: Different biological outcomes are commonly observed due to 16S rRNA region-specific performance. NG-Tax demonstrated high robustness against choice of region and other technical biases associated with 16S rRNA gene amplicon sequencing studies, diminishing their impact and providing accurate qualitative and quantitative representation of the true sample composition. This will improve comparability between studies and facilitate efforts towards standardization.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
DADA2: High–resolution sample inference from Illumina amplicon data
Callahan, B. J., McMurdie, P. J., Rosen, M. J., Han, A. W., Johnson, A. J. A., & Holmes, S. P. (2016) · Nature Methods · doi:10.1038/nmeth.3869 · Cited by 35,698
Structure, function and diversity of the healthy human microbiome
The Human Microbiome Project Consortium (2012) · Nature · doi:10.1038/nature11234 · Cited by 11,726
Greengenes, a Chimera-Checked 16S rRNA Gene Database and Workbench Compatible with ARB
DeSantis, T. Z., Hugenholtz, P., Larsen, N., Rojas, M., Brodie, E. L., Keller, K., Huber, T., Dalevi, D., Hu, P., & Andersen, G. L. (2006) · Applied and Environmental Microbiology · doi:10.1128/aem.03006-05 · Cited by 10,891
UniFrac: a New Phylogenetic Method for Comparing Microbial Communities
Lozupone, C., & Knight, R. (2005) · Applied and Environmental Microbiology · doi:10.1128/aem.71.12.8228-8235.2005 · Cited by 8,227
The Long-Term Stability of the Human Gut Microbiota
Faith, J. J., Guruge, J. L., Charbonneau, M., Subramanian, S., Seedorf, H., Goodman, A. L., Clemente, J. C., Knight, R., Heath, A. C., Leibel, R. L., et al. (2013) · Science · doi:10.1126/science.1237439 · Cited by 2,058
Evaluation of 16S rDNA-Based Community Profiling for Human Microbiome Research
Jumpstart Consortium Human Microbiome Project Data Generation Working Group (2012) · PLoS ONE · doi:10.1371/journal.pone.0039315 · Cited by 297
Comparing Apples and Oranges?: Next Generation Sequencing and Its Impact on Microbiome Analysis
Clooney, A. G., Fouhy, F., Sleator, R. D., O’ Driscoll, A., Stanton, C., Cotter, P. D., & Claesson, M. J. (2016) · PLOS ONE · doi:10.1371/journal.pone.0148028 · Cited by 270 · cited 4×
“Some authors raised their concern with comparing data generated using different strategies 29 , which basically suggests that true reproducibility ( i.e. using different approaches and drawing the same biological conclusions) cannot be attained.”
Influential
Research works printed but not linked: 42
- J Qin, 2010, A human gut microbial gene catalogue established by metagenomic sequencing., Nature., 464, 59-65, 10.1038/nature08821 · DOI · Paper page
- G Olsen, 1986, Microbial ecology and evolution: a ribosomal RNA approach., Annu Rev Microbiol., 40, 337-65, 10.1146/annurev.mi.40.100186.002005 · DOI · Paper page
- D Lane, 1985, Rapid determination of 16S ribosomal RNA sequences for phylogenetic analyses., Proc Natl Acad Sci U S A., 82, 6955-9, 10.1073/pnas.82.20.6955 · DOI · Paper page
- M Claesson, 2010, Comparison of two next-generation sequencing technologies for resolving highly complex microbiota composition using tandem variable 16S rRNA gene regions., Nucleic Acids Res., 38, e200, 10.1093/nar/gkq873 · DOI · Paper page
- J Barb, 2016, Development of an Analysis Pipeline Characterizing Multiple Hypervariable Regions of 16S rRNA Using Mock Samples., PLoS One., 11, e0148047, 10.1371/journal.pone.0148047 · DOI
- K Koskinen, 2015, Inconsistent Denoising and Clustering Algorithms for Amplicon Sequence Data., J Comput Biol., 22, 743-51, 10.1089/cmb.2014.0268 · DOI
- Y Sun, 2011, A large-scale benchmark study of existing algorithms for taxonomy-independent microbial community analysis., Brief Bioinform., 13, 107-21, 10.1093/bib/bbr009 · DOI · Paper page
- T Schmidt, 2015, Limits to robustness and reproducibility in the demarcation of operational taxonomic units., Environ Microbiol., 17, 1689-706, 10.1111/1462-2920.12610 · DOI
- J Tremblay, 2015, Primer and platform effects on 16S rRNA tag sequencing., Front Microbiol., 6, 771, 10.3389/fmicb.2015.00771 · DOI · Paper page
- J Caporaso, 2010, QIIME allows analysis of high-throughput community sequencing data., Nat Methods., 7, 335-6, 10.1038/nmeth.f.303 · DOI · Paper page
- C Drummond, 2009, Replicability is not reproducibility: nor is it good science., Proc Eval Methods Mach Learn.
- A Casadevall, 2010, Reproducible science., Infect Immun., 78, 4972-5, 10.1128/IAI.00908-10 · DOI
- N Bokulich, 2013, Quality-filtering vastly improves diversity estimates from Illumina amplicon sequencing., Nat Methods., 10, 57-9, 10.1038/nmeth.2276 · DOI · Paper page
- J Caporaso, 2011, Global patterns of 16S rRNA diversity at a depth of millions of sequences per sample., Proc Natl Acad Sci U S A., 108 Suppl 1, 4516-22, 10.1073/pnas.1000080107 · DOI · Paper page
- E Stackebrandt, 2002, Report of the ad hoc committee for the re-evaluation of the species definition in bacteriology., Int J Syst Evol Microbiol., 52, 1043-7, 10.1099/00207713-52-3-1043 · DOI · Paper page
- E Stackebrandt, 1994, A place for DNA–DNA reassociation and 16S ribosomal-RNA sequence analysis in the present species definition in bacteriology., Int J Syst Bacteriol., 44, 846-849, 10.1099/00207713-44-4-846 · DOI · Paper page
- E Stackenbrandt, 2006, Taxonomic parameters revisited: tarnished gold standards., Microbiol Today., 33, 152-155
- Y Cai, 2011, ESPRIT-Tree: hierarchical clustering analysis of millions of 16S rRNA pyrosequences in quasilinear computational time., Nucleic Acids Res., 39, e95, 10.1093/nar/gkr349 · DOI
- R Edgar, 2010, Search and clustering orders of magnitude faster than BLAST., Bioinformatics., 26, 2460-1, 10.1093/bioinformatics/btq461 · DOI · Paper page
- W Li, 2006, Cd-hit: a fast program for clustering and comparing large sets of protein or nucleotide sequences., Bioinformatics., 22, 1658-9, 10.1093/bioinformatics/btl158 · DOI · Paper page
- P Schloss, 2009, Introducing mothur: open-source, platform-independent, community-supported software for describing and comparing microbial communities., Appl Environ Microbiol., 75, 7537-41, 10.1128/AEM.01541-09 · DOI · Paper page
- F Mahé, 2014, Swarm: robust and fast clustering method for amplicon-based studies., PeerJ., 2, e593, 10.7717/peerj.593 · DOI · Paper page
- J Cole, 2014, Ribosomal Database Project: data and tools for high throughput rRNA analysis., Nucleic Acids Res., 42, D633-42, 10.1093/nar/gkt1244 · DOI · Paper page
- P Yilmaz, 2014, The SILVA and “All-species Living Tree Project (LTP)” taxonomic frameworks., Nucleic Acids Res., 42, D643-8, 10.1093/nar/gkt1209 · DOI · Paper page
- Y He, 2015, Stability of operational taxonomic units: an important but neglected property for analyzing microbial diversity., Microbiome., 3, 20, 10.1186/s40168-015-0081-x · DOI · Paper page
- Y He, 2013, Comparison of microbial diversity determined with the same variable tag sequence extracted from two different PCR amplicons., BMC Microbiol., 13, 208, 10.1186/1471-2180-13-208 · DOI
- Z Liu, 2007, Short pyrosequencing reads suffice for accurate microbial community analysis., Nucleic Acids Res., 35, e120, 10.1093/nar/gkm541 · DOI · Paper page
- Q Wang, 2007, Naive Bayesian classifier for rapid assignment of rRNA sequences into the new bacterial taxonomy., Appl Environ Microbiol., 73, 5261-7, 10.1128/AEM.00062-07 · DOI · Paper page
- Y Wang, 2009, Conservative fragments in bacterial 16S rRNA genes and primer design for 16S ribosomal DNA amplicons in metagenomic studies., PLoS One., 4, e7401, 10.1371/journal.pone.0007401 · DOI · Paper page
- J Gilbert, 2014, The Earth Microbiome project: successes and aspirations., BMC Biol., 12, 69, 10.1186/s12915-014-0069-1 · DOI · Paper page
- A Engelbrektson, 2010, Experimental factors affecting PCR-based estimates of microbial species richness and evenness., ISME J., 4, 642-7, 10.1038/ismej.2009.153 · DOI · Paper page
- A May, 2014, Unraveling the outcome of 16S rDNA-based taxonomy analysis through mock data and simulations., Bioinformatics., 30, 1530-8, 10.1093/bioinformatics/btu085 · DOI
- P Degnan, 2012, Illumina-based analysis of microbial community diversity., ISME J., 6, 183-94, 10.1038/ismej.2011.74 · DOI · Paper page
- M Schirmer, 2015, Insight into biases and sequencing errors for amplicon sequencing with the Illumina MiSeq platform., Nucleic Acids Res., 43, e37, 10.1093/nar/gku1341 · DOI · Paper page
- D Soergel, 2012, Selection of primers for optimal taxonomic classification of environmental 16S rRNA gene sequences., ISME J., 6, 1440-4, 10.1038/ismej.2011.208 · DOI · Paper page
- E Pruesse, 2012, SINA: accurate high-throughput multiple sequence alignment of ribosomal RNA genes., Bioinformatics., 28, 1823-9, 10.1093/bioinformatics/bts252 · DOI · Paper page
- S Hong, 2006, Predicting microbial species richness., Proc Natl Acad Sci U S A., 103, 117-22, 10.1073/pnas.0507245102 · DOI · Paper page
- R Edgar, 2017, Accuracy of microbial community diversity estimated by closed- and open-reference OTUs., PeerJ., 5, e3889, 10.7717/peerj.3889 · DOI · Paper page
- D Faith, 2007, The role of the phylogenetic diversity measure, PD, in bio-informatics: getting the definition right., Evol Bioinform Online., 2, 277-83, 10.1177/117693430600200008 · DOI
- M Rajilic-Stojanovic, 2009, Development and application of the human intestinal tract chip, a phylogenetic microarray: analysis of universally conserved phylotypes in the abundant microbiota of young and elderly adults., Environ Microbiol., 11, 1736-51, 10.1111/j.1462-2920.2009.01900.x · DOI · Paper page
- W Walters, 2011, PrimerProspector: de novo design and taxonomic analysis of barcoded polymerase chain reaction primers., Bioinformatics., 27, 1159-61, 10.1093/bioinformatics/btr087 · DOI · Paper page
- J Ramiro-Garcia, 2018, Dataset 1 in: NG-Tax, a highly accurate and validated pipeline for analysis of 16S rRNA amplicons from complex biomes., F1000Research., 5, 1791, 10.12688/f1000research.9227.2
Cited by
Kers, J. G., & Saccenti, E. (2022) · Frontiers in Microbiology · doi:10.3389/fmicb.2021.796025 · Cited by 359
Korpela, K., Helve, O., Kolho, K.-L., Saisto, T., Skogberg, K., Dikareva, E., Stefanovic, V., Salonen, A., Andersson, S., & de Vos, W. M. (2020) · Cell · doi:10.1016/j.cell.2020.08.047 · Cited by 359
Wampach, L., Heintz-Buschart, A., Fritz, J. V., Ramiro-Garcia, J., Habier, J., Herold, M., Narayanasamy, S., Kaysen, A., Hogan, A. H., Bindl, L., et al. (2018) · Nature Communications · doi:10.1038/s41467-018-07631-x · Cited by 292
Self-citationvan der Lugt, B., van Beek, A. A., Aalvink, S., Meijer, B., Sovran, B., Vermeij, W. P., Brandt, R. M. C., de Vos, W. M., Savelkoul, H. F. J., Steegenga, W. T., et al. (2019) · Immunity & Ageing · doi:10.1186/s12979-019-0145-z · Cited by 217
Müller, M., Hermes, G. D. A., Emanuel E., C., Holst, J. J., Zoetendal, E. G., Smidt, H., Troost, F., Schaap, F. G., Damink, S. O., Jocken, J. W. E., et al. (2020) · Gut Microbes · doi:10.1080/19490976.2019.1704141 · Cited by 120
Self-citation
Metadata
- Authors
- Ramiro-Garcia, J., Hermes, G. D. A., Giatsis, C., Sipkema, D., Zoetendal, E. G., Schaap, P. J., & Smidt, H.
- Venue
- F1000Research
- Publisher
- F1000 Research Ltd
- Published
- 2018-11-23
- Volume
- 5
- Pages
- 1791
- ISSN
- 2046-1402 (ISSN-L)
- OpenAlex
- W2480225869
- Cited by
- 202
- References
- 7
- FWCI
- 8.55
- Type
- journal article
- Language
- en
- Open access
- gold
- Funders
- European Community’s Seventh Framework Program (227197)
- Top Institute Food and Nutrition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: NG-Tax, a highly accurate and validated pipeline for analysis of 16S rRNA amplicons from complex biomes. https://app.cochat.ai/papers/10.12688/f1000research.9227.2
- The paper
- Ramiro-Garcia, J., Hermes, G. D. A., Giatsis, C., Sipkema, D., Zoetendal, E. G., Schaap, P. J., & Smidt, H. (2018). NG-Tax, a highly accurate and validated pipeline for analysis of 16S rRNA amplicons from complex biomes. F1000Research. https://doi.org/10.12688/f1000research.9227.2
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.