Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 202

The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.

NG-Tax, a highly accurate and validated pipeline for analysis of 16S rRNA amplicons from complex biomes

Open access
Ramiro-Garcia, Javier, Hermes, Gerben D. A., Giatsis, Christos, Sipkema, Detmer, Zoetendal, Erwin G., Schaap, Peter J., Smidt, Hauke · 2018 · F1000Research

Abstract

Background: Massive high-throughput sequencing of short, hypervariable segments of the 16S ribosomal RNA (rRNA) gene has transformed the methodological landscape describing microbial diversity within and across complex biomes. However, several studies have shown that the methodology rather than the biological variation is responsible for the observed sample composition and distribution. This compromises meta-analyses, although this fact is often disregarded. Results: To facilitate true meta-analysis of microbiome studies, we developed NG-Tax, a pipeline for 16S rRNA gene amplicon sequence analysis that was validated with different mock communities and benchmarked against QIIME as a frequently used pipeline. The microbial composition of 49 independently amplified mock samples was characterized by sequencing two variable 16S rRNA gene regions, V4 and V5-V6, in three separate sequencing runs on Illumina’s HiSeq2000 platform. This allowed for the evaluation of important causes of technical bias in taxonomic classification: 1) run-to-run sequencing variation, 2) PCR–error, and 3) region/primer specific amplification bias. Despite the short read length (~140 nt) and all technical biases, the average specificity of the taxonomic assignment for the phylotypes included in the mock communities was 97.78%. On average 99.95% and 88.43% of the reads could be assigned to at least family or genus level, respectively, while assignment to ‘spurious genera’ represented on average only 0.21% of the reads per sample. Analysis of α- and β-diversity confirmed conclusions guided by biology rather than the aforementioned methodological aspects, which was not achieved with QIIME. Conclusions: Different biological outcomes are commonly observed due to 16S rRNA region-specific performance. NG-Tax demonstrated high robustness against choice of region and other technical biases associated with 16S rRNA gene amplicon sequencing studies, diminishing their impact and providing accurate qualitative and quantitative representation of the true sample composition. This will improve comparability between studies and facilitate efforts towards standardization.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.12688/f1000research.9227.2

Cites

7 of 7 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 7 references

Research works printed but not linked: 42

  1. J Qin, 2010, A human gut microbial gene catalogue established by metagenomic sequencing., Nature., 464, 59-65, 10.1038/nature08821 · DOI · Paper page
  2. G Olsen, 1986, Microbial ecology and evolution: a ribosomal RNA approach., Annu Rev Microbiol., 40, 337-65, 10.1146/annurev.mi.40.100186.002005 · DOI · Paper page
  3. D Lane, 1985, Rapid determination of 16S ribosomal RNA sequences for phylogenetic analyses., Proc Natl Acad Sci U S A., 82, 6955-9, 10.1073/pnas.82.20.6955 · DOI · Paper page
  4. M Claesson, 2010, Comparison of two next-generation sequencing technologies for resolving highly complex microbiota composition using tandem variable 16S rRNA gene regions., Nucleic Acids Res., 38, e200, 10.1093/nar/gkq873 · DOI · Paper page
  5. J Barb, 2016, Development of an Analysis Pipeline Characterizing Multiple Hypervariable Regions of 16S rRNA Using Mock Samples., PLoS One., 11, e0148047, 10.1371/journal.pone.0148047 · DOI
  6. K Koskinen, 2015, Inconsistent Denoising and Clustering Algorithms for Amplicon Sequence Data., J Comput Biol., 22, 743-51, 10.1089/cmb.2014.0268 · DOI
  7. Y Sun, 2011, A large-scale benchmark study of existing algorithms for taxonomy-independent microbial community analysis., Brief Bioinform., 13, 107-21, 10.1093/bib/bbr009 · DOI · Paper page
  8. T Schmidt, 2015, Limits to robustness and reproducibility in the demarcation of operational taxonomic units., Environ Microbiol., 17, 1689-706, 10.1111/1462-2920.12610 · DOI
  9. J Tremblay, 2015, Primer and platform effects on 16S rRNA tag sequencing., Front Microbiol., 6, 771, 10.3389/fmicb.2015.00771 · DOI · Paper page
  10. J Caporaso, 2010, QIIME allows analysis of high-throughput community sequencing data., Nat Methods., 7, 335-6, 10.1038/nmeth.f.303 · DOI · Paper page
  11. C Drummond, 2009, Replicability is not reproducibility: nor is it good science., Proc Eval Methods Mach Learn.
  12. A Casadevall, 2010, Reproducible science., Infect Immun., 78, 4972-5, 10.1128/IAI.00908-10 · DOI
  13. N Bokulich, 2013, Quality-filtering vastly improves diversity estimates from Illumina amplicon sequencing., Nat Methods., 10, 57-9, 10.1038/nmeth.2276 · DOI · Paper page
  14. J Caporaso, 2011, Global patterns of 16S rRNA diversity at a depth of millions of sequences per sample., Proc Natl Acad Sci U S A., 108 Suppl 1, 4516-22, 10.1073/pnas.1000080107 · DOI · Paper page
  15. E Stackebrandt, 2002, Report of the ad hoc committee for the re-evaluation of the species definition in bacteriology., Int J Syst Evol Microbiol., 52, 1043-7, 10.1099/00207713-52-3-1043 · DOI · Paper page
  16. E Stackebrandt, 1994, A place for DNA–DNA reassociation and 16S ribosomal-RNA sequence analysis in the present species definition in bacteriology., Int J Syst Bacteriol., 44, 846-849, 10.1099/00207713-44-4-846 · DOI · Paper page
  17. E Stackenbrandt, 2006, Taxonomic parameters revisited: tarnished gold standards., Microbiol Today., 33, 152-155
  18. Y Cai, 2011, ESPRIT-Tree: hierarchical clustering analysis of millions of 16S rRNA pyrosequences in quasilinear computational time., Nucleic Acids Res., 39, e95, 10.1093/nar/gkr349 · DOI
  19. R Edgar, 2010, Search and clustering orders of magnitude faster than BLAST., Bioinformatics., 26, 2460-1, 10.1093/bioinformatics/btq461 · DOI · Paper page
  20. W Li, 2006, Cd-hit: a fast program for clustering and comparing large sets of protein or nucleotide sequences., Bioinformatics., 22, 1658-9, 10.1093/bioinformatics/btl158 · DOI · Paper page
  21. P Schloss, 2009, Introducing mothur: open-source, platform-independent, community-supported software for describing and comparing microbial communities., Appl Environ Microbiol., 75, 7537-41, 10.1128/AEM.01541-09 · DOI · Paper page
  22. F Mahé, 2014, Swarm: robust and fast clustering method for amplicon-based studies., PeerJ., 2, e593, 10.7717/peerj.593 · DOI · Paper page
  23. J Cole, 2014, Ribosomal Database Project: data and tools for high throughput rRNA analysis., Nucleic Acids Res., 42, D633-42, 10.1093/nar/gkt1244 · DOI · Paper page
  24. P Yilmaz, 2014, The SILVA and “All-species Living Tree Project (LTP)” taxonomic frameworks., Nucleic Acids Res., 42, D643-8, 10.1093/nar/gkt1209 · DOI · Paper page
  25. Y He, 2015, Stability of operational taxonomic units: an important but neglected property for analyzing microbial diversity., Microbiome., 3, 20, 10.1186/s40168-015-0081-x · DOI · Paper page
  26. Y He, 2013, Comparison of microbial diversity determined with the same variable tag sequence extracted from two different PCR amplicons., BMC Microbiol., 13, 208, 10.1186/1471-2180-13-208 · DOI
  27. Z Liu, 2007, Short pyrosequencing reads suffice for accurate microbial community analysis., Nucleic Acids Res., 35, e120, 10.1093/nar/gkm541 · DOI · Paper page
  28. Q Wang, 2007, Naive Bayesian classifier for rapid assignment of rRNA sequences into the new bacterial taxonomy., Appl Environ Microbiol., 73, 5261-7, 10.1128/AEM.00062-07 · DOI · Paper page
  29. Y Wang, 2009, Conservative fragments in bacterial 16S rRNA genes and primer design for 16S ribosomal DNA amplicons in metagenomic studies., PLoS One., 4, e7401, 10.1371/journal.pone.0007401 · DOI · Paper page
  30. J Gilbert, 2014, The Earth Microbiome project: successes and aspirations., BMC Biol., 12, 69, 10.1186/s12915-014-0069-1 · DOI · Paper page
  31. A Engelbrektson, 2010, Experimental factors affecting PCR-based estimates of microbial species richness and evenness., ISME J., 4, 642-7, 10.1038/ismej.2009.153 · DOI · Paper page
  32. A May, 2014, Unraveling the outcome of 16S rDNA-based taxonomy analysis through mock data and simulations., Bioinformatics., 30, 1530-8, 10.1093/bioinformatics/btu085 · DOI
  33. P Degnan, 2012, Illumina-based analysis of microbial community diversity., ISME J., 6, 183-94, 10.1038/ismej.2011.74 · DOI · Paper page
  34. M Schirmer, 2015, Insight into biases and sequencing errors for amplicon sequencing with the Illumina MiSeq platform., Nucleic Acids Res., 43, e37, 10.1093/nar/gku1341 · DOI · Paper page
  35. D Soergel, 2012, Selection of primers for optimal taxonomic classification of environmental 16S rRNA gene sequences., ISME J., 6, 1440-4, 10.1038/ismej.2011.208 · DOI · Paper page
  36. E Pruesse, 2012, SINA: accurate high-throughput multiple sequence alignment of ribosomal RNA genes., Bioinformatics., 28, 1823-9, 10.1093/bioinformatics/bts252 · DOI · Paper page
  37. S Hong, 2006, Predicting microbial species richness., Proc Natl Acad Sci U S A., 103, 117-22, 10.1073/pnas.0507245102 · DOI · Paper page
  38. R Edgar, 2017, Accuracy of microbial community diversity estimated by closed- and open-reference OTUs., PeerJ., 5, e3889, 10.7717/peerj.3889 · DOI · Paper page
  39. D Faith, 2007, The role of the phylogenetic diversity measure, PD, in bio-informatics: getting the definition right., Evol Bioinform Online., 2, 277-83, 10.1177/117693430600200008 · DOI
  40. M Rajilic-Stojanovic, 2009, Development and application of the human intestinal tract chip, a phylogenetic microarray: analysis of universally conserved phylotypes in the abundant microbiota of young and elderly adults., Environ Microbiol., 11, 1736-51, 10.1111/j.1462-2920.2009.01900.x · DOI · Paper page
  41. W Walters, 2011, PrimerProspector: de novo design and taxonomic analysis of barcoded polymerase chain reaction primers., Bioinformatics., 27, 1159-61, 10.1093/bioinformatics/btr087 · DOI · Paper page
  42. J Ramiro-Garcia, 2018, Dataset 1 in: NG-Tax, a highly accurate and validated pipeline for analysis of 16S rRNA amplicons from complex biomes., F1000Research., 5, 1791, 10.12688/f1000research.9227.2

Cited by

See all 202

Metadata

Authors
Ramiro-Garcia, J., Hermes, G. D. A., Giatsis, C., Sipkema, D., Zoetendal, E. G., Schaap, P. J., & Smidt, H.
Venue
F1000Research
Published
2018-11-23
Volume
5
Pages
1791
ISSN
2046-1402 (ISSN-L)
OpenAlex
W2480225869
Cited by
202
References
7
FWCI
8.55
Type
journal article
Language
en
Open access
gold
Funders
  • European Community’s Seventh Framework Program (227197)
  • Top Institute Food and Nutrition

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: NG-Tax, a highly accurate and validated pipeline for analysis of 16S rRNA amplicons from complex biomes. https://app.cochat.ai/papers/10.12688/f1000research.9227.2
The paper
Ramiro-Garcia, J., Hermes, G. D. A., Giatsis, C., Sipkema, D., Zoetendal, E. G., Schaap, P. J., & Smidt, H. (2018). NG-Tax, a highly accurate and validated pipeline for analysis of 16S rRNA amplicons from complex biomes. F1000Research. https://doi.org/10.12688/f1000research.9227.2

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.