The DOI matches its Crossref record; 50 of the 52 references it cites were found in a registry or an index.
The truth about metagenomics: quantifying and counteracting bias in 16S rRNA studies
Open accessAbstract
BACKGROUND: Characterizing microbial communities via next-generation sequencing is subject to a number of pitfalls involving sample processing. The observed community composition can be a severe distortion of the quantities of bacteria actually present in the microbiome, hampering analysis and threatening the validity of conclusions from metagenomic studies. We introduce an experimental protocol using mock communities for quantifying and characterizing bias introduced in the sample processing pipeline. We used 80 bacterial mock communities comprised of prescribed proportions of cells from seven vaginally-relevant bacterial strains to assess the bias introduced in the sample processing pipeline. We created two additional sets of 80 mock communities by mixing prescribed quantities of DNA and PCR product to quantify the relative contribution to bias of (1) DNA extraction, (2) PCR amplification, and (3) sequencing and taxonomic classification for particular choices of protocols for each step. We developed models to predict the "true" composition of environmental samples based on the observed proportions, and applied them to a set of clinical vaginal samples from a single subject during four visits. RESULTS: We observed that using different DNA extraction kits can produce dramatically different results but bias is introduced regardless of the choice of kit. We observed error rates from bias of over 85% in some samples, while technical variation was very low at less than 5% for most bacteria. The effects of DNA extraction and PCR amplification for our protocols were much larger than those due to sequencing and classification. The processing steps affected different bacteria in different ways, resulting in amplified and suppressed observed proportions of a community. When predictive models were applied to clinical samples from a subject, the predicted microbiome profiles were better reflections of the physiology and diagnosis of the subject at the visits than the observed community compositions. CONCLUSIONS: Bias in 16S studies due to DNA extraction and PCR amplification will continue to require attention despite further advances in sequencing technology. Analysis of mock communities can help assess bias and facilitate the interpretation of results from environmental samples.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Inter-study technical variability in microbiome measurements can sometimes, for example, outweigh biological effects6–9.”
From Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium (2017) · cites this paper as [9]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Previous detailed investigations of specific variables in microbiome experiments such as DNA extraction method have, in common with the results we report, enriched for broad classes of Gram-negative rather than Gram-positive bacteria due to technical rather than biological variables9, 24, 27, 28.”
From Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium (2017) · cites this paper as [9]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“our results suggest that microbial physiology, nucleotide composition, protocol biochemistry, and computational assumptions can all interact to induce variation in microbiome assay results9.”
From Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium (2017) · cites this paper as [9]
The cited source says what the claim attributes to it.
In the citing paper
“DNA extraction protocols are a known source of variation between microbial community characterization experiments7–9.”
From Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium (2017) · cites this paper as [9]
In the citing paper
“High-quality evidence that clinical metagenomic assays are effective in guiding patient management will require protocols that minimize potential assay and patient selection bias and compare relevant health outcomes using data sets generated from large patient cohorts119,120.”
From Clinical metagenomics (2019) · cites this paper as [120]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1994) · doi:10.1201/9780429246593 · Cited by 40,500
Naïve Bayesian Classifier for Rapid Assignment of rRNA Sequences into the New Bacterial Taxonomy
Wang, Q., Garrity, G. M., Tiedje, J. M., & Cole, J. R. (2007) · Applied and Environmental Microbiology · doi:10.1128/aem.00062-07 · Cited by 19,885 · cited 2×
“Taxonomic classification was performed using the RDP classifier [32] (see Methods).”
MethodSchloss, P. D., Westcott, S. L., Ryabin, T., Hall, J. R., Hartmann, M., Hollister, E. B., Lesniewski, R. A., Oakley, B. B., Parks, D. H., Robinson, C. J., et al. (2009) · Applied and Environmental Microbiology · doi:10.1128/aem.01541-09 · Cited by 19,549 · cited 1×
“Many sources of bias have been identified in 16S rRNA studies using NGS including PCR amplification [4-11], DNA extraction protocol [5,12,13], sequencing artifacts [8,14-18], DNA copy number [19], sampling depth [7,20,21], and primer design [22-25].”
BackgroundClassification and Regression by randomForest
Liaw, A. I., & Wiener, M. C. (2007) · Cited by 18,594
ggplot2: Elegant Graphics for Data Analysis
Wickham, H. (2009) · doi:10.1007/978-0-387-98141-3 · Cited by 14,447
Structure, function and diversity of the healthy human microbiome
The Human Microbiome Project Consortium (2012) · Nature · doi:10.1038/nature11234 · Cited by 11,726
Vaginal microbiome of reproductive-age women
Ravel, J., Gajer, P., Abdo, Z., Schneider, G. M., Koenig, S. S. K., McCulle, S. L., Karlebach, S., Gorle, R., Russell, J., Tacket, C. O., et al. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1002611107 · Cited by 4,254 · cited 1×
“Because of the low diversity, vaginal samples are often classified by the predominant bacterium into community states or types [40].”
BackgroundLauber, C. L., Hamady, M., Knight, R., & Fierer, N. (2009) · Applied and Environmental Microbiology · doi:10.1128/aem.00335-09 · Cited by 4,063 · cited 1×
“Many sources of bias have been identified in 16S rRNA studies using NGS including PCR amplification [4-11], DNA extraction protocol [5,12,13], sequencing artifacts [8,14-18], DNA copy number [19], sampling depth [7,20,21], and primer design [22-25].”
BackgroundThe interaction of TIGIT with PVR and PVRL2 inhibits human NK cell cytotoxicity
Stanietsky, N., Simic, H., Arapovic, J., Toporik, A., Levy, O., Novik, A., Levine, Z., Beiman, M., Dassa, L., Achdout, H., et al. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0903474106 · Cited by 3,524
Chimeric 16S rRNA sequence formation and detection in Sanger and 454-pyrosequenced PCR amplicons
Haas, B. J., Gevers, D., Earl, A. M., Feldgarden, M., Ward, D. V., Giannoukos, G., Ciulla, D., Tabbaa, D., Highlander, S. K., Sodergren, E., et al. (2011) · Genome Research · doi:10.1101/gr.112730.110 · Cited by 3,473 · cited 2×
“Many sources of bias have been identified in 16S rRNA studies using NGS including PCR amplification [4-11], DNA extraction protocol [5,12,13], sequencing artifacts [8,14-18], DNA copy number [19], sampling depth [7,20,21], and primer design [22-25].”
BackgroundMethod
Cited by
Byrd, A. L., Belkaid, Y., & Segre, J. A. (2018) · Nature Reviews Microbiology · doi:10.1038/nrmicro.2017.157 · Cited by 2,806
Large-scale association analyses identify host factors influencing human gut microbiome composition
Kurilshikov, A., Medina-Gomez, C., Bacigalupe, R., Radjabzadeh, D., Wang, J., Demirkan, A., Le Roy, C. I., Raygoza Garay, J. A., Finnicum, C. T., Liu, X., et al. (2021) · Nature Genetics · doi:10.1038/s41588-020-00763-1 · Cited by 1,786
Chiu, C. Y., & Miller, S. A. (2019) · Nature Reviews Genetics · doi:10.1038/s41576-019-0113-7 · Cited by 1,620
Gupta, V. K., Paul, S., & Dutta, C. (2017) · Frontiers in Microbiology · doi:10.3389/fmicb.2017.01162 · Cited by 1,019
“Some recent studies attributed variations in microbiome profiles to methodological biases (DNA extraction, primer choice and amplification methods) (Brooks et al., 2015; Walker et al., 2015; Gerasimidis et al., 2016; Vebo et al., 2016).”
BackgroundSystematic improvement of amplicon marker gene methods for increased accuracy in microbiome studies
Gohl, D. M., Vangay, P., Garbe, J., MacLean, A., Hauge, A., Becker, A., Gould, T. J., Clayton, J. B., Johnson, T. J., Hunter, R., et al. (2016) · Nature Biotechnology · doi:10.1038/nbt.3601 · Cited by 819
Metadata
- Authors
- Vaginal Microbiome Consortium (additional members), Brooks, J. P., Edwards, D. J., Harwich, M. D., Rivera, M. C., Fettweis, J. M., Serrano, M. G., Reris, R. A., Sheth, N. U., Huang, B., Girerd, P., Strauss, J. F., Jefferson, K. K., & Buck, G. A.
- Affiliations
- Virginia Commonwealth University (US)
- Corresponding author
- Brooks, J Paul
- ORCID
- Venue
- BMC Microbiology
- Published
- 2015-03-21
- Volume
- 15
- Issue
- 1
- Pages
- 66-66
- ISSN
- 1471-2180 (ISSN-L)
- PMC
- PMC4433096
- OpenAlex
- W2113925621
- Cited by
- 528
- References
- 52
- Citations by year
- 2026: 27 · 2025: 39 · 2024: 28 · 2023: 47 · 2022: 51 · 2021: 73 · 2020: 66 · 2019: 51 · 2018: 57 · 2017: 49 · 2016: 37 · 2015: 3
- FWCI
- 21.14
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/2.0 (tdm)
- Locations
- BMC Microbiology (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- VCU Scholars Compass (Virginia Commonwealth University) (submittedVersion)
- Funders
- National Science Foundation (1127914)
- Thomas F. and Kate Miller Jeffress Memorial Trust
- National Institutes of Health
- National Institute of Allergy and Infectious Diseases (UH3AI08326-01)
- Division of Mathematical Sciences (1127914, DMS 1127914)
- National Institute on Minority Health and Health Disparities (P60MD002256)
- Eunice Kennedy Shriver National Institute of Child Health and Human Development (U54HD080784)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gut microbiota and health
- Physical Sciences › Environmental Science › Ecology › Microbial Community Ecology and Physiology
- Keywords
- 16S rRNA gene sequencing, mock microbial community, DNA extraction bias, PCR bias, vaginal microbiota, bias quantification, DNA extraction kit comparison
- MeSH terms
- Bacteria, DNA, Bacterial, Female, Humans, Models, Biological, Phylogeny, RNA, Ribosomal, 16S, Specimen Handling, Vagina, Bias, Polymerase Chain Reaction, Artifacts, Genes, rRNA, Metagenomics, Microbial Consortia, High-Throughput Nucleotide Sequencing, Microbiota
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The truth about metagenomics: quantifying and counteracting bias in 16S rRNA studies. https://app.cochat.ai/papers/10.1186/s12866-015-0351-6
- The paper
- Vaginal Microbiome Consortium (additional members), Brooks, J. P., Edwards, D. J., Harwich, M. D., Rivera, M. C., Fettweis, J. M., Serrano, M. G., Reris, R. A., Sheth, N. U., Huang, B., Girerd, P., Strauss, J. F., Jefferson, K. K., & Buck, G. A. (2015). The truth about metagenomics: quantifying and counteracting bias in 16S rRNA studies. BMC Microbiology. https://doi.org/10.1186/s12866-015-0351-6
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.