Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 50 of the 52 references it cites were found in a registry or an index.

The truth about metagenomics: quantifying and counteracting bias in 16S rRNA studies

Open access

Abstract

BACKGROUND: Characterizing microbial communities via next-generation sequencing is subject to a number of pitfalls involving sample processing. The observed community composition can be a severe distortion of the quantities of bacteria actually present in the microbiome, hampering analysis and threatening the validity of conclusions from metagenomic studies. We introduce an experimental protocol using mock communities for quantifying and characterizing bias introduced in the sample processing pipeline. We used 80 bacterial mock communities comprised of prescribed proportions of cells from seven vaginally-relevant bacterial strains to assess the bias introduced in the sample processing pipeline. We created two additional sets of 80 mock communities by mixing prescribed quantities of DNA and PCR product to quantify the relative contribution to bias of (1) DNA extraction, (2) PCR amplification, and (3) sequencing and taxonomic classification for particular choices of protocols for each step. We developed models to predict the "true" composition of environmental samples based on the observed proportions, and applied them to a set of clinical vaginal samples from a single subject during four visits. RESULTS: We observed that using different DNA extraction kits can produce dramatically different results but bias is introduced regardless of the choice of kit. We observed error rates from bias of over 85% in some samples, while technical variation was very low at less than 5% for most bacteria. The effects of DNA extraction and PCR amplification for our protocols were much larger than those due to sequencing and classification. The processing steps affected different bacteria in different ways, resulting in amplified and suppressed observed proportions of a community. When predictive models were applied to clinical samples from a subject, the predicted microbiome profiles were better reflections of the physiology and diagnosis of the subject at the visits than the observed community compositions. CONCLUSIONS: Bias in 16S studies due to DNA extraction and PCR amplification will continue to require attention despite further advances in sequencing technology. Analysis of mock communities can help assess bias and facilitate the interpretation of results from environmental samples.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/s12866-015-0351-6

Cites

50 of 50 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Schematic of three mixture experiments and observed results. In Experiment 1, bacterial cultures were mixed so that communities were comprised of equal numbers of cells. In Experiment 2, DNA was extracted from pure bacterial cultures and then mixed so that communities were comprised of equal amounts of DNA. In Experiment 3, DNA was extracted from pure bacterial cultures and subjected to PCR and PCR product was mixed so that communities are comprised of equal amounts of PCR product. The pie charts in the bottom row are the observed results for a sample that consisted of equal proportions of seven bacteria for each experiment. The pie charts in the other rows represent the prescribed mixing ratios (each slice is of equal size). Key: red - G. vaginalis, orange - S. agalactiae, purple - S. amnii,green - P. bivia, light blue - L. iners, yellow - L. crispatus, brown - A. vaginae.
Figure 1 Schematic of three mixture experiments and observed results. In Experiment 1, bacterial cultures were mixed so that communities were comprised of equal numbers of cells. In Experiment 2, DNA was extracted from pure bacterial cultures and then mixed so that communities were comprised of equal amounts of DNA. In Experiment 3, DNA was extracted from pure bacterial cultures and subjected to PCR and PCR product was mixed so that communities are comprised of equal amounts of PCR product. The pie charts in the bottom row are the observed results for a sample that consisted of equal proportions of seven bacteria for each experiment. The pie charts in the other rows represent the prescribed mixing ratios (each slice is of equal size). Key: red - G. vaginalis, orange - S. agalactiae, purple - S. amnii,green - P. bivia, light blue - L. iners, yellow - L. crispatus, brown - A. vaginae.CC BY · PubMed Central
Figure 2 Observed bias by bacterium. The observed bias (the observed minus the actual proportions) for each bacterium in the experimental design due to the different effects of our DNA Extraction, PCR amplification, and sequencing and taxonomic classification protocols. The total bias is also plotted for each bacterium. For each box and whisker plot, only the samples including the bacterium were included.
Figure 2 Observed bias by bacterium. The observed bias (the observed minus the actual proportions) for each bacterium in the experimental design due to the different effects of our DNA Extraction, PCR amplification, and sequencing and taxonomic classification protocols. The total bias is also plotted for each bacterium. For each box and whisker plot, only the samples including the bacterium were included.CC BY · PubMed Central
Figure 3 Interaction/blending plots for L. crispatus and (a) G. vaginalis and (b) S. amnii . The contours indicate the expected observed amount of L. crispatus for a given actual percentage of a sample for a pair of bacteria.
Figure 3 Interaction/blending plots for L. crispatus and (a) G. vaginalis and (b) S. amnii . The contours indicate the expected observed amount of L. crispatus for a given actual percentage of a sample for a pair of bacteria.CC BY · PubMed Central
Figure 4 Results for mixture of L. crispatus and S. agalactiae . Actual and observed proportions of bacteria when mixing equal proportions of cells (Exp. 1), DNA (Exp. 2), and PCR product (Exp. 3) for L. crispatus and S. agalactiae.
Figure 4 Results for mixture of L. crispatus and S. agalactiae . Actual and observed proportions of bacteria when mixing equal proportions of cells (Exp. 1), DNA (Exp. 2), and PCR product (Exp. 3) for L. crispatus and S. agalactiae.CC BY · PubMed Central
Figure 5 (a) Observed and (b) predicted proportions of bacteria of four clinical samples. The samples are from the same subject in different visits.
Figure 5 (a) Observed and (b) predicted proportions of bacteria of four clinical samples. The samples are from the same subject in different visits.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 52 references

Cited by

See all 555

Metadata

Authors
Vaginal Microbiome Consortium (additional members), Brooks, J. P., Edwards, D. J., Harwich, M. D., Rivera, M. C., Fettweis, J. M., Serrano, M. G., Reris, R. A., Sheth, N. U., Huang, B., Girerd, P., Strauss, J. F., Jefferson, K. K., & Buck, G. A.
Affiliations
Virginia Commonwealth University (US)
Corresponding author
Brooks, J Paul
Venue
BMC Microbiology
Published
2015-03-21
Volume
15
Issue
1
Pages
66-66
ISSN
1471-2180 (ISSN-L)
OpenAlex
W2113925621
Cited by
528
References
52
Citations by year
2026: 27 · 2025: 39 · 2024: 28 · 2023: 47 · 2022: 51 · 2021: 73 · 2020: 66 · 2019: 51 · 2018: 57 · 2017: 49 · 2016: 37 · 2015: 3
FWCI
21.14
Type
journal article
Language
en
Open access
Licence
  • cc-by
  • creativecommons.org/licenses/by/2.0 (tdm)
Locations
  • BMC Microbiology (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • VCU Scholars Compass (Virginia Commonwealth University) (submittedVersion)
Funders
  • National Science Foundation (1127914)
  • Thomas F. and Kate Miller Jeffress Memorial Trust
  • National Institutes of Health
  • National Institute of Allergy and Infectious Diseases (UH3AI08326-01)
  • Division of Mathematical Sciences (1127914, DMS 1127914)
  • National Institute on Minority Health and Health Disparities (P60MD002256)
  • Eunice Kennedy Shriver National Institute of Child Health and Human Development (U54HD080784)
Topics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gut microbiota and health
  • Physical Sciences › Environmental Science › Ecology › Microbial Community Ecology and Physiology
Keywords
16S rRNA gene sequencing, mock microbial community, DNA extraction bias, PCR bias, vaginal microbiota, bias quantification, DNA extraction kit comparison
MeSH terms
Bacteria, DNA, Bacterial, Female, Humans, Models, Biological, Phylogeny, RNA, Ribosomal, 16S, Specimen Handling, Vagina, Bias, Polymerase Chain Reaction, Artifacts, Genes, rRNA, Metagenomics, Microbial Consortia, High-Throughput Nucleotide Sequencing, Microbiota

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: The truth about metagenomics: quantifying and counteracting bias in 16S rRNA studies. https://app.cochat.ai/papers/10.1186/s12866-015-0351-6
The paper
Vaginal Microbiome Consortium (additional members), Brooks, J. P., Edwards, D. J., Harwich, M. D., Rivera, M. C., Fettweis, J. M., Serrano, M. G., Reris, R. A., Sheth, N. U., Huang, B., Girerd, P., Strauss, J. F., Jefferson, K. K., & Buck, G. A. (2015). The truth about metagenomics: quantifying and counteracting bias in 16S rRNA studies. BMC Microbiology. https://doi.org/10.1186/s12866-015-0351-6

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.