The DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
Consistent and correctable bias in metagenomic sequencing experiments
Open accessAbstract
Marker-gene and metagenomic sequencing have profoundly expanded our ability to measure biological communities. But the measurements they provide differ from the truth, often dramatically, because these experiments are biased toward detecting some taxa over others. This experimental bias makes the taxon or gene abundances measured by different protocols quantitatively incomparable and can lead to spurious biological conclusions. We propose a mathematical model for how bias distorts community measurements based on the properties of real experiments. We validate this model with 16S rRNA gene and shotgun metagenomics data from defined bacterial communities. Our model better fits the experimental data despite being simpler than previous models. We illustrate how our model can be used to evaluate protocols, to understand the effect of bias on downstream statistical analyses, and to measure and correct bias given suitable calibration controls. These results illuminate new avenues toward truly quantitative and reproducible metagenomics measurements.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Bootstrap methods: another look at the jackknife
Efron, B. (1979) · The Annals of Statistics · doi:10.1214/aos/1176344552 · Cited by 17,602
Human gut microbes associated with obesity
Ley, R. E., Turnbaugh, P. J., Klein, S., & Gordon, J. I. (2006) · Nature · doi:10.1038/4441022a · Cited by 8,785
Newman, M. (2010) · doi:10.1093/acprof:oso/9780199206650.001.0001 · Cited by 6,595
The Statistical Analysis of Compositional Data
Aitchison, J. (1986) · doi:10.1007/978-94-009-4109-0 · Cited by 4,383
A standardized bacterial taxonomy based on genome phylogeny substantially revises the tree of life
Parks, D. H., Chuvochina, M., Waite, D. W., Rinke, C., Skarshewski, A., Chaumeil, P.-A., & Hugenholtz, P. (2018) · Nature Biotechnology · doi:10.1038/nbt.4229 · Cited by 3,603
Davis, N. M., Proctor, D. M., Holmes, S. P., Relman, D. A., & Callahan, B. J. (2018) · Microbiome · doi:10.1186/s40168-018-0605-2 · Cited by 3,493 · cited 1×
“Accurate bias inference also requires accurate removal of contaminant reads prior to estimation through manual filtering or automated removal methods (Davis et al., 2018; Larsson et al., 2018).”
MethodSelf-citationMicrobiome Datasets Are Compositional: And This Is Not Optional
Gloor, G. B., Macklaim, J. M., Pawlowsky-Glahn, V., & Egozcue, J. J. (2017) · Frontiers in Microbiology · doi:10.3389/fmicb.2017.02224 · Cited by 3,044 · cited 3×
“The left column shows taxon relative abundances as in Figure 4B and the right column shows the first two principal components from a compositional principle-components analysis (Gloor et al., 2017).”
BackgroundMethodPersonalized nutrition by prediction of glycemic responses
Zeevi, D., Korem, T., Zmora, N., Israeli, D., Rothschild, D., Weinberger, A., Ben-Yacov, O., Lador, D., Avnit-Sagi, T., Lotan-Pompan, M., et al. (2015) · Cell · doi:10.1016/j.cell.2015.11.001 · Cited by 2,929
Yarza, P., Yilmaz, P., Pruesse, E., Glöckner, F. O., Ludwig, W., Schleifer, K.-H., Whitman, W. B., Euzéby, J., Amann, R., & Rosselló-Móra, R. (2014) · Nature Reviews Microbiology · doi:10.1038/nrmicro3330 · Cited by 2,589
Shotgun metagenomics, from sampling to analysis
Quince, C., Walker, A. W., Simpson, J. T., Loman, N. J., & Segata, N. (2017) · Nature Biotechnology · doi:10.1038/nbt.3935 · Cited by 2,202
MetaPhlAn2 for enhanced metagenomic taxonomic profiling
Truong, D. T., Franzosa, E. A., Tickle, T. L., Scholz, M., Weingart, G., Pasolli, E., Tett, A., Huttenhower, C., & Segata, N. (2015) · Nature Methods · doi:10.1038/nmeth.3589 · Cited by 2,185
PCR inhibitors - occurrence, properties and removal
Schrader, C., Schielke, A., Ellerbroek, L., & Johne, R. (2012) · Journal of Applied Microbiology · doi:10.1111/j.1365-2672.2012.05384.x · Cited by 2,118
Bias caused by template annealing in the amplification of mixtures of 16S rRNA genes by PCR
Suzuki, M. T., & Giovannoni, S. J. (1996) · Applied and Environmental Microbiology · doi:10.1128/aem.62.2.625-630.1996 · Cited by 1,881
Bias in template-to-product ratios in multitemplate PCR
Polz, M. F., & Cavanaugh, C. M. (1998) · Applied and Environmental Microbiology · doi:10.1128/aem.64.10.3724-3730.1998 · Cited by 1,484
Rubin, D. B. (1981) · The Annals of Statistics · doi:10.1214/aos/1176345338 · Cited by 1,153
Contamination in Low Microbial Biomass Microbiome Studies: Issues and Recommendations
Eisenhofer, R., Minich, J. J., Marotz, C., Cooper, A., Knight, R., & Weyrich, L. S. (2019) · Trends in Microbiology · doi:10.1016/j.tim.2018.11.003 · Cited by 1,146 · cited 1×
“Some of the challenges associated with building a statistical model for bias include modeling the presence of taxa thought to be absent from the community (but observed due to contamination or index switching (Eisenhofer et al. 2018)) and the absence of taxa known to be present (Yeh et al.”
BackgroundTowards standards for human fecal sample processing in metagenomic studies
Costea, P. I., Zeller, G., Sunagawa, S., Pelletier, E., Alberti, A., Levenez, F., Tramontano, M., Driessen, M., Hercog, R., Jung, F.-E., et al. (2017) · Nature Biotechnology · doi:10.1038/nbt.3960 · Cited by 893
The Earth Microbiome project: successes and aspirations
Gilbert, J. A., Jansson, J. K., & Knight, R. (2014) · BMC Biology · doi:10.1186/s12915-014-0069-1 · Cited by 878
cowplot: Streamlined Plot Theme and Plot Annotations for 'ggplot2'
Wilke, C. O. (2015) · CRAN: Contributed Packages · doi:10.32614/cran.package.cowplot · Cited by 870
Updating the 97% identity threshold for 16S ribosomal RNA OTUs
Edgar, R. C. (2018) · Bioinformatics · doi:10.1093/bioinformatics/bty113 · Cited by 723
Graham, E. B., Knelman, J. E., Schindlbacher, A., Siciliano, S., Breulmann, M., Yannarell, A., Beman, J. M., Abell, G., Philippot, L., Prosser, J., et al. (2016) · Frontiers in Microbiology · doi:10.3389/fmicb.2016.00214 · Cited by 671
Analyzing Compositional Data with R
van den Boogaart, K. G., & Tolosana-Delgado, R. (2013) · Springer eBooks · doi:10.1007/978-3-642-36809-7 · Cited by 638
The Microbiome Quality Control Project Consortium, Sinha, R., Abu-Ali, G., Vogtmann, E., Fodor, A. A., Ren, B., Amir, A., Schwager, E., Crabtree, J., Ma, S., et al. (2017) · Nature Biotechnology · doi:10.1038/nbt.3981 · Cited by 587 · cited 5×
“Previous analyses of bias in MGS experiments have largely relied on descriptive statistical models (Bell et al. 2018; Brooks et al. 2015; Krehenwinkel et al. 2017; Sinha et al. 2017) whose parameters cannot be identified with biophysical quantities that one might expect to apply to differently composed samples.”
BackgroundInfluentialThe Madness of Microbiome: Attempting To Find Consensus “Best Practice” for 16S Microbiome Studies
Pollock, J., Glendinning, L., Wisedchanwet, T., & Watson, M. (2018) · Applied and Environmental Microbiology · doi:10.1128/aem.02627-17 · Cited by 575
The truth about metagenomics: quantifying and counteracting bias in 16S rRNA studies
Vaginal Microbiome Consortium (additional members), Brooks, J. P., Edwards, D. J., Harwich, M. D., Rivera, M. C., Fettweis, J. M., Serrano, M. G., Reris, R. A., Sheth, N. U., Huang, B., et al. (2015) · BMC Microbiology · doi:10.1186/s12866-015-0351-6 · Cited by 528
Kembel, S. W., Wu, M., Eisen, J. A., & Green, J. L. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002743 · Cited by 516
Evaluation of Methods for the Extraction and Purification of DNA from the Human Microbiome
Yuan, S., Cohen, D. B., Ravel, J., Abdo, Z., & Forney, L. J. (2012) · PLoS ONE · doi:10.1371/journal.pone.0033865 · Cited by 511
Preservation Methods Differ in Fecal Microbiome Stability, Affecting Suitability for Field Studies
Song, S. J., Amir, A., Metcalf, J. L., Amato, K. R., Xu, Z. Z., Humphrey, G., & Knight, R. (2016) · mSystems · doi:10.1128/msystems.00021-16 · Cited by 483
Evaluating the Information Content of Shallow Shotgun Metagenomics
Hillmann, B., Al-Ghalith, G. A., Shields-Cutler, R. R., Zhu, Q., Gohl, D. M., Beckman, K. B., Knight, R., & Knights, D. (2018) · mSystems · doi:10.1128/msystems.00069-18 · Cited by 474 · cited 1×
“…et al., 2014), exact short-read ribosomal sequence variants and common shotgun profilers group variation at roughly the species level (Edgar, 2018; Hillmann et al., 2018), and metagenome assembly combines strains too similar to be separated by the assembler or by the subsequent binning (Dick,…”
BackgroundSipos, R., Székely, A. J., Palatinszky, M., Révész, S., Márialigeti, K., & Nikolausz, M. (2007) · FEMS Microbiology Ecology · doi:10.1111/j.1574-6941.2007.00283.x · Cited by 461
D’Amore, R., Ijaz, U. Z., Schirmer, M., Kenny, J. G., Gregory, R., Darby, A. C., Shakya, M., Podar, M., Quince, C., & Hall, N. (2016) · BMC Genomics · doi:10.1186/s12864-015-2194-9 · Cited by 405 · cited 1×
“, 2017), and almost every choice in an MGS experiment has been implicated as contributing to bias (D’Amore et al., 2016; Hugerth and Andersson, 2017; Sinha et al., 2017; Pollock et al., 2018).”
BackgroundCallahan, B. J., DiGiulio, D. B., Goltsman, D. S. A., Sun, C. L., Costello, E. K., Jeganathan, P., Biggio, J. R., Wong, R. J., Druzin, M. L., Shaw, G. M., et al. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1705899114 · Cited by 391
Self-citationThe Microbiome and Human Biology
Knight, R., Callewaert, C., Marotz, C., Hyde, E. R., Debelius, J. W., McDonald, D., & Sogin, M. L. (2017) · Annual Review of Genomics and Human Genetics · doi:10.1146/annurev-genom-083115-022438 · Cited by 373
Hugerth, L. W., & Andersson, A. F. (2017) · Frontiers in Microbiology · doi:10.3389/fmicb.2017.01561 · Cited by 356
A Taxonomic Signature of Obesity in the Microbiome? Getting to the Guts of the Matter
Finucane, M. M., Sharpton, T. J., Laurent, T. J., & Pollard, K. S. (2014) · PLoS ONE · doi:10.1371/journal.pone.0084689 · Cited by 321
A phylogenetic transform enhances analysis of compositional microbiota data
Silverman, J. D., Washburne, A. D., Mukherjee, S., & David, L. A. (2017) · eLife · doi:10.7554/elife.21887 · Cited by 319
Estimating and mitigating amplification bias in qualitative and quantitative arthropod metabarcoding
Krehenwinkel, H., Wolf, M., Lim, J. Y., Rominger, A. J., Simison, W. B., & Gillespie, R. G. (2017) · Scientific Reports · doi:10.1038/s41598-017-17333-x · Cited by 307
Toward Accurate and Quantitative Comparative Metagenomics
Nayfach, S., & Pollard, K. S. (2016) · Cell · doi:10.1016/j.cell.2016.08.007 · Cited by 292
Microbiome, Metagenomics, and High-Dimensional Compositional Data Analysis
Li, H. (2015) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-010814-020351 · Cited by 288
Balances: a New Perspective for Microbiome Analysis
Rivera-Pinto, J., Egozcue, J. J., Pawlowsky-Glahn, V., Paredes, R., Noguera-Julian, M., & Calle, M. L. (2018) · mSystems · doi:10.1128/msystems.00053-18 · Cited by 288
Surveys of Gene Families Using Polymerase Chain Reaction: PCR Selection and PCR Drift
Wagner, A., Blackstone, N., Cartwright, P., Dick, M., Misof, B., Snow, P., Wagner, G. P., Bartels, J., Murtha, M., & Pendleton, J. (1994) · Systematic Biology · doi:10.1093/sysbio/43.2.250 · Cited by 264
Thomas, A. C., Deagle, B. E., Eveson, J. P., Harsch, C. H., & Trites, A. W. (2016) · Molecular Ecology Resources · doi:10.1111/1755-0998.12490 · Cited by 249
Metagenomic Sequencing of an In Vitro-Simulated Microbial Community
Morgan, J. L., Darling, A. E., & Eisen, J. A. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010209 · Cited by 248
On criteria for measures of compositional difference
Aitchison, J. (1992) · Mathematical Geology · doi:10.1007/bf00891269 · Cited by 230
Reference standards for next-generation sequencing
Hardwick, S. A., Deveson, I. W., & Mercer, T. R. (2017) · Nature Reviews Genetics · doi:10.1038/nrg.2017.44 · Cited by 225
Predicting microbial traits with phylogenies
Goberna, M., & Verdú, M. (2016) · The ISME Journal · doi:10.1038/ismej.2015.171 · Cited by 197
Experimental design and quantitative analysis of microbial community multiomics
Mallick, H., Ma, S., Franzosa, E. A., Vatanen, T., Morgan, X. C., & Huttenhower, C. (2017) · Genome Biology · doi:10.1186/s13059-017-1359-z · Cited by 192
Species-level classification of the vaginal microbiome
Fettweis, J. M., Serrano, M. G., Sheth, N. U., Mayer, C. M., Glascock, A. L., Brooks, J. P., Jefferson, K. K., Vaginal Microbiome Consortium (additional members), & Buck, G. A. (2012) · BMC Genomics · doi:10.1186/1471-2164-13-s8-s17 · Cited by 186
Gonzalez, J. M., Portillo, M. C., Belda-Ferre, P., & Mira, A. (2012) · PLoS ONE · doi:10.1371/journal.pone.0029973 · Cited by 180
Correcting for batch effects in case-control microbiome studies
Gibbons, S. M., Duvallet, C., & Alm, E. J. (2018) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1006102 · Cited by 162
Microbiome Tools for Forensic Science
Metcalf, J. L., Xu, Z. Z., Bouslimani, A., Dorrestein, P., Carter, D. O., & Knight, R. (2017) · Trends in Biotechnology · doi:10.1016/j.tibtech.2017.03.006 · Cited by 160
Bell, K. L., Burgess, K. S., Botsch, J. C., Dobbs, E. K., Read, T. D., & Brosi, B. J. (2019) · Molecular Ecology · doi:10.1111/mec.14840 · Cited by 160
Hiergeist, A., Reischl, U., & Gessner, A. (2016) · International Journal of Medical Microbiology · doi:10.1016/j.ijmm.2016.03.005 · Cited by 158
Soil biology for resilient, healthy soil
Lehman, R. M., Acosta‐Martínez, V., Buyer, J. S., Cambardella, C. A., Collins, H. P., Ducey, T. F., Halvorson, J. J., Jin, V. L., Johnson, J. M. F., Kremer, R. J., et al. (2015) · Journal of Soil and Water Conservation · doi:10.2489/jswc.70.1.12a · Cited by 145
Next generation microbiological risk assessment meta-omics: The next need for integration
Cocolin, L., Mataragas, M., Bourdichon, F., Doulgeraki, A. I., Pilet, M.-F., Jagadeesan, B., Rantsiou, K., & Phister, T. G. (2017) · International Journal of Food Microbiology · doi:10.1016/j.ijfoodmicro.2017.11.008 · Cited by 130
BLU Estimators and Compositional Data
Pawlowsky‐Glahn, V., & Egozcue, J. J. (2002) · Mathematical Geology · doi:10.1023/a:1014890722372 · Cited by 122
Yeh, Y., Needham, D. M., Sieradzki, E. T., & Fuhrman, J. A. (2018) · mSystems · doi:10.1128/msystems.00023-18 · Cited by 92
Computational correction of index switching in multiplexed sequencing libraries
Larsson, A. J. M., Stanley, G., Sinha, R., Weissman, I. L., & Sandberg, R. (2018) · Nature Methods · doi:10.1038/nmeth.4666 · Cited by 89
UNBIAS: An attempt to correct abundance bias in 16S sequencing, with limited successPreprint
Edgar, R. C. (2017) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/124149 · Cited by 59
Challenges for case-control studies with microbiome data
Brooks, J. P. (2016) · Annals of Epidemiology · doi:10.1016/j.annepidem.2016.03.009 · Cited by 34
Kevorkian, R. T., Bird, J. T., Shumaker, A., & Lloyd, K. G. (2017) · Applied and Environmental Microbiology · doi:10.1128/aem.01443-17 · Cited by 21
Correcting for batch effects in case-control microbiome studiesPreprint
Gibbons, S. M., Duvallet, C., & Alm, E. J. (2017) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/165910 · Cited by 16
In Nature, There Is Only Diversity
McLaren, M. R., & Callahan, B. J. (2018) · mBio · doi:10.1128/mbio.02149-17 · Cited by 14
Self-citation
Cited by
NetCoMi: network construction and comparison for microbiome data in R
Peschel, S., Müller, C. L., von Mutius, E., Boulesteix, A.-L., & Depner, M. (2021) · Briefings in Bioinformatics · doi:10.1093/bib/bbaa290 · Cited by 604
Benchmarking Metagenomics Tools for Taxonomic Classification
Ye, S. H., Siddle, K. J., Park, D. J., & Sabeti, P. C. (2019) · Cell · doi:10.1016/j.cell.2019.07.010 · Cited by 593
Multigroup analysis of compositions of microbiomes with covariate adjustments and repeated measures
Lin, H., & Peddada, S. D. (2024) · Nature Methods · doi:10.1038/s41592-023-02092-7 · Cited by 540
Reporting guidelines for human microbiome research: the STORMS checklist
Mirzayi, C., Renson, A., Genomic Standards Consortium, Massive Analysis and Quality Control Society, Furlanello, C., Sansone, S.-A., Zohra, F., Elsafoury, S., Geistlinger, L., Kasselman, L. J., et al. (2021) · Nature Medicine · doi:10.1038/s41591-021-01552-x · Cited by 521
France, M. T., Ma, B., Gajer, P., Brown, S., Humphrys, M. S., Holm, J. B., Waetjen, L. E., Brotman, R. M., & Ravel, J. (2020) · Microbiome · doi:10.1186/s40168-020-00934-6 · Cited by 441
Metadata
- Authors
- McLaren, M. R., Willis, A. D., & Callahan, B. J.
- Venue
- eLife
- Publisher
- eLife Sciences Publications, Ltd
- Published
- 2019-09-10
- Volume
- 8
- ISSN
- 2050-084X (ISSN-L)
- OpenAlex
- W2972720814
- Cited by
- 429
- References
- 64
- FWCI
- 14.32
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.