On the limits of 16S rRNA gene-based metagenome prediction and functional profiling
Open accessPublished version of a preprint
The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
Molecular profiling techniques such as metagenomics, metatranscriptomics or metabolomics offer important insights into the functional diversity of the microbiome. In contrast, 16S rRNA gene sequencing, a widespread and cost-effective technique to measure microbial diversity, only allows for indirect estimation of microbial function. To mitigate this, tools such as PICRUSt2, Tax4Fun2, PanFP and MetGEM infer functional profiles from 16S rRNA gene sequencing data using different algorithms. Prior studies have cast doubts on the quality of these predictions, motivating us to systematically evaluate these tools using matched 16S rRNA gene sequencing, metagenomic datasets, and simulated data. Our contribution is threefold: (i) using simulated data, we investigate if technical biases could explain the discordance between inferred and expected results; (ii) considering human cohorts for type two diabetes, colorectal cancer and obesity, we test if health-related differential abundance measures of functional categories are concordant between 16S rRNA gene-inferred and metagenome-derived profiles and; (iii) since 16S rRNA gene copy number is an important confounder in functional profiles inference, we investigate if a customised copy number normalisation with the rrnDB database could improve the results. Our results show that 16S rRNA gene-based functional inference tools generally do not have the necessary sensitivity to delineate health-related functional changes in the microbiome and should thus be used with care. Furthermore, we outline important differences in the individual tools tested and offer recommendations for tool selection.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
KEGG: Kyoto Encyclopedia of Genes and Genomes
Kanehisa, M. (2000) · Nucleic Acids Research · doi:10.1093/nar/28.1.27 · Cited by 37,077
DADA2: High–resolution sample inference from Illumina amplicon data
Callahan, B. J., McMurdie, P. J., Rosen, M. J., Han, A. W., Johnson, A. J. A., & Holmes, S. P. (2016) · Nature Methods · doi:10.1038/nmeth.3869 · Cited by 35,698 · cited 1×
“Raw 16S rRNA gene reads were processed using DADA2 (1.26) [63] to obtain an amplicon sequence variants (ASV) abundance table.”
MethodInfluentialThe SILVA ribosomal RNA gene database project: improved data processing and web-based tools
Quast, C., Pruesse, E., Yilmaz, P., Gerken, J., Schweer, T., Yarza, P., Peplies, J., & Glöckner, F. O. (2012) · Nucleic Acids Research · doi:10.1093/nar/gks1219 · Cited by 33,055
KEGG: Kyoto Encyclopedia of Genes and Genomes
Ogata, H., Goto, S., Sato, K., Fujibuchi, W., Bono, H., & Kanehisa, M. (1999) · Nucleic Acids Research · doi:10.1093/nar/27.1.29 · Cited by 31,232
Predictive functional profiling of microbial communities using 16S rRNA marker gene sequences
Langille, M. G. I., Zaneveld, J., Caporaso, J. G., McDonald, D., Knights, D., Reyes, J. A., Clemente, J. C., Burkepile, D. E., Vega Thurber, R. L., Knight, R., et al. (2013) · Nature Biotechnology · doi:10.1038/nbt.2676 · Cited by 9,116 · cited 1×
“While accessible and cost-effective, 16S rRNA gene sequencing is limited due to short read lengths, sequencing errors [6], differences caused by the use of different variable regions [7–9] and difficulties in clustering sequences into operational taxonomic units (OTUs) [10].”
BackgroundPower failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641 · cited 1×
“In contrast to 16S rRNA gene sequencing, shotgun metagenome sequencing (MGS) provides rich information on functional genes, which can be translated to the pathway level using tools such as the HMP Unified Metabolic Analysis Network (verison 3) (HUMAnN3) [19], Kraken [20], or MGS-FAST [21].”
MethodO'Leary, N. A., Wright, M. W., Brister, J. R., Ciufo, S., Haddad, D., McVeigh, R., Rajput, B., Robbertse, B., Smith-White, B., Ako-Adjei, D., et al. (2016) · Nucleic Acids Research · doi:10.1093/nar/gkv1189 · Cited by 6,357
A standardized bacterial taxonomy based on genome phylogeny substantially revises the tree of life
Parks, D. H., Chuvochina, M., Waite, D. W., Rinke, C., Skarshewski, A., Chaumeil, P.-A., & Hugenholtz, P. (2018) · Nature Biotechnology · doi:10.1038/nbt.4229 · Cited by 3,603
Benson, D. A., Cavanaugh, M., Clark, K., Karsch-Mizrachi, I., Lipman, D. J., Ostell, J., & Sayers, E. W. (2012) · Nucleic Acids Research · doi:10.1093/nar/gks1195 · Cited by 3,261
Bacterial Community Variation in Human Body Habitats Across Space and Time
Costello, E. K., Lauber, C. L., Hamady, M., Fierer, N., Gordon, J. I., & Knight, R. (2009) · Science · doi:10.1126/science.1177486 · Cited by 3,231 · cited 1×
“Prior research suggests a close association between CRC and the gut microbiome, with modifications in the microbiome contributing to CRC development through factors such as inflammatory disorders, microbial metabolites, or virulence factors [87–90].”
BackgroundBeghini, F., McIver, L. J., Blanco-Míguez, A., Dubois, L., Asnicar, F., Maharjan, S., Mailyan, A., Manghi, P., Scholz, M., Thomas, A. M., et al. (2021) · eLife · doi:10.7554/elife.65088 · Cited by 2,303
Best practices for analysing microbiomes
Knight, R., Vrbanac, A., Taylor, B. C., Aksenov, A., Callewaert, C., Debelius, J., Gonzalez, A., Kosciolek, T., McCall, L.-I., McDonald, D., et al. (2018) · Nature Reviews Microbiology · doi:10.1038/s41579-018-0029-9 · Cited by 2,030 · cited 1×
“These KO terms are reported to be enriched in CRC patients [69–73].”
BackgroundSpecies-level functional profiling of metagenomes and metatranscriptomes
Franzosa, E. A., McIver, L. J., Rahnavard, G., Thompson, L. R., Schirmer, M., Weingart, G., Lipson, K. S., Knight, R., Caporaso, J. G., Segata, N., et al. (2018) · Nature Methods · doi:10.1038/s41592-018-0176-y · Cited by 1,693 · cited 1×
“This allows us to assess the impact of those in comparison to well-controlled simulated data.”
ResultPotential of fecal microbiota for early-stage detection of colorectal cancer
Zeller, G., Tap, J., Voigt, A. Y., Sunagawa, S., Kultima, J. R., Costea, P. I., Amiot, A., Böhm, J., Brunetti, F., Habermann, N., et al. (2014) · Molecular Systems Biology · doi:10.15252/msb.20145645 · Cited by 1,375
Ironing out the wrinkles in the rare biosphere through improved OTU clustering
Huse, S. M., Welch, D. M., Morrison, H. G., & Sogin, M. L. (2010) · Environmental Microbiology · doi:10.1111/j.1462-2920.2010.02193.x · Cited by 1,346 · cited 1×
“While accessible and cost-effective, 16S rRNA gene sequencing is limited due to short read lengths, sequencing errors [6], differences caused by the use of different variable regions [7–9] and difficulties in clustering sequences into operational taxonomic units (OTUs) [10].”
BackgroundCharacterization of the gut microbiome using 16S or shotgun metagenomics
Jovel, J., Patterson, J., Wang, W., Hotte, N., O'Keefe, S., Mitchel, T., Perry, T., Kao, D., Mason, A. L., Madsen, K. L., et al. (2016) · Frontiers in Microbiology · doi:10.3389/fmicb.2016.00459 · Cited by 942
Regional variation limits applications of healthy gut microbiome reference ranges and disease models
He, Y., Wu, W., Zheng, H.-M., Li, P., McDonald, D., Sheng, H.-F., Chen, M.-X., Chen, Z.-H., Ji, G.-Y., Zheng, Z.-D.-X., et al. (2018) · Nature Medicine · doi:10.1038/s41591-018-0164-x · Cited by 894 · cited 1×
“However, the contrasts that were investigated were related to geography, where microbial composition and function are known to differ considerably [48].”
BackgroundDifferentiation of diabetes by pathophysiology, natural history, and prognosis
Skyler, J. S., Bakris, G. L., Bonifacio, E., Darsow, T., Eckel, R. H., Groop, L., Groop, P.-H., Handelsman, Y., Insel, R. A., Mathieu, C., et al. (2017) · Diabetes · doi:10.2337/db16-0806 · Cited by 823
Dai, Z., Coker, O. O., Nakatsu, G., Wu, W. K. K., Zhao, L., Chen, Z., Chan, F. K. L., Kristiansen, K., Sung, J. J. Y., Wong, S. H., et al. (2018) · Microbiome · doi:10.1186/s40168-018-0451-2 · Cited by 545
Chapter 12: Human Microbiome Analysis
Morgan, X. C., & Huttenhower, C. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002808 · Cited by 496
Liu, N.-N., Jiao, N., Tan, J.-C., Wang, Z., Wu, D., Wang, A.-J., Chen, J., Tao, L., Zhou, C., Fang, W., et al. (2022) · Nature Microbiology · doi:10.1038/s41564-021-01030-7 · Cited by 306 · cited 1×
“Hence, we performed a Wilcoxon rank sum test to identify differential pathways between healthy and disease groups, where we found that PICRUSt2, Tax4Fun2, and PanFP had varying degrees of overlap with MGS results.”
MethodNutritional preferences of human gut bacteria reveal their metabolic idiosyncrasies
Tramontano, M., Andrejev, S., Pruteanu, M., Klünemann, M., Kuhn, M., Galardini, M., Jouhten, P., Zelezniak, A., Zeller, G., Bork, P., et al. (2018) · Nature Microbiology · doi:10.1038/s41564-018-0123-9 · Cited by 295
Jervis-Bardy, J., Leong, L. E. X., Marri, S., Smith, R. J., Choo, J. M., Smith-Vaughan, H. C., Nosworthy, E., Morris, P. S., O’Leary, S., Rogers, G. B., et al. (2015) · Microbiome · doi:10.1186/s40168-015-0083-8 · Cited by 192 · cited 1×
“Additionally, MGS can be challenging for low biomass samples or samples that are dominated by non-microbial DNA [25, 26].”
BackgroundCowPI: a rumen microbiome focussed version of the PICRUSt functional inference software
Wilkinson, T. J., Huws, S. A., Edwards, J. E., Kingston-Smith, A. H., Siu-Ting, K., Hughes, M., Rubino, F., Friedersdorff, M., & Creevey, C. J. (2018) · Frontiers in Microbiology · doi:10.3389/fmicb.2018.01095 · Cited by 160 · cited 2×
“Even though the accuracy of these tools has been validated, they are generally limited by the quality of the reference genomes and annotation, which suffer from ambiguous or missing coding regions [28, 31].”
BackgroundMethod
Research works printed but not linked: 73
- 10.3389/fimmu.2018.02868 · DOI · Paper page
- 10.3389/fcimb.2021.801122 · DOI
- 10.3390/biom11040530 · DOI · Paper page
- 10.1186/s12859-016-0992-y · DOI · Paper page
- 10.1101/gr.085464.108 · DOI · Paper page
- 10.1186/1471-2105-12-38 · DOI · Paper page
- 10.1128/mSphere.01202-20 · DOI · Paper page
- 10.1038/sdata.2019.7 · DOI · Paper page
- 10.1128/JCM.42.8.3711-3730.2004 · DOI · Paper page
- 10.1111/j.1574-6976.2001.tb00571.x · doi:10.1111/j.1574-6976.2001.tb00571.x · Paper page
- 10.3389/fmicb.2021.670336 · DOI · Paper page
- 10.1038/s41598-021-82726-y · DOI · Paper page
- 10.1016/j.jff.2015.02.013 · DOI · Paper page
- 10.1128/mBio.02348-16 · DOI · Paper page
- 10.1186/gm469 · DOI · Paper page
- 10.1186/s13059-019-1891-0 · DOI · Paper page
- 10.1093/gigascience/giz020 · DOI
- 10.1186/s12864-017-3918-9 · DOI · Paper page
- 10.3389/fmicb.2021.766364 · DOI · Paper page
- 10.1128/mSystems.00218-17 · DOI · Paper page
- 10.1038/s41587-020-0548-6 · DOI · Paper page
- 10.1186/s40793-020-00358-7 · DOI · Paper page
- 10.1186/s13104-015-1462-8 · DOI · Paper page
- 10.1186/s12864-019-6427-1 · DOI
- 10.1371/journal.pcbi.1008487 · DOI
- 10.1038/nbt.3703 · DOI · Paper page
- 10.1186/s40168-019-0689-3 · DOI · Paper page
- 10.1038/nature11234 · DOI · Paper page
- 10.1371/journal.pcbi.1002743 · DOI · Paper page
- 10.1186/s40168-018-0420-9 · DOI · Paper page
- 10.1371/journal.pone.0135868 · DOI · Paper page
- 10.1093/nar/gku1201 · DOI · Paper page
- 10.1093/nar/gkt1244 · DOI · Paper page
- 10.1111/raq.12237 · DOI
- 10.1093/gigascience/giab090 · DOI · Paper page
- 10.1186/s40168-020-00815-y · DOI · Paper page
- 10.1016/j.apsoil.2021.104129 · DOI
- 10.1055/s-2005-858235 · DOI · Paper page
- 10.1038/s41588-020-00747-1 · DOI · Paper page
- 10.1159/000090694 · DOI · Paper page
- 10.1371/journal.pone.0057923 · DOI · Paper page
- 10.1186/s40168-019-0633-6 · DOI · Paper page
- 10.1038/nmeth.4458 · DOI · Paper page
- 10.1093/nar/gkab1053 · DOI · Paper page
- 10.1093/bioinformatics/btx754 · DOI · Paper page
- 10.7717/peerj.6174 · doi:10.7717/peerj.6174
- 10.1002/imt2.1 · DOI
- 10.1186/s12864-020-07307-1 · DOI
- 10.1093/nar/gkv1323 · DOI · Paper page
- 10.1093/nar/gkh131 · DOI · Paper page
- 10.18637/jss.v022.i04 · DOI · Paper page
- 10.1186/s40168-015-0087-4 · DOI · Paper page
- 10.1155/2022/1940846 · DOI
- 10.3390/microorganisms9081548 · DOI
- 10.1097/MOG.0000000000000811 · DOI
- Foss, 1989, Carbohydrate, lipid and amino acid metabolism of insulin-dependent diabetic patients regulated by an artificial beta-cell unit, Diabetes Res, 11, 1
- 10.3390/nu14163345 · DOI
- 10.1038/s41387-022-00213-3 · DOI · Paper page
- 10.1155/2022/1708769 · DOI
- 10.1042/BST0351180 · DOI · Paper page
- 10.1371/journal.pone.0255446 · DOI · Paper page
- 10.14814/phy2.15254 · DOI
- 10.1128/mSystems.00163-17 · DOI
- 10.1007/s10539-016-9542-2 · DOI · Paper page
- 10.1016/j.csbj.2020.07.020 · DOI
- 10.1053/j.gastro.2019.06.048 · DOI · Paper page
- 10.1038/s41575-019-0258-z · DOI · Paper page
- 10.1016/j.tim.2020.01.001 · DOI · Paper page
- 10.1038/s41574-022-00797-x · DOI
- 10.1016/j.syapm.2018.07.003 · DOI · Paper page
- 10.1038/nbt.3886 · DOI · Paper page
- 10.3389/fmicb.2021.678319 · DOI
- 10.20517/mrr.2021.07 · DOI
Cited by
AI in microbiome‐related healthcare
Probul, N., Huang, Z., Saak, C. C., Baumbach, J., & List, M. (2024) · Microbial Biotechnology · doi:10.1111/1751-7915.70027 · Cited by 36
Self-citationBiazzo, M., Pinzauti, D., & Podrini, C. (2025) · International Journal of Molecular Sciences · doi:10.3390/ijms26115000 · Cited by 9
Metadata
- Authors
- Matchado, M. S., Rühlemann, M., Reitmeier, S., Kacprowski, T., Frost, F., Haller, D., Baumbach, J., & List, M.
- Venue
- Microbial Genomics
- Publisher
- Microbiology Society
- Published
- 2024-02-29
- Volume
- 10
- Issue
- 2
- ISSN
- 2057-5858 (ISSN-L)
- OpenAlex
- W4392284791
- Cited by
- 181
- References
- 24
- FWCI
- 20.91
- Type
- journal article
- Language
- en
- Open access
- gold
- Funders
- Deutsche Forschungsgemeinschaft (395357507, 422216132)
- VILLUM Young Investigator Grant (13154)
- German Federal Ministry of Education and Research (01IS21079)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.