The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Inference-based accuracy of metagenome prediction tools varies across sample types and functional categories
Open accessAbstract
Background: Despite recent decreases in the cost of sequencing, shotgun metagenome sequencing remains more expensive compared with 16S rRNA amplicon sequencing. Methods have been developed to predict the functional profiles of microbial communities based on their taxonomic composition. In this study, we evaluated the performance of three commonly used metagenome prediction tools (PICRUSt, PICRUSt2, and Tax4Fun) by comparing the significance of the differential abundance of predicted functional gene profiles to those from shotgun metagenome sequencing across different environments. Results: We selected 7 datasets of human, non-human animal, and environmental (soil) samples that have publicly available 16S rRNA and shotgun metagenome sequences. As we would expect based on previous literature, strong Spearman correlations were observed between predicted gene compositions and gene relative abundance measured with shotgun metagenome sequencing. However, these strong correlations were preserved even when the abundance of genes were permuted across samples. This suggests that simple correlation coefficient is a highly unreliable measure for the performance of metagenome prediction tools. As an alternative, we compared the performance of genes predicted with PICRUSt, PICRUSt2, and Tax4Fun to sequenced metagenome genes in inference models associated with metadata within each dataset. With this approach, we found reasonable performance for human datasets, with the metagenome prediction tools performing better for inference on genes related to “housekeeping” functions. However, their performance degraded sharply outside of human datasets when used for inference. Conclusion: We conclude that the utility of PICRUSt, PICRUSt2, and Tax4Fun for inference with the default database is likely limited outside of human samples and that development of tools for gene prediction specific to different non-human and environmental samples is warranted.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Structure, function and diversity of the healthy human microbiome
The Human Microbiome Project Consortium (2012) · Nature · doi:10.1038/nature11234 · Cited by 11,726
Diet rapidly and reproducibly alters the human gut microbiome
David, L. A., Maurice, C. F., Carmody, R. N., Gootenberg, D. B., Button, J. E., Wolfe, B. E., Ling, A. V., Devlin, A. S., Varma, Y., Fischbach, M. A., et al. (2014) · Nature · doi:10.1038/nature12820 · Cited by 10,100
Predictive functional profiling of microbial communities using 16S rRNA marker gene sequences
Langille, M. G. I., Zaneveld, J., Caporaso, J. G., McDonald, D., Knights, D., Reyes, J. A., Clemente, J. C., Burkepile, D. E., Vega Thurber, R. L., Knight, R., et al. (2013) · Nature Biotechnology · doi:10.1038/nbt.2676 · Cited by 9,116
Human gut microbiome viewed across age and geography
Yatsunenko, T., Rey, F. E., Manary, M. J., Trehan, I., Dominguez-Bello, M. G., Contreras, M., Magris, M., Hidalgo, G., Baldassano, R. N., Anokhin, A. P., et al. (2012) · Nature · doi:10.1038/nature11053 · Cited by 7,815
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641
Decoupling function and taxonomy in the global ocean microbiome
Louca, S., Parfrey, L. W., & Doebeli, M. (2016) · Science · doi:10.1126/science.aaf4507 · Cited by 3,510
The Treatment-Naive Microbiome in New-Onset Crohn’s Disease
Gevers, D., Kugathasan, S., Denson, L. A., Vázquez-Baeza, Y., Van Treuren, W., Ren, B., Schwager, E., Knights, D., Song, S. J., Yassour, M., et al. (2014) · Cell Host & Microbe · doi:10.1016/j.chom.2014.02.005 · Cited by 3,220
Human Genetics Shape the Gut Microbiome
Goodrich, J. K., Waters, J. L., Poole, A. C., Sutter, J. L., Koren, O., Blekhman, R., Beaumont, M., Van Treuren, W., Knight, R., Bell, J. T., et al. (2014) · Cell · doi:10.1016/j.cell.2014.09.053 · Cited by 3,164 · cited 1×
“To address this problem, tools have been developed to predict microbial functional genes from their taxonomic compositions inferred from more cost-effective amplicon sequencing, including PICRUSt, PICRUSt2, Tax4Fun, and FaproTax [4–7], and these tools have been applied in hundreds of projects on various environments,…”
MethodSpecies-level functional profiling of metagenomes and metatranscriptomes
Franzosa, E. A., McIver, L. J., Rahnavard, G., Thompson, L. R., Schirmer, M., Weingart, G., Lipson, K. S., Knight, R., Caporaso, J. G., Segata, N., et al. (2018) · Nature Methods · doi:10.1038/s41592-018-0176-y · Cited by 1,693
Tax4Fun: predicting functional profiles from metagenomic 16S rRNA data
Aßhauer, K. P., Wemheuer, B., Daniel, R., & Meinicke, P. (2015) · Bioinformatics · doi:10.1093/bioinformatics/btv287 · Cited by 1,578
Cited by
Climate warming enhances microbial network complexity and stability
Yuan, M. M., Guo, X., Wu, L., Zhang, Y., Xiao, N., Ning, D., Shi, Z., Zhou, X., Wu, L., Yang, Y., et al. (2021) · Nature Climate Change · doi:10.1038/s41558-021-00989-9 · Cited by 2,238
Xu, Y., Wang, J., Wu, X., Jing, H., Zhang, S., Hu, Z., Rao, L., Chang, Q., Wang, L., & Zhang, Z. (2023) · Gut Microbes · doi:10.1080/19490976.2023.2168101 · Cited by 61
Metadata
- Authors
- Sun, S., Jones, R. B., & Fodor, A. A.
- Venue
- Microbiome
- Published
- 2020-04-02
- Volume
- 8
- Issue
- 1
- Pages
- 46-46
- ISSN
- 2049-2618 (ISSN-L)
- OpenAlex
- W3014424623
- Cited by
- 335
- References
- 36
- FWCI
- 10.86
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Inference-based accuracy of metagenome prediction tools varies across sample types and functional categories. https://app.cochat.ai/papers/10.1186/s40168-020-00815-y
- The paper
- Sun, S., Jones, R. B., & Fodor, A. A. (2020). Inference-based accuracy of metagenome prediction tools varies across sample types and functional categories. Microbiome. https://doi.org/10.1186/s40168-020-00815-y
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.