Correcting index databases improves metagenomic studies
Open accessThe DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Abstract
Assessing the taxonomic composition of metagenomic samples is an important first step in understanding the biology and ecology of microbial communities in complex environments. Despite a wealth of algorithms and tools for metagenomic classification, relatively little effort has been put into the critical task of improving the quality of reference indices to which metagenomic reads are assigned. Here, we inferred the taxonomic composition of 404 publicly available metagenomes from human, marine and soil environments, using custom index databases modified according to two factors: the number of reference genomes used to build the databases, and the monophyletic strictness of species definitions. Index databases built following the NCBI taxonomic system were also compared to others using Genome Taxonomy Database (GTDB) taxonomic redefinitions. We observed a considerable increase in the rate of read classification using modified reference index databases as compared to a default NCBI RefSeq database, with up to a 4.4-, 6.4- and 2.2-fold increase in classified reads per sample for human, marine and soil metagenomes, respectively. Importantly, targeted correction for 70 common human pathogens and bacterial genera in the index database increased their specific detection levels in human metagenomes. We also show the choice of index database can influence downstream diversity and distance estimates for microbiome data. Overall, the study shows a large amount of accessible information in metagenomes remains unexploited using current methods, and that the same data analysed using different index databases could potentially lead to different conclusions. These results have implications for the power and design of individual microbiome studies, and for comparison and meta-analysis of microbiome datasets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“We contend that this is at least partly artefactual, as these functional comparisons are typically carried out after discarding the large proportion of metagenomic data that does not map to reference databases 30 .”
From Human microbiome myths and misconceptions (2023) · cites this paper as [30]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
QIIME allows analysis of high-throughput community sequencing data
Caporaso, J. G., Kuczynski, J., Stombaugh, J., Bittinger, K., Bushman, F. D., Costello, E. K., Fierer, N., Peña, A. G., Goodrich, J. K., Gordon, J. I., et al. (2010) · Nature Methods · doi:10.1038/nmeth.f.303 · Cited by 34,887 · cited 1×
“wealth of metagenomic classification algorithms have been developed in the last few years [4, 9-16], 65”
Backgroundphyloseq: An R Package for Reproducible Interactive Analysis and Graphics of Microbiome Census Data
McMurdie, P. J., & Holmes, S. (2013) · PLoS ONE · doi:10.1371/journal.pone.0061217 · Cited by 21,322
Structure, function and diversity of the healthy human microbiome
The Human Microbiome Project Consortium (2012) · Nature · doi:10.1038/nature11234 · Cited by 11,726
Van Der Heijden, M. G. A., Bardgett, R. D., & Van Straalen, N. M. (2008) · Ecology Letters · doi:10.1111/j.1461-0248.2007.01139.x · Cited by 5,053 · cited 1×
“This makes them ubiquitous components of biogeochemical cycles 51 on land [1], in the sea [2], the atmosphere [3], and on or inside other living organisms [4, 5] including 52 humans, in which they are important for development and health [6, 7].”
BackgroundKraken: ultrafast metagenomic sequence classification using exact alignments
Wood, D. E., & Salzberg, S. L. (2014) · Genome Biology · doi:10.1186/gb-2014-15-3-r46 · Cited by 4,521 · cited 5×
“mainly focusing on improving classification speed and memory usage, including popular methods 66 such as Kraken [17, 18] or Centrifuge [19].”
MethodInfluentialA standardized bacterial taxonomy based on genome phylogeny substantially revises the tree of life
Parks, D. H., Chuvochina, M., Waite, D. W., Rinke, C., Skarshewski, A., Chaumeil, P.-A., & Hugenholtz, P. (2018) · Nature Biotechnology · doi:10.1038/nbt.4229 · Cited by 3,603
The human microbiome: at the interface of health and disease
Cho, I., & Blaser, M. J. (2012) · Nature Reviews Genetics · doi:10.1038/nrg3182 · Cited by 3,449
Mash: fast genome and metagenome distance estimation using MinHash
Ondov, B. D., Treangen, T. J., Melsted, P., Mallonee, A. B., Bergman, N. H., Koren, S., & Phillippy, A. M. (2016) · Genome biology · doi:10.1186/s13059-016-0997-x · Cited by 3,373
Structure and function of the global ocean microbiome
Sunagawa, S., Coelho, L. P., Chaffron, S., Kultima, J. R., Labadie, K., Salazar, G., Djahanschiri, B., Zeller, G., Mende, D. R., Alberti, A., et al. (2015) · Science · doi:10.1126/science.1261359 · Cited by 2,921
MetaPhlAn2 for enhanced metagenomic taxonomic profiling
Truong, D. T., Franzosa, E. A., Tickle, T. L., Scholz, M., Weingart, G., Pasolli, E., Tett, A., Huttenhower, C., & Segata, N. (2015) · Nature Methods · doi:10.1038/nmeth.3589 · Cited by 2,185
The NIH Human Microbiome Project
The NIH HMP Working Group, Peterson, J., Garges, S., Giovanni, M., McInnes, P., Wang, L., Schloss, J. A., Bonazzi, V., McEwen, J. E., Wetterstrand, K. A., et al. (2009) · Genome Research · doi:10.1101/gr.096651.109 · Cited by 2,066
Ancient DNA and the rewriting of human history: be sparing with Occam’s razor
Haber, M., Mezzavilla, M., Xue, Y., & Tyler-Smith, C. (2016) · Genome Biology · doi:10.1186/s13059-015-0866-z · Cited by 1,924
Role of microorganisms in the evolution of animals and plants: the hologenome theory of evolution
Zilber-Rosenberg, I., & Rosenberg, E. (2008) · FEMS Microbiology Reviews · doi:10.1111/j.1574-6976.2008.00123.x · Cited by 1,739 · cited 1×
“This makes them ubiquitous components of biogeochemical cycles 51 on land [1], in the sea [2], the atmosphere [3], and on or inside other living organisms [4, 5] including 52 humans, in which they are important for development and health [6, 7].”
BackgroundCentrifuge: rapid and sensitive classification of metagenomic sequences
Kim, D., Song, L., Breitwieser, F. P., & Salzberg, S. L. (2016) · Genome Research · doi:10.1101/gr.210641.116 · Cited by 1,438
Kostic, A. D., Gevers, D., Siljander, H., Vatanen, T., Hyötyläinen, T., Hämäläinen, A.-M., Peet, A., Tillmann, V., Pöhö, P., Mattila, I., et al. (2015) · Cell Host & Microbe · doi:10.1016/j.chom.2015.01.001 · Cited by 1,186
Microbiota and Host Nutrition across Plant and Animal Kingdoms
Hacquard, S., Garrido-Oter, R., González, A., Spaepen, S., Ackermann, G., Lebeis, S., McHardy, A. C., Dangl, J. L., Knight, R., Ley, R., et al. (2015) · Cell Host & Microbe · doi:10.1016/j.chom.2015.04.009 · Cited by 779
PhyloSift: phylogenetic analysis of genomes and metagenomes
Darling, A. E., Jospin, G., Lowe, E., Matsen, F. A., Bik, H. M., & Eisen, J. A. (2014) · PeerJ · doi:10.7717/peerj.243 · Cited by 631
Jackson, M. A., Verdi, S., Maxan, M.-E., Shin, C. M., Zierer, J., Bowyer, R. C. E., Martin, T., Williams, F. M. K., Menni, C., Bell, J. T., et al. (2018) · Nature Communications · doi:10.1038/s41467-018-05184-7 · Cited by 616
Marine Microbes See a Sea of Gradients
Stocker, R. (2012) · Science · doi:10.1126/science.1208929 · Cited by 604
phyloXML: XML for evolutionary biology and comparative genomics
Han, M. V., & Zmasek, C. M. (2009) · BMC Bioinformatics · doi:10.1186/1471-2105-10-356 · Cited by 545
KrakenUniq: confident and fast metagenomics classification using unique k-mer counts
Breitwieser, F. P., Baker, D. N., & Salzberg, S. L. (2018) · Genome Biology · doi:10.1186/s13059-018-1568-0 · Cited by 474
Evaluating the Information Content of Shallow Shotgun Metagenomics
Hillmann, B., Al-Ghalith, G. A., Shields-Cutler, R. R., Zhu, Q., Gohl, D. M., Beckman, K. B., Knight, R., & Knights, D. (2018) · mSystems · doi:10.1128/msystems.00069-18 · Cited by 474 · cited 1×
“In particular, our results may 314 facilitate “shallow sequencing” metagenomics [34] by maximising the extraction of taxonomic 315 information from samples sequenced at lower depth, thus enabling more cost-effective comparison of 316 thousands or tens of thousands of samples in large-scale metagenomic and multi-omics…”
Novel soil bacteria possess diverse genes for secondary metabolite biosynthesis
Crits-Christoph, A., Diamond, S., Butterfield, C. N., Thomas, B. C., & Banfield, J. F. (2018) · Nature · doi:10.1038/s41586-018-0207-y · Cited by 435
Open science resources for the discovery and analysis of Tara Oceans data
Pesant, S., Not, F., Picheral, M., Kandels-Lewis, S., Le Bescot, N., Gorsky, G., Iudicone, D., Karsenti, E., Speich, S., Troublé, R., et al. (2015) · Scientific Data · doi:10.1038/sdata.2015.23 · Cited by 431
SILVA, RDP, Greengenes, NCBI and OTT — how do these taxonomies compare?
Balvočiūtė, M., & Huson, D. H. (2017) · BMC Genomics · doi:10.1186/s12864-017-3501-4 · Cited by 405
Comprehensive benchmarking and ensemble approaches for metagenomic classifiers
McIntyre, A. B. R., Ounit, R., Afshinnekoo, E., Prill, R. J., Hénaff, E., Alexander, N., Minot, S. S., Danko, D., Foox, J., Ahsanuddin, S., et al. (2017) · Genome Biology · doi:10.1186/s13059-017-1299-7 · Cited by 342 · cited 2×
“indices from all described bacteria and archaea using their reported taxonomic definitions [16, 21], 76 typically NCBI RefSeq [22] for whole representative genomes, and SILVA, Greengenes, or RDP [23] 77 for 16S rRNA-based studies.”
BackgroundMethodPhylogenomic evidence for ancient hybridization in the genomes of living cats (Felidae)
Li, G., Davis, B. W., Eizirik, E., & Murphy, W. J. (2016) · Genome Research · doi:10.1101/gr.186668.114 · Cited by 326
En route to a genome-based classification of Archaea and Bacteria?
Klenk, H.-P., & Göker, M. (2010) · Systematic and Applied Microbiology · doi:10.1016/j.syapm.2010.03.003 · Cited by 275
The phenomenon of microbial uncultivability
Epstein, S. (2013) · Current Opinion in Microbiology · doi:10.1016/j.mib.2013.08.003 · Cited by 223
Microorganisms cultured from stratospheric air samples obtained at 41 km
Wainwright, M. (2003) · FEMS Microbiology Letters · doi:10.1016/s0378-1097(02)01138-2 · Cited by 216
Gomila, M., Busquets, A., Mulet, M., García-Valdés, E., & Lalucat, J. (2017) · Frontiers in Microbiology · doi:10.3389/fmicb.2017.02422 · Cited by 170
Nasko, D. J., Koren, S., Phillippy, A. M., & Treangen, T. J. (2018) · Genome Biology · doi:10.1186/s13059-018-1554-6 · Cited by 170 · cited 1×
“Recent efforts showed that the addition of new genomes to NCBI RefSeq could influence 72 metagenomic classification performance, with indices built on most recent releases of NCBI RefSeq 73 able to classify more reads overall, but fewer at the species level [20].”
BackgroundContribution of Microbial Activity to Carbon Chemistry in Clouds
Vaïtilingom, M., Amato, P., Sancelme, M., Laj, P., Leriche, M., & Delort, A. M. (2009) · Applied and Environmental Microbiology · doi:10.1128/aem.01127-09 · Cited by 126
Update on RefSeq microbial genomes resources
Tatusova, T., Ciufo, S., Federhen, S., Fedorov, B., McVeigh, R., O'Neill, K., Tolstoy, I., & Zaslavsky, L. (2015) · Nucleic Acids Research · doi:10.1093/nar/gku1062 · Cited by 123
Koeppel, A. F., & Wu, M. (2013) · Nucleic Acids Research · doi:10.1093/nar/gkt241 · Cited by 115
Pettengill, E. A., Pettengill, J., & Binet, R. (2016) · Frontiers in Microbiology · doi:10.3389/fmicb.2015.01573 · Cited by 99
Pavian: Interactive analysis of metagenomics data for microbiomics and pathogen identificationPreprint
Breitwieser, F. P., & Salzberg, S. L. (2016) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/084715 · Cited by 75
Méric, G., Mageiros, L., Pascoe, B., Woodcock, D. J., Mourkas, E., Lamble, S., Bowden, R. J., Jolley, K. A., Raymond, B., & Sheppard, S. K. (2018) · Molecular Ecology · doi:10.1111/mec.14546 · Cited by 60
Self-citationGenetic and phylogenetic evidence for misidentification of Vibrio species within the Harveyi clade
Hoffmann, M., Monday, S. R., Fischer, M. J., & Brown, E. W. (2011) · Letters in Applied Microbiology · doi:10.1111/j.1472-765x.2011.03183.x · Cited by 53
Conducting metagenomic studies in microbiology and clinical research
Martin, T. C., Visconti, A., Spector, T. D., & Falchi, M. (2018) · Applied Microbiology and Biotechnology · doi:10.1007/s00253-018-9209-9 · Cited by 48
LiveKraken––real-time metagenomic classification of illumina data
Tausch, S. H., Strauch, B., Andrusch, A., Loka, T. P., Lindner, M. S., Nitsche, A., & Renard, B. Y. (2018) · Bioinformatics · doi:10.1093/bioinformatics/bty433 · Cited by 35
Bayesian identification of bacterial strains from sequencing data
Sankar, A., Malone, B., Bayliss, S., Pascoe, B., Méric, G., Hitchings, M. D., Sheppard, S. K., Feil, E. J., Corander, J., & Honkela, A. (2016) · Microbial Genomics · doi:10.1099/mgen.0.000075 · Cited by 22
Self-citationHahn, A., Fanous, H., Jensen, C. D., Chaney, H. R., Sami, I. R., Pérez, G. F., Koumbourlis, A. C., Louie, S. G., Bost, J. E., van den Anker, J. N., et al. (2019) · Scientific Reports · doi:10.1038/s41598-019-38984-y · Cited by 22
Research works printed but not linked: 1
- 10.1111/j.1574-6968.2003.tb11513.x · doi:10.1111/j.1574-6968.2003.tb11513.x · Paper page
Cited by
RESCRIPt: Reproducible sequence taxonomy reference database management
(2021) · doi:10.1371/journal.pcbi.1009581 · Cited by 983
Qin, Y., Havulinna, A. S., Liu, Y., Jousilahti, P., Ritchie, S. C., Tokolyi, A., Sanders, J. G., Valsta, L., Brożyńska, M., Zhu, Q., et al. (2022) · Nature Genetics · doi:10.1038/s41588-021-00991-z · Cited by 586
Self-citationPersonalized microbiome-driven effects of non-nutritive sweeteners on human glucose tolerance
Suez, J., Cohen, Y., Valdés-Mas, R., Mor, U., Dori-Bachash, M., Federici, S., Zmora, N., Leshem, A., Heinemann, M., Linevsky, R., et al. (2022) · Cell · doi:10.1016/j.cell.2022.07.016 · Cited by 423
RESCRIPt: Reproducible sequence taxonomy reference database management for the massesPreprint
Robeson, M. S., O’Rourke, D. R., Kaehler, B. D., Ziemski, M., Dillon, M. R., Foster, J. T., & Bokulich, N. A. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.10.05.326504 · Cited by 176
Human microbiome myths and misconceptions
Walker, A. W., & Hoyles, L. (2023) · Nature Microbiology · doi:10.1038/s41564-023-01426-7 · Cited by 163
Metadata
- Authors
- Méric, G., Wick, R. R., Watts, S. C., Holt, K. E., & Inouye, M.
- Affiliations
- Baker Heart and Diabetes Institute (AU)
- Monash University (AU)
- London School of Hygiene & Tropical Medicine (GB)
- Corresponding author
- Méric, Guillaume
- Wick, Ryan R.
- Venue
- bioRxiv (Cold Spring Harbor Laboratory)
- Publisher
- openRxiv
- Published
- 2019-07-23
- OpenAlex
- W2962840130
- Cited by
- 34
- References
- 43
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 8 · 2023: 3 · 2022: 6 · 2021: 11 · 2020: 3
- Type
- posted content
- Language
- en
- Open access
- green
- doi.org
- Licence
- cc-by-nc-nd
- Locations
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nc-nd)
- LSHTM Research Online (London School of Hygiene and Tropical Medicine) (acceptedVersion)
- Funders
- Bill and Melinda Gates Foundation
- Australian Government
- State Government of Victoria
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
- Physical Sciences › Environmental Science › Ecology › Microbial Community Ecology and Physiology
- Physical Sciences › Environmental Science › Ecology › Environmental DNA in Biodiversity Studies
- Keywords
- taxonomic classification, metagenome-assembled genomes, GTDB, NCBI RefSeq, human pathogens, marine metagenomes, soil metagenome
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.