The DOI matches its Crossref record; 85 of the 85 references it cites were found in a registry or an index.
Benchmarking Metagenomics Tools for Taxonomic Classification
Open accessAbstract
Summary Metagenomic sequencing is revolutionizing the detection and characterization of microbial species, and a wide variety of software tools are available to perform taxonomic classification of this data. The fast pace of development of these tools, alongside the complexity of metagenomic data, make it important that researchers are able to benchmark their performance. Here, we review current approaches for metagenomic analysis and evaluate the performance of 20 metagenomic classifiers using simulated and experimental datasets. We describe the key metrics used to assess performance, offer a framework for the comparison of additional classifiers, and discuss the future of metagenomic data analysis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Basic local alignment search tool
Altschul, S. F., Gish, W., Miller, W., Myers, E. W., & Lipman, D. J. (1990) · Journal of Molecular Biology · doi:10.1006/jmbi.1990.9999 · Cited by 98,669
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
Matplotlib: a 2D graphics environment
Hunter, J. D. (2007) · Computing in Science & Engineering · doi:10.1109/mcse.2007.55 · Cited by 39,249
The SILVA ribosomal RNA gene database project: improved data processing and web-based tools
Quast, C., Pruesse, E., Yilmaz, P., Gerken, J., Schweer, T., Yarza, P., Peplies, J., & Glöckner, F. O. (2012) · Nucleic Acids Research · doi:10.1093/nar/gks1219 · Cited by 33,055
Fast and sensitive protein alignment using DIAMOND
Buchfink, B., Xie, C., & Huson, D. H. (2015) · Nature Methods · doi:10.1038/nmeth.3176 · Cited by 14,201
Data Structures for Statistical Computing in Python
McKinney, W. (2010) · Proceedings of the Python in Science Conference · doi:10.25080/majora-92bf1922-00a · Cited by 11,032
UniFrac: a New Phylogenetic Method for Comparing Microbial Communities
Lozupone, C., & Knight, R. (2005) · Applied and Environmental Microbiology · doi:10.1128/aem.71.12.8228-8235.2005 · Cited by 8,227
The relationship between Precision-Recall and ROC curves
Davis, J., & Goadrich, M. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143874 · Cited by 6,559
Saito, T., & Rehmsmeier, M. (2015) · PLOS ONE · doi:10.1371/journal.pone.0118432 · Cited by 5,309
Aligning sequence reads, clone sequences and assembly contigs with BWA-MEM
Li, H. (2013) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.48550/arxiv.1303.3997 · Cited by 5,159
Cited by
Improved metagenomic analysis with Kraken 2
Wood, D. E., Lu, J., & Langmead, B. (2019) · Genome Biology · doi:10.1186/s13059-019-1891-0 · Cited by 7,061
Beghini, F., McIver, L. J., Blanco-Míguez, A., Dubois, L., Asnicar, F., Maharjan, S., Mailyan, A., Manghi, P., Scholz, M., Thomas, A. M., et al. (2021) · eLife · doi:10.7554/elife.65088 · Cited by 2,303
A practical guide to amplicon and metagenomic analysis of microbiome data
Liu, Y.-X., Qin, Y., Chen, T., Lu, M., Qian, X., Guo, X., & Bai, Y. (2021) · Protein & Cell · doi:10.1007/s13238-020-00724-8 · Cited by 864
Metagenome analysis using the Kraken software suite
Lu, J., Rincon, N., Wood, D. E., Breitwieser, F. P., Pockrandt, C., Langmead, B., Salzberg, S. L., & Steinegger, M. (2022) · Nature Protocols · doi:10.1038/s41596-022-00738-y · Cited by 756
A pan-cancer mycobiome analysis reveals fungal involvement in gastrointestinal and lung tumors
Dohlman, A. B., Klug, J., Mesko, M., Gao, I. H., Lipkin, S. M., Shen, X., & Iliev, I. D. (2022) · Cell · doi:10.1016/j.cell.2022.09.015 · Cited by 413
Kalantar, K. L., Carvalho, T., de Bourcy, C. F. A., Dimitrov, B., Dingle, G., Egger, R., Han, J., Holmes, O. B., Juan, Y.-F., King, R., et al. (2020) · GigaScience · doi:10.1093/gigascience/giaa111 · Cited by 406
Pérez-Cobas, A. E., Gomez-Valero, L., & Buchrieser, C. (2020) · Microbial Genomics · doi:10.1099/mgen.0.000409 · Cited by 314
Identifying biases and their potential solutions in human microbiome studies
Nearing, J. T., Comeau, A. M., & Langille, M. G. I. (2021) · Microbiome · doi:10.1186/s40168-021-01059-0 · Cited by 240
A survey of k-mer methods and applications in bioinformatics
Moeckel, C., Mareboina, M., Konnaris, M. A., Chan, C. S. Y., Mouratidis, I., Montgomery, A., Chantzi, N., Pavlopoulos, G. A., & Georgakopoulos-Soares, I. (2024) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2024.05.025 · Cited by 131
“[257,258] Table 2 ( continued ) Application Description Tools (reference) [272], Taxonomer[273], TETRA[274], VirFinder[18], WGSQuikr[275]”
BackgroundQuantifying bias introduced by sample collection in relative and absolute microbiome measurements
Maghini, D. G., Dvorak, M., Dahlen, A., Roos, M., Doyle, B., Kuersten, S., & Bhatt, A. S. (2024) · Nature Biotechnology · doi:10.1038/s41587-023-01754-3 · Cited by 116
Virus Metagenomics in Farm Animals: A Systematic Review
Kwok, K. T. T., Nieuwenhuijse, D. F., Phan, M. V. T., & Koopmans, M. P. G. (2020) · Viruses · doi:10.3390/v12010107 · Cited by 97
Han, D., Gao, P., Li, R., Tan, P., Xie, J., Zhang, R., & Li, J. (2020) · Journal of Advanced Research · doi:10.1016/j.jare.2020.07.010 · Cited by 93
Metadata
- Authors
- Ye, S. H., Siddle, K. J., Park, D. J., & Sabeti, P. C.
- Venue
- Cell
- Publisher
- Elsevier BV
- Published
- 2019-08
- Volume
- 178
- Issue
- 4
- Pages
- 779-794
- ISSN
- 0092-8674 (ISSN-L)
- OpenAlex
- W2968450569
- Cited by
- 593
- References
- 85
- FWCI
- 17.76
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.