Evaluating metagenomics tools for genome binning with real metagenomic datasets and CAMI datasets
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
Background: Shotgun metagenomics based on untargeted sequencing can explore the taxonomic profile and the function of unknown microorganisms in samples, and complement the shortage of amplicon sequencing. Binning assembled sequences into individual groups, which represent microbial genomes, is the key step and a major challenge in metagenomic research. Both supervised and unsupervised machine learning methods have been employed in binning. Genome binning belonging to unsupervised method clusters contigs into individual genome bins by machine learning methods without the assistance of any reference databases. So far a lot of genome binning tools have emerged. Evaluating these genome tools is of great significance to microbiological research. In this study, we evaluate 15 genome binning tools containing 12 original binning tools and 3 refining binning tools by comparing the performance of these tools on chicken gut metagenomic datasets and the first CAMI challenge datasets. Results: For chicken gut metagenomic datasets, original genome binner MetaBat, Groopm2 and Autometa performed better than other original binner, and MetaWrap combined the binning results of them generated the most high-quality genome bins. For CAMI datasets, Groopm2 achieved the highest purity (> 0.9) with good completeness (> 0.8), and reconstructed the most high-quality genome bins among original genome binners. Compared with Groopm2, MetaBat2 had similar performance with higher completeness and lower purity. Genome refining binners DASTool predicated the most high-quality genome bins among all genomes binners. Most genome binner performed well for unique strains. Nonetheless, reconstructing common strains still is a substantial challenge for all genome binner. Conclusions: In conclusion, we tested a set of currently available, state-of-the-art metagenomics hybrid binning tools and provided a guide for selecting tools for metagenomic binning by comparing range of purity, completeness, adjusted rand index, and the number of high-quality reconstructed bins. Furthermore, available information for future binning strategy were concluded.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
DADA2: High–resolution sample inference from Illumina amplicon data
Callahan, B. J., McMurdie, P. J., Rosen, M. J., Han, A. W., Johnson, A. J. A., & Holmes, S. P. (2016) · Nature Methods · doi:10.1038/nmeth.3869 · Cited by 35,698
fastp: an ultra-fast all-in-one FASTQ preprocessor
Chen, S., Zhou, Y., Chen, Y., & Gu, J. (2018) · Bioinformatics · doi:10.1093/bioinformatics/bty560 · Cited by 29,721
Self-citationReproducible, interactive, scalable and extensible microbiome data science using QIIME 2
Bolyen, E., Rideout, J. R., Dillon, M. R., Bokulich, N. A., Abnet, C. C., Al-Ghalith, G. A., Alexander, H., Alm, E. J., Arumugam, M., Asnicar, F., et al. (2019) · Nature Biotechnology · doi:10.1038/s41587-019-0209-9 · Cited by 23,742
Self-citationMinimap2: Pairwise alignment for nucleotide sequences
Li, H. (2018) · Bioinformatics · doi:10.1093/bioinformatics/bty191 · Cited by 14,807
BUSCO: assessing genome assembly and annotation completeness with single-copy orthologs
Simão, F. A., Waterhouse, R. M., Ioannidis, P., Kriventseva, E. V., & Zdobnov, E. M. (2015) · Bioinformatics · doi:10.1093/bioinformatics/btv351 · Cited by 13,344
Parks, D. H., Imelfort, M., Skennerton, C. T., Hugenholtz, P., & Tyson, G. W. (2015) · Genome Research · doi:10.1101/gr.186072.114 · Cited by 12,496
metaSPAdes: a new versatile metagenomic assembler
Nurk, S., Meleshko, D., Korobeynikov, A., & Pevzner, P. A. (2017) · Genome Research · doi:10.1101/gr.213959.116 · Cited by 4,496
Shotgun metagenomics, from sampling to analysis
Quince, C., Walker, A. W., Simpson, J. T., Loman, N. J., & Segata, N. (2017) · Nature Biotechnology · doi:10.1038/nbt.3935 · Cited by 2,202
Unusual biology across a group comprising more than 15% of domain Bacteria
Brown, C. T., Hug, L. A., Thomas, B. C., Sharon, I., Castelle, C. J., Singh, A., Wilkins, M. J., Wrighton, K. C., Williams, K. H., & Banfield, J. F. (2015) · Nature · doi:10.1038/nature14486 · Cited by 1,216
Enterotypes in the landscape of gut microbial community composition
Costea, P. I., Hildebrand, F., Arumugam, M., Bäckhed, F., Blaser, M. J., Bushman, F. D., de Vos, W. M., Ehrlich, S. D., Fraser, C. M., Hattori, M., et al. (2017) · Nature Microbiology · doi:10.1038/s41564-017-0072-8 · Cited by 1,138
Cited by
Identifying biases and their potential solutions in human microbiome studies
Nearing, J. T., Comeau, A. M., & Langille, M. G. I. (2021) · Microbiome · doi:10.1186/s40168-021-01059-0 · Cited by 240
“[166] compared various binning strategies and found that tools output differing results, with DASTool,”
ResultMaguire, F., Jia, B., Gray, K. L., Lau, W. Y. V., Beiko, R. G., & Brinkman, F. S. L. (2020) · Microbial Genomics · doi:10.1099/mgen.0.000436 · Cited by 152
Mycobacteriaceae Mineralizes Micropolyethylene in Riverine Ecosystems.
Sun, X., Chen, Z., Kong, T., Chen, Z., Dong, Y., Kolton, M., Cao, Z., Zhang, X., Zhang, H., Liu, G., et al. (2022) · Environmental Science & Technology · doi:10.1021/acs.est.2c05346 · Cited by 46
Metadata
- Authors
- Yue, Y., Huang, H., Qi, Z., Dou, H.-M., Liu, X.-Y., Han, T.-F., Chen, Y., Song, X.-J., Zhang, Y.-H., & Tu, J.
- Venue
- BMC Bioinformatics
- Published
- 2020-07-28
- Volume
- 21
- Issue
- 1
- Pages
- 334-334
- ISSN
- 1471-2105 (ISSN-L)
- OpenAlex
- W3046109898
- Cited by
- 104
- References
- 13
- FWCI
- 3.94
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Evaluating metagenomics tools for genome binning with real metagenomic datasets and CAMI datasets. https://app.cochat.ai/papers/10.1186/s12859-020-03667-3
- The paper
- Yue, Y., Huang, H., Qi, Z., Dou, H.-M., Liu, X.-Y., Han, T.-F., Chen, Y., Song, X.-J., Zhang, Y.-H., & Tu, J. (2020). Evaluating metagenomics tools for genome binning with real metagenomic datasets and CAMI datasets. BMC Bioinformatics. https://doi.org/10.1186/s12859-020-03667-3
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.