The DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
Benchmarking viromics: an in silico evaluation of metagenome-enabled estimates of viral community composition and diversity
Open accessAbstract
Background: Viral metagenomics (viromics) is increasingly used to obtain uncultivated viral genomes, evaluate community diversity, and assess ecological hypotheses. While viromic experimental methods are relatively mature and widely accepted by the research community, robust bioinformatics standards remain to be established. Here we used in silico mock viral communities to evaluate the viromic sequence-to-ecological-inference pipeline, including (i) read pre-processing and metagenome assembly, (ii) thresholds applied to estimate viral relative abundances based on read mapping to assembled contigs, and (iii) normalization methods applied to the matrix of viral relative abundances for alpha and beta diversity estimates. Results: Tools specifically designed for metagenomes, specifically metaSPAdes, MEGAHIT, and IDBA-UD, were the most effective at assembling viromes. Read pre-processing, such as partitioning, had virtually no impact on assembly output, but may be useful when hardware is limited. Viral populations with 2–5 × coverage typically assembled well, whereas lesser coverage led to fragmented assembly. Strain heterogeneity within populations hampered assembly, especially when strains were closely related (average nucleotide identity, or ANI ≥97%) and when the most abundant strain represented <50% of the population. Viral community composition assessments based on read recruitment were generally accurate when the following thresholds for detection were applied: (i) ≥10 kb contig lengths to define populations, (ii) coverage defined from reads mapping at ≥90% identity, and (iii) ≥75% of contig length with ≥1 × coverage. Finally, although data are limited to the most abundant viruses in a community, alpha and beta diversity patterns were robustly estimated (±10%) when comparing samples of similar sequencing depth, but more divergent (up to 80%) when sequencing depth was uneven across the dataset. In the latter cases, the use of normalization methods specifically developed for metagenomes provided the best estimates. Conclusions: These simulations provide benchmarks for selecting analysis cut-offs and establish that an optimized sample-to-ecological-inference viromics pipeline is robust for making ecological inferences from natural viral communities. Continued development to better accessing RNA, rare, and/or diverse viral populations and improved reference viral genome availability will alleviate many of viromics remaining limitations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Trimmomatic: a flexible trimmer for Illumina sequence data
Bolger, A. M., Lohse, M., & Usadel, B. (2014) · Bioinformatics · doi:10.1093/bioinformatics/btu170 · Cited by 65,548
Robinson, M. D., McCarthy, D. J., & Smyth, G. K. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btp616 · Cited by 41,364
vegan: Community Ecology Package
Oksanen, J., Simpson, G. L., Blanchet, F. G., Kindt, R., Legendre, P., Minchin, P. R., O'Hara, R. B., Solymos, P., Stevens, M. H. H., Szoecs, E., et al. (2001) · CRAN: Contributed Packages · doi:10.32614/cran.package.vegan · Cited by 22,615
Differential expression analysis for sequence count data
Anders, S., & Huber, W. (2010) · Genome Biology · doi:10.1186/gb-2010-11-10-r106 · Cited by 15,581
ggplot2: Elegant Graphics for Data Analysis
Wickham, H. (2009) · doi:10.1007/978-0-387-98141-3 · Cited by 14,447
Parks, D. H., Imelfort, M., Skennerton, C. T., Hugenholtz, P., & Tyson, G. W. (2015) · Genome Research · doi:10.1101/gr.186072.114 · Cited by 12,496
metaSPAdes: a new versatile metagenomic assembler
Nurk, S., Meleshko, D., Korobeynikov, A., & Pevzner, P. A. (2017) · Genome Research · doi:10.1101/gr.213959.116 · Cited by 4,496
Nonparametric estimation of the number of classes in a population
Chao, A. (1984) · Scandinavian Journal of Statistics · Cited by 4,265
The Microbial Engines That Drive Earth's Biogeochemical Cycles
Falkowski, P. G., Fenchel, T., & Delong, E. F. (2008) · Science · doi:10.1126/science.1153213 · Cited by 3,379
Peng, Y., Leung, H. C. M., Yiu, S. M., & Chin, F. Y. L. (2012) · Bioinformatics · doi:10.1093/bioinformatics/bts174 · Cited by 2,989
Waste Not, Want Not: Why Rarefying Microbiome Data Is Inadmissible
McMurdie, P. J., & Holmes, S. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003531 · Cited by 2,921
The Genome Standards Consortium, Bowers, R. M., Kyrpides, N. C., Stepanauskas, R., Harmon-Smith, M., Doud, D., Reddy, T. B. K., Schulz, F., Jarett, J., Rivers, A. R., et al. (2017) · Nature Biotechnology · doi:10.1038/nbt.3893 · Cited by 2,624
Self-citationDifferential abundance analysis for microbial marker-gene surveys
Paulson, J. N., Stine, O. C., Bravo, H. C., & Pop, M. (2013) · Nature Methods · doi:10.1038/nmeth.2658 · Cited by 2,428
Li, D., Luo, R., Liu, C.-M., Leung, C.-M., Ting, H.-F., Sadakane, K., Yamashita, H., & Lam, T.-W. (2016) · Methods · doi:10.1016/j.ymeth.2016.02.020 · Cited by 2,079
Pyrosequencing enumerates and contrasts soil microbial diversity
Roesch, L. F. W., Fulthorpe, R. R., Riva, A., Casella, G., Hadwin, A. K. M., Kent, A. D., Daroub, S. H., Camargo, F. A. O., Farmerie, W. G., & Triplett, E. W. (2007) · The ISME Journal · doi:10.1038/ismej.2007.53 · Cited by 1,852
Mesopelagic fish biomass and trophic efficiency of the open ocean
Irigoien, X., Klevjer, J., Røstad, A., Martínez, U., Boyra, G., Acuña, J. L., Bode, A., Echevarrı́a, F., González-Gordillo, J. L., Hernández‐León, S., et al. (2014) · DIGITAL.CSIC (Spanish National Research Council (CSIC)) · Cited by 1,813
Using ecological diversity measures with bacterial communities
Hill, T. C. J., Walsh, K. A., Harris, J. A., & Moffett, B. F. (2003) · FEMS Microbiology Ecology · doi:10.1016/s0168-6496(02)00449-x · Cited by 1,020
Critical Assessment of Metagenome Interpretation—a benchmark of metagenomics software
Sczyrba, A., Hofmann, P., Belmann, P., Koslicki, D., Janssen, S., Dröge, J., Gregor, I., Majda, S., Fiedler, J., Dahms, E., et al. (2017) · Nature Methods · doi:10.1038/nmeth.4458 · Cited by 870
Edwards, R. A., & Rohwer, F. (2005) · Nature Reviews Microbiology · doi:10.1038/nrmicro1163 · Cited by 820
Patterns and ecological drivers of ocean viral communities
Brum, J. R., Ignacio-Espinoza, J. C., Roux, S., Doulcier, G., Acinas, S. G., Alberti, A., Chaffron, S., Cruaud, C., de Vargas, C., Gasol, J. M., et al. (2015) · Science · doi:10.1126/science.1261498 · Cited by 785
Self-citationNamiki, T., Hachiya, T., Tanaka, H., & Sakakibara, Y. (2012) · Nucleic Acids Research · doi:10.1093/nar/gks678 · Cited by 668
Fermentation, Hydrogen, and Sulfur Metabolism in Multiple Uncultivated Bacterial Phyla
Wrighton, K. C., Thomas, B. C., Sharon, I., Miller, C. S., Castelle, C. J., VerBerkmoes, N. C., Wilkins, M. J., Hettich, R. L., Lipton, M. S., Williams, K. H., et al. (2012) · Science · doi:10.1126/science.1224041 · Cited by 661
Using MUMmer to Identify Similar Regions in Large Sequence Sets
Delcher, A. L., Salzberg, S. L., & Phillippy, A. M. (2003) · Current Protocols in Bioinformatics · doi:10.1002/0471250953.bi1003s00 · Cited by 541
Sharon, I., Morowitz, M. J., Thomas, B. C., Costello, E. K., Relman, D. A., & Banfield, J. F. (2013) · Genome Research · doi:10.1101/gr.142315.112 · Cited by 481
Robust estimation of microbial diversity in theory and in practice
Haegeman, B., Hamelin, J., Moriarty, J., Neal, P., Dushoff, J., & Weitz, J. S. (2013) · The ISME Journal · doi:10.1038/ismej.2013.10 · Cited by 431
Viral and microbial community dynamics in four aquatic environments
Rodriguez-Brito, B., Li, L., Wegley, L., Furlan, M., Angly, F., Breitbart, M., Buchanan, J., Desnues, C., Dinsdale, E., Edwards, R., et al. (2010) · The ISME Journal · doi:10.1038/ismej.2010.1 · Cited by 429
Microbes do not follow the elevational diversity patterns of plants and animals
Fierer, N., McCain, C. M., Meir, P., Zimmermann, M., Rapp, J. M., Silman, M. R., & Knight, R. (2011) · Ecology · doi:10.1890/10-1170.1 · Cited by 396
The khmer software package: enabling efficient nucleotide sequence analysis
Crusoe, M. R., Alameldin, H. F., Awad, S., Boucher, E., Caldwell, A., Cartwright, R., Charbonneau, A., Constantinides, B., Edvenson, G., Fay, S., et al. (2015) · F1000Research · doi:10.12688/f1000research.6924.1 · Cited by 388
Rising to the challenge: accelerated pace of discovery transforms marine virology
Brum, J. R., & Sullivan, M. B. (2015) · Nature Reviews Microbiology · doi:10.1038/nrmicro3404 · Cited by 380
Self-citationUse of simulated data sets to evaluate the fidelity of metagenomic processing methods
Mavromatis, K., Ivanova, N., Barry, K., Shapiro, H., Goltsman, E., McHardy, A. C., Rigoutsos, I., Salamov, A., Korzeniewski, F., Land, M., et al. (2007) · Nature Methods · doi:10.1038/nmeth1043 · Cited by 344
Logares, R., Sunagawa, S., Salazar, G., Cornejo‐Castillo, F. M., Ferrera, I., Sarmento, H., Hingamp, P., Ogata, H., de Vargas, C., Lima‐Mendez, G., et al. (2014) · Environmental Microbiology · doi:10.1111/1462-2920.12250 · Cited by 342
Viruses as Winners in the Game of Life
Cobián Güemes, A. G., Youle, M., Cantú, V. A., Felts, B., Nulton, J., & Rohwer, F. (2016) · Annual Review of Virology · doi:10.1146/annurev-virology-100114-054952 · Cited by 319
Assessment of Metagenomic Assembly Using Simulated Next Generation Sequencing Data
Mende, D. R., Waller, A. S., Sunagawa, S., Järvelin, A. I., Chan, M. M., Arumugam, M., Raes, J., & Bork, P. (2012) · PLoS ONE · doi:10.1371/journal.pone.0031386 · Cited by 296
The bright side of microbial dark matter: lessons learned from the uncultivated majority
Solden, L., Lloyd, K., & Wrighton, K. (2016) · Current Opinion in Microbiology · doi:10.1016/j.mib.2016.04.020 · Cited by 292
vConTACT: an iVirus tool to classify double-stranded DNA viruses that infect Archaea and Bacteria
Bolduc, B., Jang, H. B., Doulcier, G., You, Z.-Q., Roux, S., & Sullivan, M. B. (2017) · PeerJ · doi:10.7717/peerj.3243 · Cited by 287
Self-citationMetabolic reprogramming by viruses in the sunlit and dark ocean
Hurwitz, B. L., Hallam, S. J., & Sullivan, M. B. (2013) · Genome Biology · doi:10.1186/gb-2013-14-11-r123 · Cited by 276
Self-citationRecovering complete and draft population genomes from metagenome datasets
Sangwan, N., Xia, F., & Gilbert, J. A. (2016) · Microbiome · doi:10.1186/s40168-016-0154-5 · Cited by 260
A survey of error-correction methods for next-generation sequencing
Yang, X., Chockalingam, S. P., & Aluru, S. (2013) · Briefings in Bioinformatics · doi:10.1093/bib/bbs015 · Cited by 249
Marine T4-type bacteriophages, a ubiquitous component of the dark matter of the biosphere
Filée, J., Tétart, F., Suttle, C. A., & Krisch, H. M. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0503404102 · Cited by 244
Vollmers, J., Wiegand, S., & Kaster, A.-K. (2017) · PLoS ONE · doi:10.1371/journal.pone.0169662 · Cited by 240
Assessing the Diversity and Specificity of Two Freshwater Viral Communities through Metagenomics
Roux, S., Enault, F., Robin, A., Ravet, V., Personnic, S., Theil, S., Colombet, J., Sime-Ngando, T., & Debroas, D. (2012) · PLoS ONE · doi:10.1371/journal.pone.0033641 · Cited by 240
Self-citationMetavir 2: new tools for viral metagenome comparison and assembled virome analysis
Roux, S., Tournayre, J., Mahul, A., Debroas, D., & Enault, F. (2014) · BMC Bioinformatics · doi:10.1186/1471-2105-15-76 · Cited by 235
Self-citationProbing Individual Environmental Bacteria for Viruses by Using Microfluidic Digital PCR
Tadmor, A. D., Ottesen, E. A., Leadbetter, J. R., & Phillips, R. (2011) · Science · doi:10.1126/science.1200758 · Cited by 230
Towards quantitative viromics for both double-stranded and single-stranded DNA viruses
Roux, S., Solonenko, N. E., Dang, V. T., Poulos, B. T., Schwenck, S. M., Goldsmith, D. B., Coleman, M. L., Breitbart, M., & Sullivan, M. B. (2016) · PeerJ · doi:10.7717/peerj.2777 · Cited by 214
Self-citationAngly, F. E., Willner, D., Prieto-Davó, A., Edwards, R. A., Schmieder, R., Vega-Thurber, R., Antonopoulos, D. A., Barott, K., Cottrell, M. T., Desnues, C., et al. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000593 · Cited by 208
Single-virus genomics reveals hidden cosmopolitan and abundant viruses
Martinez-Hernandez, F., Fornas, O., Lluesma Gomez, M., Bolduc, B., de la Cruz Peña, M. J., Martínez, J. M., Anton, J., Gasol, J. M., Rosselli, R., Rodriguez-Valera, F., et al. (2017) · Nature Communications · doi:10.1038/ncomms15892 · Cited by 208
Self-citationAssembly of Viral Metagenomes from Yellowstone Hot Springs
Schoenfeld, T., Patterson, M., Richardson, P. M., Wommack, K. E., Young, M., & Mead, D. (2008) · Applied and Environmental Microbiology · doi:10.1128/aem.02598-07 · Cited by 201
Hurwitz, B. L., Brum, J. R., & Sullivan, M. B. (2015) · The ISME Journal · doi:10.1038/ismej.2014.143 · Cited by 196
Self-citationAre we missing half of the viruses in the ocean?
Steward, G. F., Culley, A. I., Mueller, J. A., Wood-Charlson, E. M., Belcaid, M., & Poisson, G. (2013) · The ISME Journal · doi:10.1038/ismej.2012.121 · Cited by 188
IMG/VR: a database of cultured and uncultured DNA Viruses and retroviruses
Paez-Espino, D., Chen, I.-M. A., Palaniappan, K., Ratner, A., Chu, K., Szeto, E., Pillay, M., Huang, J., Markowitz, V. M., Nielsen, T., et al. (2016) · Nucleic Acids Research · doi:10.1093/nar/gkw1030 · Cited by 187
Self-citationDistantly sampled soils carry few species in common
Fulthorpe, R. R., Roesch, L. F., Riva, A., & Triplett, E. W. (2008) · The ISME Journal · doi:10.1038/ismej.2008.55 · Cited by 180
Duhaime, M. B., Deng, L., Poulos, B. T., & Sullivan, M. B. (2012) · Environmental Microbiology · doi:10.1111/j.1462-2920.2012.02791.x · Cited by 168
Self-citationWhere Next for Microbiome Research?
Waldor, M. K., Tyson, G., Borenstein, E., Ochman, H., Moeller, A., Finlay, B. B., Kong, H. H., Gordon, J. I., Nelson, K. E., Dabbagh, K., et al. (2015) · PLOS Biology · doi:10.1371/journal.pbio.1002050 · Cited by 166
Challenges in the analysis of viral metagenomes
Rose, R., Constantinides, B., Tapinos, A., Robertson, D. L., & Prosperi, M. (2016) · Virus Evolution · doi:10.1093/ve/vew022 · Cited by 144
Allers, E., Moraru, C., Duhaime, M. B., Beneze, E., Solonenko, N., Barrero‐Canosa, J., Amann, R., & Sullivan, M. B. (2013) · Environmental Microbiology · doi:10.1111/1462-2920.12100 · Cited by 138
Self-citationAccurate, multi-kb reads resolve complex populations and detect rare microorganismsPreprint
Sharon, I., Kertesz, M., Hug, L. A., Pushkarev, D., Blauwkamp, T. A., Castelle, C. J., Amirebrahimi, M., Thomas, B. C., Burstein, D. E., Tringe, S. G., et al. (2015) · Genome Research · doi:10.1101/gr.183012.114 · Cited by 129
Genetic algorithm with logistic regression for prediction of progression to Alzheimer's disease
Johnson, P., Vandewater, L., Wilson, W. J., Maruff, P. T., Savage, G. R., Graham, P. L., Macaulay, L. S., Ellis, K. A., Szoeke, C. E. I., Martins, R. N., et al. (2014) · BMC Bioinformatics · doi:10.1186/1471-2105-15-s16-s11 · Cited by 112
Omega: an Overlap-graphde novoAssembler for Metagenomics
Haider, B., Ahn, T.-H., Bushnell, B., Chai, J., Copeland, A., & Pan, C. (2014) · Bioinformatics · doi:10.1093/bioinformatics/btu395 · Cited by 97
Vázquez-Castellanos, J. F., García-López, R., Pérez‐Brocal, V., Pignatelli, M., & Moyá, A. (2014) · BMC Genomics · doi:10.1186/1471-2164-15-37 · Cited by 88
Seasonality and monthly dynamics of marine myovirus communities
Chow, C. T., & Fuhrman, J. A. (2012) · Environmental Microbiology · doi:10.1111/j.1462-2920.2012.02744.x · Cited by 77
Unveiling viral–host interactions within the ‘microbial dark matter’
Martínez‐García, M., Santos, F., Moreno‐Paz, M., Parro, V., & Antón, J. (2014) · Nature Communications · doi:10.1038/ncomms5542 · Cited by 76
NeSSM: A Next-Generation Sequencing Simulator for Metagenomics
Jia, B., Xuan, L., Cai, K., Hu, Z., Ma, L., & Wei, C. (2013) · PLoS ONE · doi:10.1371/journal.pone.0075448 · Cited by 66
Early biomarkers of brain injury and cerebral hypo- and hyperoxia in the SafeBoosC II trial
Plomgaard, A. M., Alderliesten, T., Austin, T., van Bel, F., Benders, M. J. N. L., Claris, O., Dempsey, E. M., Fumagalli, M., Gluud, C. N., Hagmann, C. F., et al. (2017) · PLoS ONE · doi:10.1371/journal.pone.0173440 · Cited by 64
Recombination and microdiversity in coastal marine cyanophages
Marston, M. F., & Amrich, C. G. (2009) · Environmental Microbiology · doi:10.1111/j.1462-2920.2009.02037.x · Cited by 53
García-López, R., Vázquez-Castellanos, J. F., & Moyá, A. (2015) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2015.00141 · Cited by 49
Aziz, R. K., Dwivedi, B., Akhter, S., Breitbart, M., & Edwards, R. A. (2015) · Frontiers in Microbiology · doi:10.3389/fmicb.2015.00381 · Cited by 34
Evaluation of viral genome assembly and diversity estimation in deep metagenomes
de Cárcer, D. A., Angly, F. E., & Alcamı́, A. (2014) · BMC Genomics · doi:10.1186/1471-2164-15-989 · Cited by 32
Utilization of defined microbial communities enables effective evaluation of meta-genomic assemblies
Greenwald, W. W. Y., Klitgord, N., Seguritan, V., Yooseph, S., Venter, J. C., Garner, C. P., Nelson, K. E., & Li, W. (2017) · BMC Genomics · doi:10.1186/s12864-017-3679-5 · Cited by 26
Nunes-Alves, C. (2014) · Nature Reviews Microbiology · doi:10.1038/nrmicro3409 · Cited by 3
Cited by
CheckV assesses the quality and completeness of metagenome-assembled viral genomes
Nayfach, S., Camargo, A. P., Schulz, F., Eloe-Fadrosh, E., Roux, S., & Kyrpides, N. C. (2021) · Nature Biotechnology · doi:10.1038/s41587-020-00774-7 · Cited by 1,750
Self-citationMarine DNA Viral Macro- and Microdiversity from Pole to Pole
Gregory, A. C., Zayed, A. A., Conceição-Neto, N., Temperton, B., Bolduc, B., Alberti, A., Ardyna, M., Arkhipova, K., Carmichael, M., Cruaud, C., et al. (2019) · Cell · doi:10.1016/j.cell.2019.03.040 · Cited by 826
Self-citationBacteriophages of the Human Gut: The “Known Unknown” of the Microbiome
Shkoporov, A. N., & Hill, C. (2019) · Cell Host & Microbe · doi:10.1016/j.chom.2019.01.017 · Cited by 767
The Human Gut Virome Is Highly Diverse, Stable, and Individual Specific
Shkoporov, A. N., Clooney, A. G., Sutton, T. D. S., Ryan, F. J., Daly, K. M., Nolan, J. A., McDonnell, S. A., Khokhlova, E. V., Draper, L. A., Forde, A., et al. (2019) · Cell Host & Microbe · doi:10.1016/j.chom.2019.09.009 · Cited by 737
Minimum Information about an Uncultivated Virus Genome (MIUViG)
Roux, S., Adriaenssens, E. M., Dutilh, B. E., Koonin, E. V., Kropinski, A. M., Krupovic, M., Kuhn, J. H., Lavigne, R., Brister, J. R., Varsani, A., et al. (2019) · Nature Biotechnology · doi:10.1038/nbt.4306 · Cited by 732
Self-citation
Metadata
- Authors
- Roux, S., Emerson, J. B., Eloe-Fadrosh, E. A., & Sullivan, M. B.
- Venue
- PeerJ
- Publisher
- PeerJ
- Published
- 2017-09-21
- Volume
- 5
- Pages
- e3817
- ISSN
- 2167-8359 (ISSN-L)
- OpenAlex
- W2732496903
- Cited by
- 319
- References
- 69
- FWCI
- 17.43
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.