Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 194

The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.

CAMISIM: simulating metagenomes and microbial communities

Open access
Fritz, Adrian, Hofmann, Peter, Majda, Stephan, Dahms, Eik, Dröge, Johannes, Fiedler, Jessika, Lesker, Till R., Belmann, Peter, DeMaere, Matthew Z., Darling, Aaron E., Sczyrba, Alexander, Bremges, Andreas, McHardy, Alice C. · 2019 · Microbiome

Published version of a preprint

Abstract

BACKGROUND: Shotgun metagenome data sets of microbial communities are highly diverse, not only due to the natural variation of the underlying biological systems, but also due to differences in laboratory protocols, replicate numbers, and sequencing technologies. Accordingly, to effectively assess the performance of metagenomic analysis software, a wide range of benchmark data sets are required. RESULTS: We describe the CAMISIM microbial community and metagenome simulator. The software can model different microbial abundance profiles, multi-sample time series, and differential abundance studies, includes real and simulated strain-level diversity, and generates second- and third-generation sequencing data from taxonomic profiles or de novo. Gold standards are created for sequence assembly, genome binning, taxonomic binning, and taxonomic profiling. CAMSIM generated the benchmark data sets of the first CAMI challenge. For two simulated multi-sample data sets of the human and mouse gut microbiomes, we observed high functional congruence to the real data. As further applications, we investigated the effect of varying evolutionary genome divergence, sequencing depth, and read error profiles on two popular metagenome assemblers, MEGAHIT, and metaSPAdes, on several thousand small data sets generated with CAMISIM. CONCLUSIONS: CAMISIM can simulate a wide variety of microbial communities and metagenome data sets together with standards of truth for method evaluation. All data sets and the software are freely available at https://github.com/CAMI-challenge/CAMISIM.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/s40168-019-0633-6

Cites

7 of 7 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 7 references

Research works printed but not linked: 56

  1. Turnbaugh PJ, Ley RE, Hamady M, Fraser-Liggett C, Knight R, Gordon JI. The human microbiome project: exploring the microbial part of ourselves in a changing world. Nature. 2007; 449(7164):804–10. https://doi.org/10.1038/nature06244 . · DOI · Paper page
  2. Warnecke F, Luginbühl P, Ivanova N, Ghassemian M, Richardson TH, et al.Metagenomic and functional analysis of hindgut microbiota of a wood-feeding higher termite. Nature. 2007; 450(7169):560–5. https://doi.org/10.1038/nature06269 . · DOI · Paper page
  3. Hess M, Sczyrba A, Egan R, Kim TW, Chokhawala H, et al. Metagenomic discovery of biomass-degrading genes and genomes from cow rumen. Science. 2011; 331(6016):463–7. https://doi.org/10.1126/science.1200387 . · DOI · Paper page
  4. Bremges A, Maus I, Belmann P, Eikmeyer F, Winkler A, et al.Deeply sequenced metagenome and metatranscriptome of a biogas-producing microbial community from an agricultural production-scale biogas plant. GigaScience. 2015; 4:33. https://doi.org/10.1186/s13742-015-0073-6 . · DOI
  5. Sunagawa S, Coelho LP, Chaffron S, Kultima JR, Labadie K, et al. Ocean plankton. Structure and function of the global ocean microbiome. Science. 2015; 348(6237):1261359. https://doi.org/10.1126/science.1261359 . · DOI · Paper page
  6. Xiao L, Feng Q, Liang S, Sonne SB, Xia Z, et al. A catalog of the mouse gut metagenome. Nat Biotechnol. 2015; 33(10):1103–8. https://doi.org/10.1038/nbt.3353 . · DOI · Paper page
  7. Kunath BJ, Bremges A, Weimann A, McHardy AC, Pope PB. Metagenomics and CAZyme Discovery. Methods Mol Biol. 2017; 1588:255–77. https://doi.org/10.1007/978-1-4939-6899-2_20 . · doi:10.1007/978-1-4939-6899-2_20
  8. Huttenhower C, Gevers D, Knight R, Abubucker S, Badger JH, et al. Structure, function and diversity of the healthy human microbiome. Nature. 2012; 486(7402):207–14. https://doi.org/10.1038/nature11234 . · DOI · Paper page
  9. Scholz M, Ward DV, Pasolli E, Tolio T, Zolfo M, et al. Strain-level microbial epidemiology and population genomics from shotgun metagenomics. Nat Methods. 2016; 13(5):435–8. https://doi.org/10.1038/nmeth.3802 . · DOI · Paper page
  10. Quince C, Delmont TO, Raguideau S, Alneberg J, Darling AE, et al. DESMAN: a new tool for de novo extraction of strains from metagenomes. Genome Biol. 2017; 18(1):181. https://doi.org/10.1186/s13059-017-1309-9 . · DOI · Paper page
  11. Thompson LR, Sanders JG, McDonald D, Amir A, Ladau J, et al. A communal catalogue reveals earth’s multiscale microbial diversity. Nature. 2017. https://doi.org/10.1038/nature24621 . · DOI · Paper page
  12. Sczyrba A, Hofmann P, Belmann P, Koslicki D, Janssen S, et al. Critical assessment of metagenome interpretation-a benchmark of metagenomics software. Nat Methods. 2017; 14(11):1063–71. https://doi.org/10.1038/nmeth.4458 . · DOI · Paper page
  13. Belmann P, Dröge J, Bremges A, McHardy AC, Sczyrba A, Barton MD. Bioboxes: standardised containers for interchangeable bioinformatics software. GigaScience. 2015; 4:47. https://doi.org/10.1186/s13742-015-0087-0 . · DOI
  14. Roy U, Galvez EJC, Iljazovic A, Lesker TR, Blazejewski AJ, et al. Distinct microbial communities trigger colitis development upon intestinal barrier damage via innate or adaptive immune cells. Cell Rep. 2017; 21(4):994–1008. https://doi.org/10.1016/j.celrep.2017.09.097 . · DOI
  15. Li D, Liu CM, Luo R, Sadakane K, Lam TW. MEGAHIT: an ultra-fast single-node solution for large and complex metagenomics assembly via succinct de Bruijn graph. Bioinformatics. 2015; 31(10):1674–6. https://doi.org/10.1093/bioinformatics/btv033 . · DOI · Paper page
  16. Nurk S, Meleshko D, Korobeynikov A, Pevzner PA. metaSPAdes: a new versatile metagenomic assembler. Genome Res. 2017;:213959–116. https://doi.org/10.1101/gr.213959.116 . · DOI · Paper page
  17. McDonald D, Clemente JC, Kuczynski J, Rideout JR, Stombaugh J, et al. The Biological Observation Matrix (BIOM) format or: how I learned to stop worrying and love the ome-ome. GigaScience. 2012; 1:7. https://doi.org/10.1186/2047-217X-1-7 . · DOI · Paper page
  18. Pruitt KD, Tatusova T, Maglott DR. NCBI reference sequences (RefSeq): a curated non-redundant sequence database of genomes, transcripts and proteins. Nucleic Acids Res. 2007; 35(Database issue):61–5. https://doi.org/10.1093/nar/gkl842 . · DOI · Paper page
  19. Albertsen M, Hugenholtz P, Skarshewski A, Nielsen KL, Tyson GW, Nielsen PH. Genome sequences of rare, uncultured bacteria obtained by differential coverage binning of multiple metagenomes. Nat Biotechnol. 2013; 31(6):533–8. https://doi.org/10.1038/nbt.2579 . · DOI · Paper page
  20. Bendall ML, Stevens SL, Chan LK, Malfatti S, Schwientek P, et al. Genome-wide selective sweeps and gene-specific sweeps in natural bacterial populations. The ISME J. 2016; 10(7):1589–601. https://doi.org/10.1038/ismej.2015.241 . · DOI · Paper page
  21. Stolze Y, Bremges A, Rumming M, Henke C, Maus I, et al. Identification and genome reconstruction of abundant distinct taxa in microbiomes from one thermophilic and three mesophilic production-scale biogas plants. Biotechnol Biofuels. 2016; 9:156. https://doi.org/10.1186/s13068-016-0565-3 . · DOI
  22. Roux S, Chan LK, Egan R, Malmstrom RR, McMahon KD, Sullivan MB. Ecogenomics of virophages and their giant virus hosts assessed through time series metagenomics. Nat Commun. 2017;8(1). https://doi.org/10.1038/s41467-017-01086-2 . · DOI
  23. Alneberg J, Bjarnason BS, de Bruijn I, Schirmer M, Quick J, et al.Binning metagenomic contigs by coverage and composition. Nat Methods. 2014; 11(11):1144–6. https://doi.org/10.1038/nmeth.3103 . · DOI · Paper page
  24. Kang DD, Froula J, Egan R, Wang Z. MetaBAT, an efficient tool for accurately reconstructing single genomes from complex microbial communities. PeerJ. 2015; 3:1165. https://doi.org/10.7717/peerj.1165 . · doi:10.7717/peerj.1165
  25. Curtis TP, Sloan WT, Scannell JW. Estimating prokaryotic diversity and its limits. Proc Natl Acad Sci. 2002; 99(16):10494–9. https://doi.org/10.1073/pnas.142680199 . · DOI · Paper page
  26. Ofiţeru ID, Lunn M, Curtis TP, Wells GF, Criddle CS, et al.Combined niche and neutral effects in a microbial wastewater treatment community. Proc Natl Acad Sci. 2010; 107(35):15345–50. https://doi.org/10.1073/pnas.1000604107 . · DOI · Paper page
  27. Ulrich W, Ollik M, Ugland KI. A meta-analysis of species–abundance distributions. Oikos. 2010; 119(7):1149–55. https://doi.org/10.1111/j.1600-0706.2009.18236.x . · DOI · Paper page
  28. Unterseher M, Jumpponen A, Opik M, Tedersoo L, Moora M, et al. Species abundance distributions and richness estimations in fungal metagenomics–lessons learned from community ecology. Mol Ecol. 2011; 20(2):275–85. https://doi.org/10.1111/j.1365-294X.2010.04948.x . · DOI · Paper page
  29. Nielsen HB, Almeida M, Juncker AS, Rasmussen S, Li J, et al. Identification and assembly of genomes and genetic elements in complex metagenomic samples without using reference genomes. Nat Biotechnol. 2014; 32(8):822–8. https://doi.org/10.1038/nbt.2939 . · DOI · Paper page
  30. Imelfort M, Parks D, Woodcroft BJ, Dennis P, Hugenholtz P, Tyson GW. GroopM: an automated tool for the recovery of population genomes from related metagenomes. PeerJ. 2014; 2:603. https://doi.org/10.7717/peerj.603 . · DOI · Paper page
  31. Huang W, Li L, Myers JR, Marth GT. ART: a next-generation sequencing read simulator. Bioinformatics. 2012; 28(4):593–4. https://doi.org/10.1093/bioinformatics/btr708 . · DOI · Paper page
  32. Singer E, Andreopoulos B, Bowers RM, Lee J, Deshpande S, et al.Next generation sequencing data of a defined microbial mock community. Sci Data. 2016; 3:160081. https://doi.org/10.1038/sdata.2016.81 . · DOI
  33. Bremges A, Singer E, Woyke T, Sczyrba A. MeCorS: Metagenome-enabled error correction of single cell sequencing reads. Bioinformatics. 2016; 32(14):2199–201. https://doi.org/10.1093/bioinformatics/btw144 . · DOI
  34. Singer E, Bushnell B, Coleman-Derr D, Bowman B, Bowers RM, et al.High-resolution phylogenetic microbial community profiling. ISME J. 2016; 10(8):2020–032. https://doi.org/10.1038/ismej.2015.249 . · DOI · Paper page
  35. Li H, Handsaker B, Wysoker A, Fennell T, Ruan J, et al.The Sequence Alignment/Map format and SAMtools. Bioinformatics. 2009; 25(16):2078–9. https://doi.org/10.1093/bioinformatics/btp352 . · DOI · Paper page
  36. Ono Y, Asai K, Hamada M. PBSIM: PacBio reads simulator–toward accurate genome assembly. Bioinformatics. 2013; 29(1):119–21. https://doi.org/10.1093/bioinformatics/bts649 . · DOI · Paper page
  37. Yang C, Chu J, Warren RL, Birol I. NanoSim: nanopore sequence read simulator based on statistical characterization. GigaScience. 2017. https://doi.org/10.1093/gigascience/gix010 . · DOI · Paper page
  38. Jia B, Xuan L, Cai K, Hu Z, Ma L, Wei C. NeSSM: a next-generation sequencing simulator for metagenomics. PLoS ONE. 2013; 8(10):75448. https://doi.org/10.1371/journal.pone.0075448 . · DOI
  39. Johnson S, Trost B, Long JR, Pittet V, Kusalik A. A better sequence-read simulator program for metagenomics. BMC Bioinformatics. 2014; 15(Suppl 9):14. https://doi.org/10.1186/1471-2105-15-s9-s14 . · DOI
  40. Shcherbina A. FASTQSim: platform-independent data characterization and in silico read generation for NGS datasets. BMC Res Notes. 2014; 7(1):533. https://doi.org/10.1186/1756-0500-7-533 . · DOI
  41. Angly FE, Willner D, Rohwer F, Hugenholtz P, Tyson GW. Grinder: a versatile amplicon and shotgun sequence simulator. Nucleic Acids Res. 2012; 40(12):94–4. https://doi.org/10.1093/nar/gks251 . · DOI · Paper page
  42. Rinke C, Schwientek P, Sczyrba A, Ivanova NN, Anderson IJ, et al. Insights into the phylogeny and coding potential of microbial dark matter. Nature. 2013; 499(7459):431–7. https://doi.org/10.1038/nature12352 . · DOI · Paper page
  43. Laehnemann D, Borkhardt A, McHardy AC. Denoising DNA deep sequencing data-high-throughput sequencing errors and their correction. Brief Bioinformatics. 2016; 17(1):154–79. https://doi.org/10.1093/bib/bbv029 . · DOI · Paper page
  44. Letunic I, Bork P. Interactive Tree Of Life (iTOL): an online tool for phylogenetic tree display and annotation. Bioinformatics. 2007; 23(1):127–8. https://doi.org/10.1093/bioinformatics/btl529 . · DOI · Paper page
  45. Buchfink B, Xie C, Huson DH. Fast and sensitive protein alignment using DIAMOND. Nat Methods. 2014; 12(1):59–60. https://doi.org/10.1038/nmeth.3176 . · DOI · Paper page
  46. Kruskal JB. Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis. Psychometrika. 1964; 29(1):1–27. https://doi.org/10.1007/bf02289565 . · DOI · Paper page
  47. Awad S, Irber L, Brown CT. Evaluating metagenome assembly on a simple defined community with many strain variants. bioRxiv. 2017. https://doi.org/10.1101/155358 . · DOI
  48. Konstantinidis KT, Tiedje JM. Genomic insights that advance the species definition for prokaryotes. Proc Natl Acad Sci USA. 2005. https://doi.org/10.1073/pnas.0409727102 . · DOI · Paper page
  49. Varghese NJ, Mukherjee S, Ivanova N, Konstantinidis KT, Mavrommatis K, et al. Microbial species delineation using whole genome sequences. Nucleic Acids Res. 2015. https://doi.org/10.1093/nar/gkv657 . · DOI · Paper page
  50. Peng Y, Leung HCM, Yiu SM, Chin FYL. IDBA-UD: a de novo assembler for single-cell and metagenomic sequencing data with highly uneven depth. Bioinformatics. 2012; 28(11):1420–8. https://doi.org/10.1093/bioinformatics/bts174 . · DOI · Paper page
  51. DeMaere MZ, Darling AE. Deconvoluting simulated metagenomes: the performance of hard- and soft- clustering algorithms applied to metagenomic chromosome conformation capture (3c). PeerJ. 2016; 4:2676. https://doi.org/10.7717/peerj.2676 . · DOI
  52. Cleary B, Brito IL, Huang K, Gevers D, Shea T, et al. Detection of low-abundance bacterial strains in metagenomic datasets by eigengenome partitioning. Nat Biotechnol. 2015; 33(10):1053–60. https://doi.org/10.1038/nbt.3329 . · DOI
  53. Bremges A, McHardy AC. Critical Assessment of Metagenome Interpretation Enters the Second Round. mSystems. 2018;3(4). https://doi.org/10.1128/mSystems.00103-18 . · doi:10.1128/msystems.00103-18
  54. Wick RR, Schultz MB, Zobel J, Holt KE. Bandage: interactive visualization ofde novogenome assemblies. Bioinformatics. 2015; 31(20):3350–2. https://doi.org/10.1093/bioinformatics/btv383 . · DOI · Paper page
  55. Richter DC, Ott F, Auch AF, Schmid R, Huson DH. MetaSim —a sequencing simulator for genomics and metagenomics. PLoS ONE. 2008; 3(10):3373. https://doi.org/10.1371/journal.pone.0003373 . · DOI · Paper page
  56. Mende DR, Waller AS, Sunagawa S, Järvelin AI, Chan MM, et al. Assessment of metagenomic assembly using simulated next generation sequencing data. PLoS ONE. 2012; 7(2):31386. https://doi.org/10.1371/journal.pone.0031386 . · DOI · Paper page

Cited by

See all 194

Metadata

Authors
Fritz, A., Hofmann, P., Majda, S., Dahms, E., Dröge, J., Fiedler, J., Lesker, T. R., Belmann, P., DeMaere, M. Z., Darling, A. E., Sczyrba, A., Bremges, A., & McHardy, A. C.
Venue
Microbiome
Published
2019-02-08
Volume
7
Issue
1
Pages
17-17
ISSN
2049-2618 (ISSN-L)
OpenAlex
W2952204926
Cited by
194
References
7
FWCI
6.59
Type
journal article
Language
en
Open access
gold
Licence
creativecommons.org/licenses/by/4.0/ (tdm)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: CAMISIM: simulating metagenomes and microbial communities. https://app.cochat.ai/papers/10.1186/s40168-019-0633-6
The paper
Fritz, A., Hofmann, P., Majda, S., Dahms, E., Dröge, J., Fiedler, J., Lesker, T. R., Belmann, P., DeMaere, M. Z., Darling, A. E., Sczyrba, A., Bremges, A., & McHardy, A. C. (2019). CAMISIM: simulating metagenomes and microbial communities. Microbiome. https://doi.org/10.1186/s40168-019-0633-6

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.