Assemblathon 2: evaluating de novo methods of genome assembly in three vertebrate species
Open accessThe DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Abstract
Background: The process of generating raw genome sequence data continues to become cheaper, faster, and more accurate. However, assembly of such data into high-quality, finished genome sequences remains challenging. Many genome assembly tools are available, but they differ greatly in terms of their performance (speed, scalability, hardware requirements, acceptance of newer read technologies) and in their final output (composition of assembled sequence). More importantly, it remains largely unclear how to best assess the quality of assembled genome sequences. The Assemblathon competitions are intended to assess current state-of-the-art methods in genome assembly. Results: In Assemblathon 2, we provided a variety of sequence data to be assembled for three vertebrate species (a bird, a fish, and snake). This resulted in a total of 43 submitted assemblies from 21 participating teams. We evaluated these assemblies using a combination of optical map data, Fosmid sequences, and several statistical methods. From over 100 different metrics, we chose ten key measures by which to assess the overall quality of the assemblies. Conclusions: Many current genome assemblers produced useful assemblies, containing a significant representation of their genes and overall genome structure. However, the high degree of variability between the entries suggests that there is still much room for improvement in the field of genome assembly and that approaches which work well in assembling the genome of one species may not necessarily work well for another.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Basic local alignment search tool
Altschul, S. F., Gish, W., Miller, W., Myers, E. W., & Lipman, D. J. (1990) · Journal of Molecular Biology · doi:10.1006/jmbi.1990.9999 · Cited by 98,669
The Sequence Alignment/Map format and SAMtools
Li, H., Handsaker, B., Wysoker, A., Fennell, T., Ruan, J., Homer, N., Marth, G., Abecasis, G., Durbin, R., & 1000 Genome Project Data Processing Subgroup (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp352 · Cited by 62,041
Self-citationFast and accurate short read alignment with Burrows-Wheeler transform
Li, H., & Durbin, R. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp324 · Cited by 58,607
Self-citationInitial sequencing and analysis of the human genome
International Human Genome Sequencing Consortium, Whitehead Institute for Biomedical Research, C. F. G. R., Lander, E. S., Linton, L. M., Birren, B., Nusbaum, C., Zody, M. C., Baldwin, J., Devon, K., Dewar, K., et al. (2001) · Nature · doi:10.1038/35057062 · Cited by 24,216
Self-citationVelvet: Algorithms for de novo short read assembly using de Bruijn graphs
Zerbino, D. R., & Birney, E. (2008) · Genome Research · doi:10.1101/gr.074492.107 · Cited by 9,491
SOAPdenovo2: an empirically improved memory-efficient short-read de novo assembler
Luo, R., Liu, B., Xie, Y., Li, Z., Huang, W., Yuan, J., He, G., Chen, Y., Pan, Q., Liu, Y., et al. (2012) · Gigascience · doi:10.1186/2047-217x-1-18 · Cited by 5,307
Self-citationThe B73 Maize Genome: Complexity, Diversity, and Dynamics
Schnable, P. S., Ware, D., Fulton, R. S., Stein, J. C., Wei, F., Pasternak, S., Liang, C., Zhang, J., Fulton, L., Graves, T. A., et al. (2009) · Science · doi:10.1126/science.1178534 · Cited by 4,046
Self-citationABySS: A parallel assembler for short read sequence data
Simpson, J. T., Wong, K., Jackman, S. D., Schein, J. E., Jones, S. J. M., & Birol, İ. (2009) · Genome Research · doi:10.1101/gr.089532.108 · Cited by 3,608
Self-citationCEGMA: a pipeline to accurately annotate core genes in eukaryotic genomes
Parra, G., Bradnam, K., & Korf, I. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btm071 · Cited by 2,184
Self-citationEvolutionary and biomedical insights from the rhesus macaque genome.
Gibbs, R. A., Rogers, J., Katze, M. G., Bumgarner, R., Weinstock, G. M., Mardis, E. R., Remington, K. A., Strausberg, R. L., Venter, J. C., Wilson, R. K., et al. (2007) · Science · doi:10.1126/science.1139247 · Cited by 1,403 · cited 1×
“Combining multiple assemblies from different assembly pipelines in order to produce an improved assembly was an approach used in the assembly of the rhesus macaque genome [66].”
MethodSelf-citationAn Eulerian path approach to DNA fragment assembly
Pevzner, P. A., Tang, H., & Waterman, M. S. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.171285098 · Cited by 1,352
The Medicago genome provides insight into the evolution of rhizobial symbioses
Young, N. D., Debellé, F., Oldroyd, G. E. D., Geurts, R., Cannon, S. B., Udvardi, M. K., Benedito, V. A., Mayer, K. F. X., Gouzy, J., Schoof, H., et al. (2011) · Nature · doi:10.1038/nature10625 · Cited by 1,275
Self-citationThe sequence and de novo assembly of the giant panda genome
Li, R., Fan, W., Tian, G., Zhu, H., He, L., Cai, J., Huang, Q., Cai, Q., Li, B., Bai, Y., et al. (2010) · Nature · doi:10.1038/nature08696 · Cited by 1,180 · cited 1×
“The de Bruijn approach was also used by the SOAPdenovo assembler [9] in generating the first wholly de novo assembly of a large eukaryotic genome sequence (the giant panda, Ailuropoda melanoleuca [10]).”
MethodSelf-citationAssembly algorithms for next-generation sequencing data
Miller, J. R., Koren, S., & Sutton, G. (2010) · Genomics · doi:10.1016/j.ygeno.2010.03.001 · Cited by 1,154
Self-citationHybrid error correction and de novo assembly of single-molecule sequencing reads
Koren, S., Schatz, M. C., Walenz, B. P., Martin, J., Howard, J. T., Ganapathy, G., Wang, Z., Rasko, D. A., McCombie, W. R., Jarvis, E. D., et al. (2012) · Nature Biotechnology · doi:10.1038/nbt.2280 · Cited by 1,011
Self-citationImproved pairwise alignment of genomic dna
Harris, R. S. (2007) · Cited by 890
Flicek, P., Amode, M. R., Barrell, D., Beal, K., Brent, S., Carvalho-Silva, D., Clapham, P., Coates, G., Fairley, S., Fitzgerald, S., et al. (2012) · Nucleic Acids Research · doi:10.1093/nar/gkr991 · Cited by 823
Self-citationALLPATHS: De novo assembly of whole-genome shotgun microreads
Butler, J., MacCallum, I., Kleber, M., Shlyakhter, I. A., Belmonte, M. K., Lander, E. S., Nusbaum, C., & Jaffe, D. B. (2008) · Genome Research · doi:10.1101/gr.7337908 · Cited by 808
Self-citationBentley, D. R. (2006) · Current Opinion in Genetics & Development · doi:10.1016/j.gde.2006.10.009 · Cited by 803
Efficient de novo assembly of large genomes using compressed data structures
Simpson, J. T., & Durbin, R. (2012) · Genome Research · doi:10.1101/gr.126953.111 · Cited by 768
Self-citationLimitations of next-generation genome sequence assembly
Alkan, C., Sajjadian, S., & Eichler, E. E. (2011) · Nature Methods · doi:10.1038/nmeth.1527 · Cited by 733
GAGE: A critical evaluation of genome assemblies and assembly algorithms
Salzberg, S. L., Phillippy, A. M., Zimin, A., Puiu, D., Magoc, T., Koren, S., Treangen, T. J., Schatz, M. C., Delcher, A. L., Roberts, M., et al. (2012) · Genome Research · doi:10.1101/gr.131383.111 · Cited by 682
Self-citationA beginner’s guide to eukaryotic genome annotation
Yandell, M., & Ence, D. (2012) · Nature Reviews Genetics · doi:10.1038/nrg3174 · Cited by 588
Quake: quality-aware detection and correction of sequencing errors
Kelley, D. R., Schatz, M. C., & Salzberg, S. L. (2010) · Genome Biology · doi:10.1186/gb-2010-11-11-r116 · Cited by 582
Self-citationGenome 10K: A Proposal to Obtain Whole-Genome Sequence for 10 000 Vertebrate Species
Scientists, G. 1. C. O. (2009) · Journal of Heredity · doi:10.1093/jhered/esp086 · Cited by 547
Ray: Simultaneous Assembly of Reads from a Mix of High-Throughput Sequencing Technologies
Boisvert, S., Laviolette, F., & Corbeil, J. (2010) · Journal of Computational Biology · doi:10.1089/cmb.2009.0238 · Cited by 539
Self-citationA genome triplication associated with early diversification of the core eudicots
Jiao, Y., Leebens-Mack, J., Ayyampalayam, S., Bowers, J. E., McKain, M. R., McNeal, J., Rolf, M., Ruzicka, D. R., Wafula, E., Wickett, N. J., et al. (2012) · Genome Biology · doi:10.1186/gb-2012-13-1-r3 · Cited by 515
Self-citationAssemblathon 1: A competitive assessment of de novo short read assembly methods
Earl, D., Bradnam, K., St. John, J., Darling, A., Lin, D., Fass, J., Yu, H. O. K., Buffalo, V., Zerbino, D. R., Diekhans, M., et al. (2011) · Genome Research · doi:10.1101/gr.126599.111 · Cited by 507
Self-citationLineage-Specific Biology Revealed by a Finished Genome Assembly of the Mouse
Church, D. M., Goodstadt, L., Hillier, L. W., Zody, M. C., Goldstein, S., She, X., Bult, C. J., Agarwala, R., Cherry, J. L., DiCuccio, M., et al. (2009) · PLoS Biology · doi:10.1371/journal.pbio.1000112 · Cited by 503
Self-citationGenetic adaptation to high altitude in the Ethiopian highlands
Scheinfeldt, L. B., Soi, S., Thompson, S., Ranciaro, A., Woldemeskel, D., Beggs, W., Lambert, C., Jarvis, J. P., Abate, D., Belay, G., et al. (2012) · Genome Biology · doi:10.1186/gb-2012-13-1-r1 · Cited by 447
REAPR: a universal tool for genome assembly evaluation
Hunt, M., Kikuchi, T., Sanders, M., Newbold, C., Berriman, M., & Otto, T. D. (2013) · Genome Biology · doi:10.1186/gb-2013-14-5-r47 · Cited by 405
Self-citationExploring single-sample SNP and INDEL calling with whole-genome de novo assembly
Li, H. (2012) · Bioinformatics · doi:10.1093/bioinformatics/bts280 · Cited by 398
Assessing the gene space in draft genomes
Parra, G., Bradnam, K., Ning, Z., Keane, T., & Korf, I. (2009) · Nucleic Acids Research · doi:10.1093/nar/gkn916 · Cited by 395 · cited 3×
“The CEGMA tool [38,40], was used to assess the gene complement of each assembly.”
BackgroundMethodSelf-citationHaplotype-resolved genome sequencing of a Gujarati Indian individual
Kitzman, J. O., MacKenzie, A. P., Adey, A., Hiatt, J. B., Patwardhan, R. P., Sudmant, P. H., Ng, S. B., Alkan, C., Qiu, R., Eichler, E. E., et al. (2011) · Nature Biotechnology · doi:10.1038/nbt.1740 · Cited by 205
Self-citationDe novo assembly of short sequence reads
Paszkiewicz, K., & Studholme, D. J. (2010) · Briefings in Bioinformatics · doi:10.1093/bib/bbq020 · Cited by 204 · cited 1×
“For an overview of these different assembly approaches see [13-16].”
BackgroundDe novo genome assembly: what every biologist should know
Baker, M. (2012) · Nature Methods · doi:10.1038/nmeth.1935 · Cited by 201
Current challenges in de novo plant genome sequencing and assembly
Schatz, M. C., Witkowski, J., & McCombie, W. R. (2012) · Genome Biology · doi:10.1186/gb-2012-13-4-243 · Cited by 185
Self-citationHigh-resolution human genome structure by single-molecule analysis
Teague, B., Waterman, M. S., Goldstein, S., Potamousis, K., Zhou, S., Reslewic, S., Sarkar, D., Valouev, A., Churas, C., Kidd, J. M., et al. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0914638107 · Cited by 175
Self-citationWhy Assembling Plant Genome Sequences Is So Challenging
Claros, M. G., Bautista, R., Guerrero-Fernández, D., Benzerki, H., Seoane, P., & Fernández‐Pozo, N. (2012) · Biology · doi:10.3390/biology1020439 · Cited by 168
Recent advances in gene structure prediction
Brent, M. R., & Guigó, R. (2004) · Current Opinion in Structural Biology · doi:10.1016/j.sbi.2004.05.007 · Cited by 149
Comparing De Novo Genome Assembly: The Long and Short of It
Narzisi, G., & Mishra, B. (2011) · PLoS ONE · doi:10.1371/journal.pone.0019175 · Cited by 145
A Single Molecule Scaffold for the Maize Genome
Zhou, S., Wei, F., Nguyen, J., Bechner, M., Potamousis, K., Goldstein, S., Pape, L., Mehan, M. R., Churas, C., Pasternak, S., et al. (2009) · PLoS Genetics · doi:10.1371/journal.pgen.1000711 · Cited by 135
Self-citationNext-Generation Sequencing and Large Genome Assemblies
Henson, J., Tischler, G., & Ning, Z. (2012) · Pharmacogenomics · doi:10.2217/pgs.12.72 · Cited by 134
Self-citationValidation of rice genome sequence by optical mapping
Zhou, S., Bechner, M., Place, M., Churas, C. P., Pape, L. K., Leong, S. A., Runnheim, R., Forrest, D., Goldstein, S., Livny, M., et al. (2007) · BMC Genomics · doi:10.1186/1471-2164-8-278 · Cited by 120
Self-citationReevaluating Assembly Evaluations with Feature Response Curves: GAGE and Assemblathons
Vezzi, F., Narzisi, G., & Mishra, B. (2012) · PLoS ONE · doi:10.1371/journal.pone.0052210 · Cited by 103
Self-citationSmith, P. F., Konings, A. F., & Kornfield, I. (2003) · Molecular Ecology · doi:10.1046/j.1365-294x.2003.01905.x · Cited by 102
Detection and correction of false segmental duplications caused by genome mis-assembly
Kelley, D. R., & Salzberg, S. L. (2010) · Genome Biology · doi:10.1186/gb-2010-11-3-r28 · Cited by 86
Valouev, A., Li, L., Liu, Y., Schwartz, D. C., Yang, Y., Zhang, Y., & Waterman, M. S. (2006) · Journal of Computational Biology · doi:10.1089/cmb.2006.13.442 · Cited by 76
Self-citationExtreme microallopatric divergence in a cichlid species from Lake Malawi
Rico, C., & Turner, G. F. (2002) · Molecular Ecology · doi:10.1046/j.1365-294x.2002.01537.x · Cited by 72
An overview of the current status of eukaryote gene prediction strategies
Sleator, R. D. (2010) · Gene · doi:10.1016/j.gene.2010.04.008 · Cited by 68
Feature-by-Feature – Evaluating De Novo Sequence Assembly
Vezzi, F., Narzisi, G., & Mishra, B. (2012) · PLoS ONE · doi:10.1371/journal.pone.0031002 · Cited by 60
Self-citationQuigley, D. A., To, M. D., Kim, I. J., Lin, K., Albertson, D. G., Sjölund, J., Pérez‐Losada, J., & Balmain, A. (2011) · Genome biology · doi:10.1186/gb-2011-12-1-r5 · Cited by 49
Normalized N50 assembly metric using gap-restricted co-linear chaining
Mäkinen, V., Salmela, L., & Ylinen, J. (2012) · BMC Bioinformatics · doi:10.1186/1471-2105-13-255 · Cited by 35
Telescoper: de novo assembly of highly repetitive regions
Bresler, M., Sheehan, S., Chan, A. H., & Song, Y. S. (2012) · Bioinformatics · doi:10.1093/bioinformatics/bts399 · Cited by 30
Natural products research in South Africa: 1890–2010
Drewes, S. E. (2012) · South African Journal of Science · doi:10.4102/sajs.v108i5/6.765 · Cited by 29
GAM: Genomic Assemblies Merger: A Graph Based Method to Integrate Different Assemblies
Casagrande, A., Fabbro, C. D., Scalabrin, S., & Policriti, A. (2009) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm.2009.28 · Cited by 15
Self-citationScaffolding low quality genomes using orthologous protein sequences
Li, Y., & Copley, R. R. (2012) · Bioinformatics · doi:10.1093/bioinformatics/bts661 · Cited by 12
Self-citationAkey, J. M. (2011) · Genome biology · doi:10.1186/gb-2011-12-s1-i1 · Cited by 8
Next generation shotgun sequencing and the challenges of de novo genome assembly
Schlebusch, S. A., & Illing, N. (2012) · South African Journal of Science · doi:10.4102/sajs.v108i11/12.1256 · Cited by 7
Cited by
featureCounts: an efficient general purpose program for assigning sequence reads to genomic features
Liao, Y., Smyth, G. K., & Shi, W. (2014) · Bioinformatics · doi:10.1093/bioinformatics/btt656 · Cited by 27,219
Towards complete and error-free genome assemblies of all vertebrate species
Rhie, A., McCarthy, S. A., Fedrigo, O., Damas, J., Formenti, G., Koren, S., Uliano-Silva, M., Chow, W., Fungtammasan, A., Kim, J., et al. (2021) · Nature · doi:10.1038/s41586-021-03451-0 · Cited by 3,097
“-m INT minimum coverage [10] -M INT maximum coverage [400]”
BackgroundSelf-citationTowards complete and error-free genome assemblies of all vertebrate species
Rhie, A., McCarthy, S. A., Fedrigo, O., Damas, J., Formenti, G., Koren, S., Uliano-Silva, M., Chow, W., Fungtammasan, A., Gedman, G. L., et al. (2020) · doi:10.1101/2020.05.22.110833 · Cited by 3,097
Self-citationShotgun metagenomics, from sampling to analysis
Quince, C., Walker, A. W., Simpson, J. T., Loman, N. J., & Segata, N. (2017) · Nature Biotechnology · doi:10.1038/nbt.3935 · Cited by 2,202
Self-citationVersatile genome assembly evaluation with QUAST-LG
Mikheenko, A., Prjibelski, A., Saveliev, V., Antipov, D., & Gurevich, A. (2018) · Bioinformatics · doi:10.1093/bioinformatics/bty266 · Cited by 1,527
Metadata
- Authors
- Bradnam, K. R., Fass, J. N., Alexandrov, A., Baranay, P., Bechner, M., Birol, I., Boisvert, S., Chapman, J. A., Chapuis, G., Chikhi, R., Chitsaz, H., Chou, W.-C., Corbeil, J., Del Fabbro, C., Docking, T. R., Durbin, R., Earl, D., Emrich, S., Fedotov, P., Fonseca, N. A., Ganapathy, G., Gibbs, R. A., Gnerre, S., Godzaridis, É., Goldstein, S., Haimel, M., Hall, G., Haussler, D., Hiatt, J. B., Ho, I. Y., Howard, J., Hunt, M., Jackman, S. D., Jaffe, D. B., Jarvis, E. D., Jiang, H., Kazakov, S., Kersey, P. J., Kitzman, J. O., Knight, J. R., Koren, S., Lam, T.-W., Lavenier, D., Laviolette, F., Li, Y., Li, Z., Liu, B., Liu, Y., Luo, R., MacCallum, I., MacManes, M. D., Maillet, N., Melnikov, S., Naquin, D., Ning, Z., Otto, T. D., Paten, B., Paulo, O. S., Phillippy, A. M., Pina-Martins, F., Place, M., Przybylski, D., Qin, X., Qu, C., Ribeiro, F. J., Richards, S., Rokhsar, D. S., Ruby, J. G., Scalabrin, S., Schatz, M. C., Schwartz, D. C., Sergushichev, A., Sharpe, T., Shaw, T. I., Shendure, J., Shi, Y., Simpson, J. T., Song, H., Tsarev, F., Vezzi, F., Vicedomini, R., Vieira, B. M., Wang, J., Worley, K. C., Yin, S., Yiu, S.-M., Yuan, J., Zhang, G., Zhang, H., Zhou, S., & Korf, I. F.
- Venue
- Gigascience
- Publisher
- Oxford University Press (OUP)
- Published
- 2013-07-22
- Volume
- 2
- Issue
- 1
- Pages
- 10-10
- ISSN
- 2047-217X (ISSN-L)
- OpenAlex
- W2102532874
- Cited by
- 670
- References
- 59
- FWCI
- 33.22
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.