Comparing De Novo Genome Assembly: The Long and Short of It
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
Recent advances in DNA sequencing technology and their focal role in Genome Wide Association Studies (GWAS) have rekindled a growing interest in the whole-genome sequence assembly (WGSA) problem, thereby, inundating the field with a plethora of new formalizations, algorithms, heuristics and implementations. And yet, scant attention has been paid to comparative assessments of these assemblers' quality and accuracy. No commonly accepted and standardized method for comparison exists yet. Even worse, widely used metrics to compare the assembled sequences emphasize only size, poorly capturing the contig quality and accuracy. This paper addresses these concerns: it highlights common anomalies in assembly accuracy through a rigorous study of several assemblers, compared under both standard metrics (N50, coverage, contig sizes, etc.) as well as a more comprehensive metric (Feature-Response Curves, FRC) that is introduced here; FRC transparently captures the trade-offs between contigs' quality against their sizes. For this purpose, most of the publicly available major sequence assemblers--both for low-coverage long (Sanger) and high-coverage short (Illumina) reads technologies--are compared. These assemblers are applied to microbial (Escherichia coli, Brucella, Wolbachia, Staphylococcus, Helicobacter) and partial human genome sequences (Chr. Y), using sequence reads of various read-lengths, coverages, accuracies, and with and without mate-pairs. It is hoped that, based on these evaluations, computational biologists will identify innovative sequence assembly paradigms, bioinformaticists will determine promising approaches for developing "next-generation" assemblers, and biotechnologists will formulate more meaningful design desiderata for sequencing technology platforms. A new software tool for computing the FRC metric has been developed and is available through the AMOS open-source consortium.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
CAP3: A DNA Sequence Assembly Program
Huang, X., & Madan, A. (1999) · Genome Research · doi:10.1101/gr.9.9.868 · Cited by 5,261 · cited 2×
“Well known assemblers in this category include: TIGR [5], PHRAP [6], CAP3 [7], PCAP [8] and Phusion [9].”
BackgroundMethodVersatile and open software for comparing large genomes
Kurtz, S., Phillippy, A., Delcher, A. L., Smoot, M., Shumway, M., Antonescu, C., & Salzberg, S. L. (2004) · Genome Biology · doi:10.1186/gb-2004-5-2-r12 · Cited by 5,254 · cited 1×
“The dot plot alignments were generated using the MUMmer package [37] (http://mummer.”
MethodDe novo assembly of human genomes with massively parallel short read sequencing
Li, R., Zhu, H., Ruan, J., Qian, W., Fang, X., Shi, Z., Li, Y., Li, S., Shan, G., Kristiansen, K., et al. (2010) · Genome Research · doi:10.1101/gr.097261.109 · Cited by 2,926 · cited 5×
“For example ABySS and SOAPdenovo have the highest N50 values and low number of mis-assembled contigs, however such mis-assembled contigs are on average longer than those from other assemblers like SUTTA and Edena.”
MethodInfluentialAn Eulerian path approach to DNA fragment assembly
Pevzner, P. A., Tang, H., & Waterman, M. S. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.171285098 · Cited by 1,352
Wu, M., Sun, L. V., Vamathevan, J., Riegler, M., Deboy, R., Brownlie, J. C., McGraw, E. A., Martin, W., Esser, C., Ahmadinejad, N., et al. (2004) · PLoS Biology · doi:10.1371/journal.pbio.0020069 · Cited by 851 · cited 1×
“[30] and Staphylococcus epidermidis RP62A [31].”
Mullikin, J. C., & Ning, Z. (2003) · Genome Research · doi:10.1101/gr.731003 · Cited by 222
Cited by
Assemblathon 2: evaluating de novo methods of genome assembly in three vertebrate species
Bradnam, K. R., Fass, J. N., Alexandrov, A., Baranay, P., Bechner, M., Birol, I., Boisvert, S., Chapman, J. A., Chapuis, G., Chikhi, R., et al. (2013) · Gigascience · doi:10.1186/2047-217x-2-10 · Cited by 670
Assemblathon 1: A competitive assessment of de novo short read assembly methods
Earl, D., Bradnam, K., St. John, J., Darling, A., Lin, D., Fass, J., Yu, H. O. K., Buffalo, V., Zerbino, D. R., Diekhans, M., et al. (2011) · Genome Research · doi:10.1101/gr.126599.111 · Cited by 507
Nagarajan, N., & Pop, M. (2013) · Nature Reviews Genetics · doi:10.1038/nrg3367 · Cited by 474
A field guide to whole‐genome sequencing, assembly and annotation
Ekblom, R., & Wolf, J. B. W. (2014) · Evolutionary Applications · doi:10.1111/eva.12178 · Cited by 428
REAPR: a universal tool for genome assembly evaluation
Hunt, M., Kikuchi, T., Sanders, M., Newbold, C., Berriman, M., & Otto, T. D. (2013) · Genome Biology · doi:10.1186/gb-2013-14-5-r47 · Cited by 405
GapFiller: a de novo assembly approach to fill the gap within paired reads
Nadalin, F., Vezzi, F., & Policriti, A. (2012) · BMC Bioinformatics · doi:10.1186/1471-2105-13-s14-s8 · Cited by 352
Evaluation of de novo transcriptome assemblies from RNA-Seq data
Li, B., Fillmore, N., Bai, Y., Collins, M., Thomson, J. A., Stewart, R., & Dewey, C. N. (2014) · Genome Biology · doi:10.1186/s13059-014-0553-5 · Cited by 309
Effects of GC Bias in Next-Generation-Sequencing Data on De Novo Genome Assembly
Chen, Y.-C., Liu, T., Yu, C.-H., Chiang, T.-Y., & Hwang, C.-C. (2013) · PLoS ONE · doi:10.1371/journal.pone.0062856 · Cited by 285
“Atreadcoverage of50X, 100X,250X,500X,1000X,and 2000X,thenumberswere57,29,20,17,13,and11,respectively.”
BackgroundWhole-Genome Sequencing in Outbreak Analysis
Gilchrist, C. A., Turner, S. D., Riley, M. F., Petri, W. A., & Hewlett, E. L. (2015) · Clinical Microbiology Reviews · doi:10.1128/cmr.00075-13 · Cited by 288
Wesolowska-Andersen, A., Bahl, M. I., Carvalho, V., Kristiansen, K., Sicheritz-Pontén, T., Gupta, R., & Licht, T. R. (2014) · Microbiome · doi:10.1186/2049-2618-2-19 · Cited by 277
“In this context, it should be noted that the sequencing approach [28], the sequencing technology [29,30] and the choice of bioinformatics tools [31] also affect the outcome of metagenomic studies, although these issues were beyond the scope of the present study.”
BackgroundCISA: Contig Integrator for Sequence Assembly of Bacterial Genomes
Lin, S.-H., & Liao, Y.-C. (2013) · PLoS ONE · doi:10.1371/journal.pone.0060843 · Cited by 261
MetAMOS: a modular and open source metagenomic assembly and analysis pipeline
Treangen, T. J., Koren, S., Sommer, D. D., Liu, B., Astrovskaya, I., Ondov, B., Darling, A. E., Phillippy, A. M., & Pop, M. (2013) · Genome Biology · doi:10.1186/gb-2013-14-1-r2 · Cited by 225
“The results are shown in Figure 4a, b (mock Even), and Figure 4c, d (mock Staggered) using the recently proposed Feature Response Curve technique [47].”
MethodCurrent Strategies of Polyploid Plant Genome Sequence Assembly
Kyriakidou, M., Tai, H. H., Anglin, N. L., Ellis, D., & Strömvik, M. V. (2018) · Frontiers in Plant Science · doi:10.3389/fpls.2018.01660 · Cited by 203
“Furthermore, the metrics used to make comparisons tend to only focus on size which does not capture contig quality nor accuracy, and thus, there are no commonly accepted standardized methods for validation of the assemblers, which means most genomes are accepted as “draft” assemblies (Narzisi and Mishra, 2011).”
MethodA post-assembly genome-improvement toolkit (PAGIT) to obtain annotated genomes from contigs
Swain, M. T., Tsai, I. J., Assefa, S. A., Newbold, C., Berriman, M., & Otto, T. D. (2012) · Nature Protocols · doi:10.1038/nprot.2012.068 · Cited by 182
Essential guidelines for computational method benchmarking
Weber, L. M., Saelens, W., Cannoodt, R., Soneson, C., Hapfelmeier, A., Gardner, P. P., Boulesteix, A.-L., Saeys, Y., & Robinson, M. D. (2019) · Genome Biology · doi:10.1186/s13059-019-1738-8 · Cited by 21
Metadata
- Authors
- Narzisi, G., & Mishra, B.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2011-04-29
- Volume
- 6
- Issue
- 4
- Pages
- e19175
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2033083661
- Cited by
- 145
- References
- 6
- FWCI
- 9.05
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.