Cited by 144Genomics and Phylogenetic StudiesAlgorithms and Data CompressionFractal and DNA sequence analysis

Technology dictates algorithms: recent developments in read alignment

Open access
Alser, Mohammed, Rotman, Jeremy, Deshpande, Dhrithi, Taraszka, Kodi, Shi, Huwenbo, Baykal, Pelin Icer, Yang, Harry Taegyun, Xue, Victor +9 more·2021·Genome Biology

Abstract

Aligning sequencing reads onto a reference is an essential step of the majority of genomic analysis pipelines. Computational algorithms for read alignment have evolved in accordance with technological advances, leading to today’s diverse array of alignment methods. We provide a systematic survey of algorithmic foundations and methodologies across 107 alignment methods, for both short and long reads. We provide a rigorous experimental evaluation of 11 read aligners to demonstrate the effect of these underlying algorithms on speed and efficiency of read alignment. We discuss how general alignment algorithms have been tailored to the specific needs of various domains in biology.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/s13059-021-02443-7

Cites

13 of 13 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Exact methods, including those based on dynamic programming, are often used for refining alignments or for aligning smaller regions of the genome.

    “Such methods, including those based on dynamic programming, are often used for refining alignments or for aligning smaller regions of the genome [60,61].”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 217

  1. [1]Weissenbach J Human Genome Project: Past, Present, Future The Human Genome 2002 1 9 11859560
  2. [2]Shendure J Ji H Next-generation DNA sequencing Nat Biotechnol 2008 26 1135 1145 10.1038/nbt1486 18846087 · DOI · Paper page
  3. [4]Payne A Holmes N Rakyan V Loose M BulkVis: a graphical viewer for Oxford nanopore bulk FAST5 files Bioinformatics 2019 35 2193 2198 10.1093/bioinformatics/bty841 30462145 PMC6596899 · DOI · Paper page
  4. [5]Goodwin S McPherson JD McCombie WR Coming of age: ten years of next-generation sequencing technologies Nat Rev Genet 2016 17 333 351 10.1038/nrg.2016.49 27184599 PMC10373632 · DOI · Paper page
  5. [6]Fox EJ, Reid-Bayliss KS, Emond MJ, Loeb LA. Accuracy of Next Generation Sequencing Platforms, Nextgeneration, sequencing & applications. 2014;1:106-14. PMC4331009 25699289
  6. [7]Watson M Warr A Errors in long-read assemblies can critically affect protein prediction Nat Biotechnol 2019 37 124 126 10.1038/s41587-018-0004-z 30670796 · DOI
  7. [8]Srivastava A, Malik L, Sarkar H, Zakeri M, Almodaresi F, Soneson C, Love MI, Kingsford C, Patro R.Alignment and mapping methodology influence transcript abundance estimation. Genome biology. 2020;21(1):1-29. PMC7487471 32894187
  8. [9]Saha A Battle A False positives in trans-eQTL and co-expression analyses arising from RNA-sequencing alignment errors F1000Res 2018 7 1860 10.12688/f1000research.17145.1 30613398 PMC6305209 · DOI
  9. [10]Schbath S Martin V Mapping Reads on a Genomic Sequence: An Algorithmic Overview and a Practical Comparative Analysis J Comput Biol 2012 19 6 796 813 10.1089/cmb.2012.0022 22506536 PMC3375638 · DOI
  10. [11]Fonseca NA Rung J Brazma A Marioni JC Tools for mapping high-throughput sequencing data Bioinformatics 2012 28 3169 3177 10.1093/bioinformatics/bts605 23060614 · DOI
  11. [13]Hatem A Bozdağ D Toland AE Çatalyürek ÜV Benchmarking short sequence mapping tools BMC Bioinform 2013 14 184 10.1186/1471-2105-14-184 PMC3694458 23758764 · DOI
  12. [14]Baruzzo G Simulation-based comprehensive benchmarking of RNA-seq aligners Nat Methods 2017 14 135 139 10.1038/nmeth.4106 27941783 PMC5792058 · DOI
  13. [15]Nagarajan N Pop M Sequence assembly demystified Nat Rev Genet 2013 14 157 167 10.1038/nrg3367 23358380 · DOI · Paper page
  14. [16]Jain M, Koren S, Miga KH, Quick J, Rand AC, Sasani TA, Tyson JR, Beggs AD, Dilthey AT, Fiddes IT, Malla S. Nanopore sequencing and assembly of a human genome with ultra-long reads. Nature biotechnology. 2018;36(4):338-45. PMC5889714 29431738
  15. [18]Wenger AM, Peluso P, Rowell WJ, Chang PC, Hall RJ, Concepcion GT, Ebler J, Fungtammasan A, Kolesnikov A, Olson ND, Töpfer A. Accurate circular consensus long-read sequencing improves variant detection and assembly of a human genome. Nature biotechnology. 2019;37(10):1155-62. PMC6776680 31406327
  16. [19]Wee Y, Bhyan SB, Liu Y, Lu J, Li X, Zhao M. The bioinformatics tools for the genome assembly and analysis based on third-generation sequencing. Briefings in functional genomics. 2019;18(1):1-12. 30462154
  17. [20]Canzar S Salzberg SL Short Read Mapping: An Algorithmic Tour Proc IEEE Inst Electr Electron Eng 2017 105 436 458 10.1109/JPROC.2015.2455551 28502990 PMC5425171 · DOI
  18. [21]Steinberg KM, Schneider VA, Alkan C, Montague MJ, Warren WC, Church DM, Wilson RK. Building and improving reference genome assemblies. Proceedings of the IEEE. 2017;105(3):422-35.
  19. [22]Baichoo S Ouzounis CA Computational complexity of algorithms for sequence comparison, short-read assembly and genome alignment Biosystems. 2017 156-157 72 85 10.1016/j.biosystems.2017.03.003 28392341 · DOI
  20. [23]Ekblom R Wolf JBW A field guide to whole-genome sequencing, assembly and annotation Evol Appl 2014 7 1026 1042 10.1111/eva.12178 25553065 PMC4231593 · DOI
  21. [24]Bradnam KR Assemblathon 2: evaluating de novo methods of genome assembly in three vertebrate species Gigascience 2013 2 10 10.1186/2047-217X-2-10 23870653 PMC3844414 · DOI
  22. [25]Zimin AV The first near-complete assembly of the hexaploid bread wheat genome, Triticum aestivum Gigascience 2017 6 1 7 29069494 PMC5691383
  23. [26]Flicek P Birney E Sense from sequence reads: methods for alignment and assembly Nat Methods 2009 6 S6 S12 10.1038/nmeth.1376 19844229 · DOI
  24. [27]Firtina C Alkan C On genomic repeats and reproducibility Bioinformatics 2016 32 2243 2247 10.1093/bioinformatics/btw139 27153582 · DOI
  25. [28]Weiss LA Association between microdeletion and microduplication at 16p11.2 and autism N Engl J Med 2008 358 667 675 10.1056/NEJMoa075974 18184952 · DOI · Paper page
  26. [29]Guo Y The effect of strand bias in Illumina short-read sequencing data BMC Genomics 2012 13 666 10.1186/1471-2164-13-666 23176052 PMC3532123 · DOI
  27. [30]Pearson WR Lipman DJ Improved tools for biological sequence comparison Proc Natl Acad Sci U S A 1988 85 2444 2448 10.1073/pnas.85.8.2444 3162770 PMC280013 · DOI · Paper page
  28. [31]Altschul SF Gish W Miller W Myers EW Lipman DJ Basic local alignment search tool J Mol Biol 1990 215 403 410 10.1016/S0022-2836(05)80360-2 2231712 · DOI · Paper page
  29. [32]Altschul SF Gapped BLAST and PSI-BLAST: a new generation of protein database search programs Nucleic Acids Res 1997 25 3389 3402 10.1093/nar/25.17.3389 9254694 PMC146917 · DOI · Paper page
  30. [33]Ning Z Cox AJ Mullikin JC SSAHA: a fast search method for large DNA databases Genome Res 2001 11 10 1725 1729 10.1101/gr.194201 11591649 PMC311141 · DOI · Paper page
  31. [34]Egidi L Manzini G Better spaced seeds using Quadratic Residues J Comput Syst Sci 2013 79 1144 1155 10.1016/j.jcss.2013.03.002 · DOI
  32. [35]Rizk G Lavenier D GASSST: global alignment short sequence search tool Bioinformatics 2010 26 2534 2540 10.1093/bioinformatics/btq485 20739310 PMC2951093 · DOI
  33. [36]Ma B Tromp J Li M PatternHunter: faster and more sensitive homology search Bioinformatics 2002 18 440 445 10.1093/bioinformatics/18.3.440 11934743 · DOI
  34. [37]Wu TD Nacu S Fast and SNP-tolerant detection of complex variants and splicing in short reads Bioinformatics 2010 26 873 881 10.1093/bioinformatics/btq057 20147302 PMC2844994 · DOI · Paper page
  35. [38]Kent WJ BLAT--the BLAST-like alignment tool Genome Res 2002 12 4 656 664 10.1101/gr.229202 11932250 PMC187518 · DOI · Paper page
  36. [39]Schwartz S Human-mouse alignments with BLASTZ Genome Res 2003 13 103 107 10.1101/gr.809403 12529312 PMC430961 · DOI
  37. [40]Slater GSC Birney E Automated generation of heuristics for biological sequence comparison BMC Bioinform 2005 6 31 10.1186/1471-2105-6-31 PMC553969 15713233 · DOI
  38. [41]Wu TD Watanabe CK GMAP: a genomic mapping and alignment program for mRNA and EST sequences Bioinformatics 2005 21 1859 1875 10.1093/bioinformatics/bti310 15728110 · DOI · Paper page
  39. [42]Lam TW Sung WK Tam SL Wong CK Yiu SM Compressed indexing and local alignment of DNA Bioinformatics 2008 24 791 797 10.1093/bioinformatics/btn032 18227115 · DOI
  40. [43]Li H Ruan J Durbin R Mapping short DNA sequencing reads and calling variants using mapping quality scores Genome Res 2008 18 11 1851 1858 10.1101/gr.078212.108 18714091 PMC2577856 · DOI · Paper page
  41. [44]Smith AD Xuan Z Zhang MQ Using quality scores and longer reads improves accuracy of Solexa read mapping BMC Bioinform 2008 9 128 10.1186/1471-2105-9-128 PMC2335322 18307793 · DOI
  42. [45]Li R Li Y Kristiansen K Wang J SOAP: short oligonucleotide alignment program Bioinformatics 2008 24 713 714 10.1093/bioinformatics/btn025 18227114 · DOI · Paper page
  43. [46]Ondov BD Varadarajan A Passalacqua KD Bergman NH Efficient mapping of Applied Biosystems SOLiD sequence data to a reference genome for functional genomic applications Bioinformatics 2008 24 2776 2777 10.1093/bioinformatics/btn512 18842598 PMC2639273 · DOI
  44. [47]Jiang H Wong WH SeqMap: mapping massive amount of oligonucleotides to the genome Bioinformatics 2008 24 2395 2396 10.1093/bioinformatics/btn429 18697769 PMC2562015 · DOI
  45. [48]Lin H Zhang Z Zhang MQ Ma B Li M ZOOM! Zillions of oligos mapped Bioinformatics 2008 24 21 2431 2437 10.1093/bioinformatics/btn416 18684737 PMC2732274 · DOI
  46. [49]De Bona F Ossowski S Schneeberger K Rätsch G Optimal spliced alignments of short sequence reads Bioinformatics 2008 24 i174 i180 10.1093/bioinformatics/btn300 18689821 · DOI
  47. [50]Jean G Kahles A Sreedharan VT De Bona F Rätsch G RNA-Seq read alignments with PALMapper Curr Protoc Bioinform 2010 Chapter 11 Unit 11.6 21154708
  48. [51]Harris EY Ponts N Le Roch KG Lonardi S BRAT-BW: efficient and accurate mapping of bisulfite-treated reads Bioinformatics 2012 28 1795 1796 10.1093/bioinformatics/bts264 22563065 PMC3381974 · DOI
  49. [52]Xi Y Li W BSMAP: whole genome bisulfite sequence MAPping program BMC Bioinform 2009 10 232 10.1186/1471-2105-10-232 PMC2724425 19635165 · DOI
  50. [53]Homer N Merriman B Nelson SF BFAST: an alignment tool for large scale genome resequencing PLoS One 2009 4 e7767 10.1371/journal.pone.0007767 19907642 PMC2770639 · DOI
  51. [54]Li H Durbin R Fast and accurate long-read alignment with Burrows–Wheeler transform Bioinformatics 2010 26 589 595 10.1093/bioinformatics/btp698 20080505 PMC2828108 · DOI · Paper page
  52. [55]Langmead B Trapnell C Pop M Salzberg SL Ultrafast and memory-efficient alignment of short DNA sequences to the human genome Genome Biol 2009 10 R25 10.1186/gb-2009-10-3-r25 19261174 PMC2690996 · DOI · Paper page
  53. [56]Schatz MC CloudBurst: highly sensitive read mapping with MapReduce Bioinformatics 2009 25 1363 1369 10.1093/bioinformatics/btp236 19357099 PMC2682523 · DOI
  54. [57]Clement NL The GNUMAP algorithm: unbiased probabilistic mapping of oligonucleotides from next-generation sequencing Bioinformatics 2010 26 38 45 10.1093/bioinformatics/btp614 19861355 PMC6276904 · DOI
  55. [58]Schneeberger K Simultaneous alignment of short reads against multiple genomes Genome Biol 2009 10 R98 10.1186/gb-2009-10-9-r98 19761611 PMC2768987 · DOI
  56. [59]Eaves HL Gao Y MOM: maximum oligonucleotide mapping Bioinformatics 2009 25 969 970 10.1093/bioinformatics/btp092 19228804 · DOI
  57. [60]Campagna D PASS: a program to align short sequences Bioinformatics 2009 25 967 968 10.1093/bioinformatics/btp087 19218350 · DOI
  58. [61]Chen Y Souaiaia T Chen T PerM: efficient mapping of short sequencing reads with periodic full sensitive spaced seeds Bioinformatics 2009 25 2514 2521 10.1093/bioinformatics/btp486 19675096 PMC2752623 · DOI
  59. [62]Weese D Emde A-K Rausch T Döring A Reinert K RazerS--fast read mapping with sensitivity control Genome Res 2009 19 1646 1654 10.1101/gr.088823.108 19592482 PMC2752123 · DOI
  60. [63]Rumble SM SHRiMP: accurate mapping of short color-space reads PLoS Comput Biol 2009 5 e1000386 10.1371/journal.pcbi.1000386 19461883 PMC2678294 · DOI
  61. [64]Li R SOAP2: an improved ultrafast tool for short read alignment Bioinformatics 2009 25 1966 1967 10.1093/bioinformatics/btp336 19497933 · DOI
  62. [65]Malhis N Butterfield YSN Ester M Jones SJM Slider—maximum use of probability information for alignment of short sequence reads and SNP detection Bioinformatics 2009 25 6 13 10.1093/bioinformatics/btn565 18974170 PMC2638935 · DOI
  63. [66]Hoffmann S Fast mapping of short sequences with mismatches, insertions and deletions using index structures PLoS Comput Biol 2009 5 e1000502 10.1371/journal.pcbi.1000502 19750212 PMC2730575 · DOI
  64. [67]Trapnell C Pachter L Salzberg SL TopHat: discovering splice junctions with RNA-Seq Bioinformatics 2009 25 1105 1111 10.1093/bioinformatics/btp120 19289445 PMC2672628 · DOI
  65. [68]Chen P-Y Cokus SJ Pellegrini M BS Seeker: precise mapping for bisulfite sequencing BMC Bioinform 2010 11 203 10.1186/1471-2105-11-203 PMC2871274 20416082 · DOI
  66. [70]Malhis N Jones SJM High quality SNP calling using Illumina data at shallow coverage Bioinformatics 2010 26 1029 1035 10.1093/bioinformatics/btq092 20190250 · DOI
  67. [72]Hach F mrsFAST: a cache-oblivious algorithm for short-read mapping Nat Methods 2010 7 576 577 10.1038/nmeth0810-576 20676076 PMC3115707 · DOI
  68. [73]Wang K MapSplice: accurate mapping of RNA-seq reads for splice junction discovery Nucleic Acids Res 2010 38 e178 10.1093/nar/gkq622 20802226 PMC2952873 · DOI · Paper page
  69. [74]Emde A-K Grunert M Weese D Reinert K Sperling SR MicroRazerS: rapid alignment of small RNA reads Bioinformatics 2010 26 123 124 10.1093/bioinformatics/btp601 19880369 · DOI
  70. [75]Au KF Jiang H Lin L Xing Y Wong WH Detection of splice junctions from paired-end RNA-seq data by SpliceMap Nucleic Acids Res 2010 38 4570 4578 10.1093/nar/gkq211 20371516 PMC2919714 · DOI
  71. [76]Bryant DW Jr Shen R Priest HD Wong W-K Mockler TC Supersplat--spliced RNA-seq alignment Bioinformatics 2010 26 1500 1505 10.1093/bioinformatics/btq206 20410051 PMC2881391 · DOI
  72. [77]Krueger F Andrews SR Bismark: a flexible aligner and methylation caller for Bisulfite-Seq applications Bioinformatics 2011 27 1571 1572 10.1093/bioinformatics/btr167 21493656 PMC3102221 · DOI
  73. [78]Kiełbasa SM Wan R Sato K Horton P Frith MC Adaptive seeds tame genomic sequence comparison Genome Res 2011 21 487 493 10.1101/gr.113985.110 21209072 PMC3044862 · DOI
  74. [80]David M Dzamba M Lister D Ilie L Brudno M SHRiMP2: sensitive yet practical SHort Read Mapping Bioinformatics 2011 27 1011 1012 10.1093/bioinformatics/btr046 21278192 · DOI · Paper page
  75. [82]Lunter G Goodson M Stampy: a statistical algorithm for sensitive and fast mapping of Illumina sequence reads Genome Res 2011 21 936 939 10.1101/gr.111120.110 20980556 PMC3106326 · DOI · Paper page
  76. [83]Wood DLA Xu Q Pearson JV Cloonan N Grimmond SM X-MATE: a flexible system for mapping short read data Bioinformatics 2011 27 580 581 10.1093/bioinformatics/btq698 21216778 PMC3035802 · DOI
  77. [84]Huang S SOAPsplice: Genome-Wide ab initio Detection of Splice Junctions from RNA-Seq Data Front Genet 2011 2 46 10.3389/fgene.2011.00046 22303342 PMC3268599 · DOI
  78. [85]Chaisson MJ Tesler G Mapping single molecule sequencing reads using basic local alignment with successive refinement (BLASR): application and theory BMC Bioinform 2012 13 238 10.1186/1471-2105-13-238 PMC3572422 22988817 · DOI
  79. [86]Tennakoon C Purbojati RW Sung W-K BatMis: a fast algorithm for k-mismatch mapping Bioinformatics 2012 28 2122 2128 10.1093/bioinformatics/bts339 22689389 · DOI
  80. [87]Langmead B Salzberg SL Fast gapped-read alignment with Bowtie 2 Nat Methods 2012 9 357 359 10.1038/nmeth.1923 22388286 PMC3322381 · DOI · Paper page
  81. [88]Marco-Sola S Sammeth M Guigó R Ribeca P The GEM mapper: fast, accurate and versatile alignment by filtration Nat Methods 2012 9 1185 1188 10.1038/nmeth.2221 23103880 · DOI
  82. [89]Weese D Holtgrewe M Reinert K RazerS 3: faster, fully sensitive read mapping Bioinformatics 2012 28 2592 2599 10.1093/bioinformatics/bts505 22923295 · DOI
  83. [90]Mu JC Fast and accurate read alignment for resequencing Bioinformatics 2012 28 2366 2373 10.1093/bioinformatics/bts450 22811546 PMC3436849 · DOI
  84. [91]Emde A-K Schulz MH Detecting genomic indel variants with exact breakpoints in single- and paired-end sequencing data using SplazerS Bioinformatics 2012 28 5 619 627 10.1093/bioinformatics/bts019 22238266 · DOI
  85. [93]Faust GG Hall IM YAHA: fast and flexible long-read alignment with optimal breakpoint detection Bioinformatics 2012 28 2417 2424 10.1093/bioinformatics/bts456 22829624 PMC3463118 · DOI
  86. [94]Hu J Ge H Newman M Liu K OSA: a fast and accurate alignment tool for RNA-Seq Bioinformatics 2012 28 14 1933 1934 10.1093/bioinformatics/bts294 22592379 · DOI
  87. [95]Zhang Y PASSion: a pattern growth algorithm-based pipeline for splice junction detection in paired-end RNA-Seq data Bioinformatics 2012 28 479 486 10.1093/bioinformatics/btr712 22219203 PMC3278765 · DOI
  88. [96]Guo W BS-Seeker2: a versatile aligning pipeline for bisulfite sequencing data BMC Genomics 2013 14 774 10.1186/1471-2164-14-774 24206606 PMC3840619 · DOI
  89. [97]Liao Y Smyth GK Shi W The Subread aligner: fast, accurate and scalable read mapping by seed-and-vote Nucleic Acids Res 2013 41 e108 10.1093/nar/gkt214 23558742 PMC3664803 · DOI · Paper page
  90. [99]Siragusa E Weese D Reinert K Fast and accurate read mapping with approximate seeds and multiple backtracking Nucleic Acids Res 2013 41 e78 10.1093/nar/gkt005 23358824 PMC3627565 · DOI
  91. [100]Sedlazeck FJ Rescheneder P von Haeseler A NextGenMap: fast and accurate read mapping in highly polymorphic genomes Bioinformatics 2013 29 2790 2791 10.1093/bioinformatics/btt468 23975764 · DOI
  92. [101]Gontarz PM Berger J Wong CF SRmapper: a fast and sensitive genome-hashing alignment tool Bioinformatics 2013 29 316 321 10.1093/bioinformatics/bts712 23267171 · DOI
  93. [103]Philippe N Salson M Commes T Rivals E CRAC: an integrated approach to the analysis of RNA-seq reads Genome Biol 2013 14 R30 10.1186/gb-2013-14-3-r30 23537109 PMC4053775 · DOI
  94. [104]Dobin A STAR: ultrafast universal RNA-seq aligner Bioinformatics 2013 29 15 21 10.1093/bioinformatics/bts635 23104886 PMC3530905 · DOI · Paper page
  95. [105]Kim D TopHat2: accurate alignment of transcriptomes in the presence of insertions, deletions and gene fusions Genome Biol 2013 14 R36 10.1186/gb-2013-14-4-r36 23618408 PMC4053844 · DOI · Paper page
  96. [106]Sahinalp SC, Vishkin U. Efficient approximate and dynamic matching of patterns using a labeling paradigm. In Proceedings of 37th IEEE Conference on Foundations of Computer Science. October 1996;320-328.
  97. [107]Kerpedjiev P Frellsen J Lindgreen S Krogh A Adaptable probabilistic mapping of short reads using position specific scoring matrices BMC Bioinform 2014 15 100 10.1186/1471-2105-15-100 PMC4021105 24717095 · DOI
  98. [108]Liu Y Popp B Schmidt B CUSHAW3: sensitive and accurate base-space and color-space short-read alignment with hybrid seeding PLoS One 2014 9 e86869 10.1371/journal.pone.0086869 24466273 PMC3899341 · DOI
  99. [109]Kim J Li C Xie X Improving read mapping using additional prefix grams BMC Bioinform 2014 15 1 42 10.1186/1471-2105-15-42 PMC3927682 24499321 · DOI
  100. [110]Lee W-P MOSAIK: a hash-based algorithm for accurate next-generation sequencing short-read mapping PLoS One 2014 9 e90581 10.1371/journal.pone.0090581 24599324 PMC3944147 · DOI
  101. [111]Tárraga J Acceleration of short and long DNA read mapping without loss of accuracy using suffix array Bioinformatics 2014 30 3396 3398 10.1093/bioinformatics/btu553 25143289 PMC4816028 · DOI
  102. [112]Hach F mrsFAST-Ultra: a compact, SNP-aware mapper for high performance sequencing applications Nucleic Acids Res 2014 42 W494 W500 10.1093/nar/gku370 24810850 PMC4086126 · DOI
  103. [113]Butterfield YS Kreitzman M JAGuaR: junction alignments to genome for RNA-seq reads PLoS One 2014 9 7 e102398 10.1371/journal.pone.0102398 25062255 PMC4111418 · DOI
  104. [114]Bonfert T Kirner E Csaba G Zimmer R Friedel CC ContextMap 2: fast and accurate context-based RNA-seq mapping BMC Bioinform 2015 16 122 10.1186/s12859-015-0557-5 PMC4411664 25928589 · DOI
  105. [115]Kim D Langmead B Salzberg SL HISAT: a fast spliced aligner with low memory requirements Nat Methods 2015 12 357 360 10.1038/nmeth.3317 25751142 PMC4655817 · DOI · Paper page
  106. [116]Prezza N Vezzi F Käller M Policriti A Fast, accurate, and lightweight analysis of BS-treated reads with ERNE 2 BMC Bioinform 2016 17 Suppl 4 69 10.1186/s12859-016-0910-3 PMC4896272 26961371 · DOI
  107. [117]Sović I Fast and sensitive mapping of nanopore sequencing reads with GraphMap Nat Commun 2016 7 11307 10.1038/ncomms11307 27079541 PMC4835549 · DOI
  108. [118]Amin MR Skiena S Schatz MC NanoBLASTer: Fast alignment and characterization of Oxford Nanopore single molecule sequencing reads 2016
  109. [119]Li H Minimap and miniasm: fast mapping and de novo assembly for noisy long sequences Bioinformatics 2016 32 2103 2110 10.1093/bioinformatics/btw152 27153593 PMC4937194 · DOI
  110. [120]Liu B Guan D Teng M Wang Y rHAT: fast alignment of noisy long reads with regional hashing Bioinformatics 2016 32 1625 1631 10.1093/bioinformatics/btv662 26568628 · DOI
  111. [121]Lin H-N Hsu W-L Kart: a divide-and-conquer algorithm for NGS read alignment Bioinformatics 2017 33 2281 2287 10.1093/bioinformatics/btx189 28379292 PMC5860120 · DOI
  112. [122]Liu B Gao Y Wang Y LAMSA: fast split read alignment with long approximate matches Bioinformatics 2017 33 192 201 10.1093/bioinformatics/btw594 27667793 · DOI
  113. [123]Lin H-N Hsu W-L DART: a fast and accurate RNA-seq mapper with a partitioning strategy Bioinformatics 2018 34 190 197 10.1093/bioinformatics/btx558 28968831 PMC5860201 · DOI
  114. [124]Li H Minimap2: pairwise alignment for nucleotide sequences Bioinformatics 2018 34 18 3094 3100 10.1093/bioinformatics/bty191 29750242 PMC6137996 · DOI · Paper page
  115. [125]Dadi TH DREAM-Yara: an exact read mapper for very large databases with short update time Bioinformatics 2018 34 i766 i772 10.1093/bioinformatics/bty567 30423080 · DOI
  116. [126]Marçais G MUMmer4: A fast and versatile genome alignment system PLoS Comput Biol 2018 14 e1005944 10.1371/journal.pcbi.1005944 29373581 PMC5802927 · DOI · Paper page
  117. [127]Sedlazeck FJ Accurate detection of complex structural variations using single-molecule sequencing Nat Methods 2018 15 461 468 10.1038/s41592-018-0001-7 29713083 PMC5990442 · DOI
  118. [128]Haghshenas E Sahinalp SC Hach F lordFAST: sensitive and Fast Alignment Search Tool for LOng noisy Read sequencing Data Bioinformatics 2019 35 20 27 10.1093/bioinformatics/bty544 30561550 PMC6298053 · DOI
  119. [129]Zhou Q Lim J-Q Sung W-K Li G An integrated package for bisulfite DNA methylation data analysis with Indel-sensitive mapping BMC Bioinform 2019 20 47 10.1186/s12859-018-2593-4 PMC6343306 30669962 · DOI
  120. [130]Marić J, Sović I, Križanović K, Nagarajan N, Šikić M. Graphmap2-splice-aware RNA-seq mapper for long reads. bioRxiv. 2019; p.720458.
  121. [131]Boratyn GM, Thierry-Mieg J, Thierry-Mieg D, Busby B, Madden TL, Boratyn GM, Thierry-Mieg J, Thierry-Mieg D, Busby B, Madden TL. Magic-BLAST, an accurate RNA-seq aligner for long and short reads. BMC bioinformatics. 2019;20(1):1-19. PMC6659269 31345161
  122. [133]Kim D Paggi JM Park C Bennett C Salzberg SL Graph-based genome alignment and genotyping with HISAT2 and HISAT-genotype Nat Biotechnol 2019 37 907 915 10.1038/s41587-019-0201-4 31375807 PMC7605509 · DOI · Paper page
  123. [134]Liu B, et al. deSALT: fast and accurate long transcriptomic read alignment with de Bruijn graph-based index. 10.1101/612176. PMC6913027 31842925 · DOI
  124. [135]Chakraborty A Bandyopadhyay S conLSH: Context based Locality Sensitive Hashing for mapping of noisy SMRT reads Comput Biol Chem 2020 85 107206 10.1016/j.compbiolchem.2020.107206 32000034 · DOI
  125. [137]Yorukoglu D Yu YW Peng J Berger B Compressive mapping for next-generation sequencing Nat Biotechnol 2016 34 374 376 10.1038/nbt.3511 27054987 PMC5080835 · DOI
  126. [138]Wilbur WJ Lipman DJ Rapid similarity searches of nucleic acid and protein data banks Proc Natl Acad Sci U S A 1983 80 726 730 10.1073/pnas.80.3.726 6572363 PMC393452 · DOI · Paper page
  127. [139]Burkhardt S, Kärkkäinen J. Better Filtering with Gapped q-Grams. Comb Pattern Matching. 2001:73–85. 10.1007/3-540-48194-x_6. · DOI
  128. [140]Ukkonen E Approximate string-matching over suffix trees Combinatorial Pattern Matching 1993 Berlin Heidelberg Springer 228 242
  129. [141]Ghodsi M Pop M Inexact Local Alignment Search over Suffix Arrays 2009 IEEE International Conference on Bioinformatics and Biomedicine 2009 83 87 PMC3029072 21278916
  130. [142]Cokus SJ Shotgun bisulphite sequencing of the Arabidopsis genome reveals DNA methylation patterning Nature 2008 452 215 219 10.1038/nature06745 18278030 PMC2377394 · DOI
  131. [143]Kurtz S Versatile and open software for comparing large genomes Genome Biol 2004 5 R12 10.1186/gb-2004-5-2-r12 14759262 PMC395750 · DOI · Paper page
  132. [144]Medina I Highly sensitive and ultrafast read mapping for RNA-seq analysis DNA Res 2016 23 93 100 10.1093/dnares/dsv039 26740642 PMC4833417 · DOI
  133. [145]Li H Durbin R Fast and accurate short read alignment with Burrows-Wheeler transform Bioinformatics 2009 25 1754 1760 10.1093/bioinformatics/btp324 19451168 PMC2705234 · DOI · Paper page
  134. [146]Grüning B Bioconda: sustainable and comprehensive software distribution for the life sciences Nat Methods 2018 15 475 476 10.1038/s41592-018-0046-7 29967506 PMC11070151 · DOI
  135. [147]Mohamadi H Vandervalk BP DIDA: Distributed Indexing Dispatched Alignment PLoS One 2015 10 4 e0126409 10.1371/journal.pone.0126409 25923767 PMC4414605 · DOI
  136. [148]Xin H Accelerating read mapping with FastHASH BMC Genomics 2013 14 Suppl 1 S13 10.1186/1471-2164-14-S1-S13 23369189 PMC3549798 · DOI
  137. [149]Xin H Nahar S Optimal seed solver: optimizing seed selection in read mapping Bioinformatics 2016 32 11 1632 1642 10.1093/bioinformatics/btv670 26568624 PMC6363230 · DOI
  138. [150]Zhang H Chan Y Fan K Schmidt B Liu W Fast and efficient short read mapping based on a succinct hash index BMC Bioinform 2018 19 92 10.1186/s12859-018-2094-5 PMC5845352 29523083 · DOI
  139. [151]Eddy SR What is dynamic programming? Nat Biotechnol 2004 22 909 10.1038/nbt0704-909 15229554 · DOI
  140. [152]Smith TF Waterman MS Identification of common molecular subsequences J Mol Biol 1981 147 195 197 10.1016/0022-2836(81)90087-5 7265238 · DOI
  141. [154]Hamming RW Error detecting and error correcting codes Bell Syst Tech J 1950 29 147 160 10.1002/j.1538-7305.1950.tb00463.x · DOI · Paper page
  142. [155]Karp RM Rabin MO Efficient randomized pattern-matching algorithms IBM J Res Dev 1987 31 249 260 10.1147/rd.312.0249 · DOI
  143. [158]Ukkonen E. Algorithms for approximate string matching. Information and control. 1985;64(1-3):100-18.
  144. [159]Cole R Hariharan R Approximate String Matching: A Simpler Faster Algorithm SIAM J Comput 2002 31 1761 1782 10.1137/S0097539700370527 · DOI
  145. [160]Alser M, Hassan H, Kumar A, Mutlu O, Alkan C. Shouji: a fast and efficient pre-alignment filter for sequencealignment. Bioinformatics. 2019;35(21):4255-63. PMC6821304 30923804
  146. [161]Alser M, Hassan H, Xin H, Ergin O, Mutlu O, Alkan C. GateKeeper: a new hardware architecture for accelerating pre-alignment in DNA short read mapping. Bioinformatics. 2017;33(21):3355-63. PMC5860160 28575161
  147. [163]Kim JS GRIM-Filter: Fast seed location filtering in DNA read mapping using processing-in-memory technologies BMC Genomics 2018 19 89 10.1186/s12864-018-4460-0 29764378 PMC5954284 · DOI
  148. [164]Alser M, Shahroodi T, Gómez-Luna J, Alkan C, Mutlu O. SneakySnake: a fast and accurate universal genome pre-alignment filter for CPUs, GPUs and FPGAs. Bioinformatics. 2020;36(22-23):5282-90. 33315064
  149. [165]Zhang J, et al. BGSA: A Bit-Parallel Global Sequence Alignment Toolkit for Multi-core and Many-core Architectures.Bioinformatics. 2018. 10.1093/bioinformatics/bty930. 30445566 · DOI
  150. [167]Cali DS GenASM: A High-Performance, Low-Power Approximate String Matching Acceleration Framework for Genome Sequence Analysis 2020 53rd Annual IEEE/ACM International Symposium on Microarchitecture (MICRO) 2020 951 966
  151. [168]Alser M Accelerating Genome Analysis: A Primer on an Ongoing Journey IEEE Micro 2020 40 65 75 10.1109/MM.2020.3013728 · DOI
  152. [169]Kloosterman WP Characteristics of de novo structural changes in the human genome Genome Res 2015 25 792 801 10.1101/gr.185041.114 25883321 PMC4448676 · DOI
  153. [170]Vollger MR Long-read sequence and assembly of segmental duplications Nat Methods 2019 16 88 94 10.1038/s41592-018-0236-3 30559433 PMC6382464 · DOI
  154. [171]Merker JD Wenger AM Long-read genome sequencing identifies causal structural variation in a Mendelian disease Genet Med 2018 20 1 159 163 10.1038/gim.2017.86 28640241 PMC5741540 · DOI
  155. [172]Goodwin S Oxford Nanopore sequencing, hybrid error correction, and de novo assembly of a eukaryotic genome Genome Res 2015 25 1750 1756 10.1101/gr.191395.115 26447147 PMC4617970 · DOI
  156. [173]Eccles D De novo assembly of the complex genome of Nippostrongylus brasiliensis using MinION long reads BMC Biol 2018 16 6 10.1186/s12915-017-0473-4 29325570 PMC5765664 · DOI
  157. [174]Quick J Real-time, portable genome sequencing for Ebola surveillance Nature 2016 530 228 232 10.1038/nature16996 26840485 PMC4817224 · DOI
  158. [175]Kolmogorov, M., Yuan, J., Lin, Y. and Pevzner, P.A., Assembly of long, error-prone reads using repeat graphs. Nature biotechnology. 2019;37(5):540-6. 30936562
  159. [176]Misra S Agrawal A Liao W-K Choudhary A Anatomy of a hash-based long read sequence mapping algorithm for next generation DNA sequencing Bioinformatics 2011 27 189 195 10.1093/bioinformatics/btq648 21088030 · DOI
  160. [177]Liu Y Schmidt B Long read alignment based on maximal exact match seeds Bioinformatics 2012 28 i318 i324 10.1093/bioinformatics/bts414 22962447 PMC3436841 · DOI
  161. [178]Firtina C, Bar-Joseph Z, Alkan C, Cicek AE. Hercules: a profile HMM-based hybrid error correction algorithm for long reads. Nucleic acids research. 2018;46(21):e125. PMC6265270 30124947
  162. [181]Liu Y, Yu Z, Dinger ME, Li J. Index suffix–prefix overlaps by (w, k)-minimizer to generate long contigs for reads compression. Bioinformatics. 2019;35(12);2066-74. 30407482
  163. [183]Jain C Dilthey A Koren S Aluru S Phillippy AM A Fast Approximate Algorithm for Mapping Long Reads to Large Reference Databases J Comput Biol 2018 25 766 779 10.1089/cmb.2018.0036 29708767 PMC6067103 · DOI
  164. [184]Gong L Picky comprehensively detects high-resolution structural variants in nanopore long reads Nat Methods 2018 15 455 460 10.1038/s41592-018-0002-6 29713081 PMC5990454 · DOI
  165. [185]Engström PG Systematic evaluation of spliced alignment programs for RNA-seq data Nat Methods 2013 10 1185 1191 10.1038/nmeth.2722 24185836 PMC4018468 · DOI · Paper page
  166. [186]Goldstein LD Prediction and Quantification of Splice Events from RNA-Seq Data PLoS One 2016 11 e0156132 10.1371/journal.pone.0156132 27218464 PMC4878813 · DOI
  167. [187]Veeneman BA Shukla S Dhanasekaran SM Chinnaiyan AM Nesvizhskii AI Two-pass alignment improves novel splice junction quantification Bioinformatics 2016 32 43 49 26519505 PMC5006238
  168. [188]Mangul S Transcriptome assembly and quantification from Ion Torrent RNA-Seq data BMC Genomics 2014 15 Suppl 5 S7 10.1186/1471-2164-15-S5-S7 25082147 PMC4120146 · DOI
  169. [189]Nicolae M Mangul S Măndoiu II Zelikovsky A Estimation of alternative splicing isoform frequencies from RNA-Seq data Algorithms Mol Biol 2011 6 9 10.1186/1748-7188-6-9 21504602 PMC3107792 · DOI · Paper page
  170. [191]Patro R Duggal G Love MI Irizarry RA Kingsford C Salmon provides fast and bias-aware quantification of transcript expression Nat Methods 2017 14 417 419 10.1038/nmeth.4197 28263959 PMC5600148 · DOI · Paper page
  171. [192]Zhang C Zhang B Lin L-L Zhao S Evaluation and comparison of computational tools for RNA-seq isoform quantification BMC Genomics 2017 18 583 10.1186/s12864-017-4002-1 28784092 PMC5547501 · DOI
  172. [193]Nawrocki EP S. R. E Infernal 1.1: 100-fold faster RNA homology searches Bioinformatics 2013 29 2933 10.1093/bioinformatics/btt509 24008419 PMC3810854 · DOI
  173. [194]Kuczynski J Using QIIME to analyze 16S rRNA gene sequences from Microbial Communities Curr Protoc Bioinform 2011 CHAPTER Unit10.7 PMC3249058 22161565
  174. [195]Schloss PD Introducing mothur: Open-Source, Platform-Independent, Community-Supported Software for Describing and Comparing Microbial Communities Appl Environ Microbiol 2009 75 7537 7541 10.1128/AEM.01541-09 19801464 PMC2786419 · DOI
  175. [196]Huson DH Auch AF Qi J Schuster SC MEGAN analysis of metagenomic data Genome Res 2007 17 377 386 10.1101/gr.5969107 17255551 PMC1800929 · DOI
  176. [197]DeSantis TZ Hugenholtz P NAST: a multiple sequence alignment server for comparative analysis of 16S rRNA genes Nucleic Acids Res 2006 34 Web Server W394 W399 10.1093/nar/gkl244 16845035 PMC1538769 · DOI
  177. [198]Caporaso JG, Bittinger K, Bushman FD, DeSantis TZ, Andersen GL, Knight R. PyNAST: a flexible tool for aligning sequences to a template alignment. Bioinformatics. 2010;26(2):266-7. Access date: February 2020. PMC2804299 19914921
  178. [199]Edgar RC MUSCLE: multiple sequence alignment with high accuracy and high throughput Nucleic Acids Res 2004 32 5 1792 1797 10.1093/nar/gkh340 15034147 PMC390337 · DOI · Paper page
  179. [200]Sczyrba A Critical Assessment of Metagenome Interpretation-a benchmark of metagenomics software Nat Methods 2017 14 1063 1071 10.1038/nmeth.4458 28967888 PMC5903868 · DOI
  180. [201]Ounit R Wanamaker S Close TJ Lonardi S CLARK: fast and accurate classification of metagenomic and genomic sequences using discriminative k -mers BMC Genomics 2015 16 1 236 10.1186/s12864-015-1419-2 25879410 PMC4428112 · DOI
  181. [202]Lee AY Lee CS Van Gelder RN Scalable metagenomics alignment research tool (SMART): a scalable, rapid, and complete search heuristic for the classification of metagenomic sequences from complex sequence populations BMC Bioinform 2016 17 292 10.1186/s12859-016-1159-6 PMC4963998 27465705 · DOI
  182. [204]Sharpton TJ An introduction to the analysis of shotgun metagenomic data Front Plant Sci 2014 5 209 10.3389/fpls.2014.00209 24982662 PMC4059276 · DOI
  183. [205]Steinegger M Söding J MMseqs2 enables sensitive protein sequence searching for the analysis of massive data sets Nat Biotechnol 2017 35 1026 1028 10.1038/nbt.3988 29035372 · DOI · Paper page
  184. [206]Zhao Y Tang H Ye Y RAPSearch2: a fast and memory-efficient protein similarity search tool for next-generation sequencing data Bioinformatics 2012 28 125 126 10.1093/bioinformatics/btr595 22039206 PMC3244761 · DOI
  185. [207]Buchfink B Xie C Huson DH Fast and sensitive protein alignment using DIAMOND Nat Methods 2014 12 59 10.1038/nmeth.3176 25402007 · DOI · Paper page
  186. [208]Sanjuan R Nebot MR Chirico N Mansky LM Belshaw R Viral Mutation Rates J Virol 2010 84 9733 9748 10.1128/JVI.00694-10 20660197 PMC2937809 · DOI
  187. [210]Beerenwinkel N Computational methods for the design of effective therapies against drug resistant HIV strains Bioinformatics 2005 21 3943 3950 10.1093/bioinformatics/bti654 16144807 · DOI
  188. [211]Skums P Bunimovich L Khudyakov Y Antigenic cooperation among intrahost HCV variants organized into a complex network of cross-immunoreactivity Proc Natl Acad Sci 2015 112 6653 6658 10.1073/pnas.1422942112 25941392 PMC4450434 · DOI
  189. [212]Knyazev S, Tsyvin V, Melnyk A, Artyomenko A, Malygina T, Porozov YB, Campbell E, Switzer WM, Skums P, Zelikovsky A. Cliquesnv: Scalable reconstruction of intra-host viral populations from ngs reads. BioRxiv. 2018:264242.
  190. [213]Zagordi O Bhattacharya A Eriksson N Beerenwinkel N ShoRAH: estimating the genetic diversity of a mixed sample from next-generation sequencing data BMC Bioinform 2011 12 119 10.1186/1471-2105-12-119 PMC3113935 21521499 · DOI
  191. [214]Yang X Charlebois P Macalalad A Henn MR Zody MC V-Phaser 2: variant inference for viral populations BMC Genomics 2013 14 1 674 10.1186/1471-2164-14-674 24088188 PMC3907024 · DOI
  192. [215]Huber M MinVar: A rapid and versatile tool for HIV-1 drug resistance genotyping by deep sequencing J Virol Methods 2017 240 7 13 10.1016/j.jviromet.2016.11.008 27867045 · DOI
  193. [216]Langmead B Aligning short sequencing reads with Bowtie Curr Protoc Bioinform 2010 Chapter 11 Unit 11.7 PMC3010897 21154709
  194. [217]Harris RA Comparison of sequencing-based methods to profile DNA methylation and identification of monoallelic epigenetic modifications Nat Biotechnol 2010 28 1097 1105 10.1038/nbt.1682 20852635 PMC2955169 · DOI
  195. [218]Singer BD A Practical Guide to the Measurement and Analysis of DNA Methylation Am J Respir Cell Mol Biol 2019 61 417 428 10.1165/rcmb.2019-0150TR 31264905 PMC6775954 · DOI
  196. [219]Sun X, Han Y, Zhou L, Chen E, Lu B, Liu Y, Pan X, Cowley Jr AW, Liang M, Wu Q, Lu Y. A comprehensive evaluation of alignment software for reduced representation bisulfite sequencing data. Bioinformatics. 2018;34(16):2715-23. 29579198
  197. [221]Bolotin DA MiXCR: software for comprehensive adaptive immunity profiling Nat Methods 2015 12 380 381 10.1038/nmeth.3364 25924071 · DOI
  198. [222]Kidd JM Mapping and sequencing of structural variation from eight human genomes Nature 2008 453 56 64 10.1038/nature06862 18451855 PMC2424287 · DOI · Paper page
  199. [223]Dennis MY Evolution of human-specific neural SRGAP2 genes by incomplete segmental duplication Cell 2012 149 912 922 10.1016/j.cell.2012.03.033 22559943 PMC3365555 · DOI · Paper page
  200. [225]Phillippy AM Schatz MC Pop M Genome assembly forensics: finding the elusive mis-assembly Genome Biol 2008 9 R55 10.1186/gb-2008-9-3-r55 18341692 PMC2397507 · DOI

200 of 217 shown

Cited by

Sorted by citations

Authors
Alser, M., Rotman, J., Deshpande, D., Taraszka, K., Shi, H., Baykal, P. I., Yang, H. T., Xue, V., Knyazev, S., Singer, B. D., Balliu, B., Koslicki, D., Skums, P., Zelikovsky, A., Alkan, C., Mutlu, O., & Mangul, S.
Affiliations
  • Bilkent University (TR)
  • University of California, Los Angeles (US)
  • University of Southern California (US)
  • Broad Institute (US)
  • Georgia State University (US)
  • Northwestern University (US)
  • Pennsylvania State University (US)
  • Sechenov University (RU)
Corresponding author
Mangul, Serghei
Venue
Genome Biology
Published
2021-08-26
Volume
22
Issue
1
Pages
249-249
ISSN
  • 1465-6906 (ISSN-L)
  • 1474-760X
OpenAlex
W3008701988
Cited by
144
References
13
Citations by year
2026: 24 · 2025: 25 · 2024: 37 · 2023: 29 · 2022: 20 · 2021: 5 · 2020: 3 · 2012: 1
FWCI
2.42
Type
journal article
Language
en
Open access
Locations
  • Genome biology (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • Bilkent University Institutional Repository (Bilkent University) (submittedVersion)
  • Repository for Publications and Research Data (ETH Zurich) (submittedVersion, cc-by)
  • arXiv (Cornell University)
  • ETH Zürich Research Collection (cc-by)
  • Figshare (cc-by)
Funders
  • National Heart, Lung, and Blood Institute (K08HL128867)
  • National Institutes of Health (1R01EB025022, R01HL149883, R01HL153122, HG006004)
  • National Science Foundation (2047828, 2041984)
  • Molecular Basis of Disease
  • Intel Corporation
  • VMware
Topics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
  • Physical Sciences › Computer Science › Artificial Intelligence › Algorithms and Data Compression
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Fractal and DNA sequence analysis
Keywords
read mapping, sequence alignment algorithms, short-read sequencing, long-read sequencing, reference genome mapping
MeSH terms
Algorithms, HIV, Humans, Sulfites, Genome, Human, Sequence Alignment, Computational Biology, Metagenomics

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review