The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Scaling read aligners to hundreds of threads on general-purpose processors
Open accessAbstract
Motivation: General-purpose processors can now contain many dozens of processor cores and support hundreds of simultaneous threads of execution. To make best use of these threads, genomics software must contend with new and subtle computer architecture issues. We discuss some of these and propose methods for improving thread scaling in tools that analyze each read independently, such as read aligners. Results: We implement these methods in new versions of Bowtie, Bowtie 2 and HISAT. We greatly improve thread scaling in many scenarios, including on the recent Intel Xeon Phi architecture. We also highlight how bottlenecks are exacerbated by variable-record-length file formats like FASTQ and suggest changes that enable superior scaling. Availability and implementation: Experiments for this study: https://github.com/BenLangmead/bowtie-scaling. Bowtie: http://bowtie-bio.sourceforge.net . Bowtie 2: http://bowtie-bio.sourceforge.net/bowtie2 . HISAT: http://www.ccb.jhu.edu/software/hisat Supplementary information: Supplementary data are available at Bioinformatics online.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Trimmomatic: a flexible trimmer for Illumina sequence data
Bolger, A. M., Lohse, M., & Usadel, B. (2014) · Bioinformatics · doi:10.1093/bioinformatics/btu170 · Cited by 65,548
The Sequence Alignment/Map format and SAMtools
Li, H., Handsaker, B., Wysoker, A., Fennell, T., Ruan, J., Homer, N., Marth, G., Abecasis, G., Durbin, R., & 1000 Genome Project Data Processing Subgroup (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp352 · Cited by 62,041
Fast gapped-read alignment with Bowtie 2
Langmead, B., & Salzberg, S. L. (2012) · Nature Methods · doi:10.1038/nmeth.1923 · Cited by 56,400
Self-citationHISAT: a fast spliced aligner with low memory requirements
Kim, D., Langmead, B., & Salzberg, S. L. (2015) · Nature Methods · doi:10.1038/nmeth.3317 · Cited by 24,112
Self-citationUltrafast and memory-efficient alignment of short DNA sequences to the human genome.
Langmead, B., Trapnell, C., Pop, M., & Salzberg, S. L. (2009) · Genome Biology · doi:10.1186/gb-2009-10-3-r25 · Cited by 21,849
Self-citationA global reference for human genetic variation
The 1000 Genomes Project Consortium, authors, C., Auton, A., Abecasis, G. R., Steering committee, Altshuler, D. M., Durbin, R. M., Abecasis, G. R., Bentley, D. R., Chakravarti, A., et al. (2015) · Nature · doi:10.1038/nature15393 · Cited by 18,247
Near-optimal probabilistic RNA-seq quantification
Bray, N. L., Pimentel, H., Melsted, P., & Pachter, L. (2016) · Nature Biotechnology · doi:10.1038/nbt.3519 · Cited by 9,723
Aligning sequence reads, clone sequences and assembly contigs with BWA-MEM
Li, H. (2013) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.48550/arxiv.1303.3997 · Cited by 5,159
Aligning sequence reads, clone sequences and assembly con*gs with BWA-MEM
Li, H. (2014) · arXiv (Cornell University) · doi:10.6084/m9.figshare.963153.v1 · Cited by 4,932
Kraken: ultrafast metagenomic sequence classification using exact alignments
Wood, D. E., & Salzberg, S. L. (2014) · Genome Biology · doi:10.1186/gb-2014-15-3-r46 · Cited by 4,521
The chips are down for Moore’s law
Waldrop, M. M. (2016) · Nature · doi:10.1038/530144a · Cited by 2,397
Cock, P. J. A., Fields, C. J., Goto, N., Heuer, M. L., & Rice, P. M. (2010) · Nucleic Acids Research · doi:10.1093/nar/gkp1137 · Cited by 1,879
Metagenomic microbial community profiling using unique clade-specific marker genes
Segata, N., Waldron, L., Ballarini, A., Narasimhan, V., Jousson, O., & Huttenhower, C. (2012) · Nature Methods · doi:10.1038/nmeth.2066 · Cited by 1,776
Cilk: an efficient multithreaded runtime system
Blumofe, R. D., Joerg, C. F., Kuszmaul, B. C., Leiserson, C. E., Randall, K. H., & Zhou, Y. (1995) · Proceedings of the fifth ACM SIGPLAN symposium on Principles and practice of parallel programming · doi:10.1145/209936.209958 · Cited by 1,021
Intel threading building blocks : outfitting C++ for multi-core processor parallelism
Reinders, J. R. (2007) · Cited by 708
Tabix: fast retrieval of sequence features from generic TAB-delimited files
Li, H. (2011) · Bioinformatics · doi:10.1093/bioinformatics/btq671 · Cited by 595
Quake: quality-aware detection and correction of sequencing errors
Kelley, D. R., Schatz, M. C., & Salzberg, S. L. (2010) · Genome Biology · doi:10.1186/gb-2010-11-11-r116 · Cited by 582
The GEM mapper: fast, accurate and versatile alignment by filtration
Marco-Sola, S., Sammeth, M., Guigó, R., & Ribeca, P. (2012) · Nature Methods · doi:10.1038/nmeth.2221 · Cited by 544
Eberle, M. A., Fritzilas, E., Krusche, P., Källberg, M., Moore, B. L., Bekritsky, M. A., Iqbal, Z., Chuang, H.-Y., Humphray, S. J., Halpern, A. L., et al. (2017) · Genome Research · doi:10.1101/gr.210500.116 · Cited by 354
Analysis of the platypus genome suggests a transposon origin for mammalian imprinting
Pask, A. J., Papenfuss, A. T., Ager, E. I., McColl, K. A., Speed, T. P., & Renfree, M. B. (2009) · Genome Biology · doi:10.1186/gb-2009-10-1-r1 · Cited by 328
Lighter: fast and memory-efficient sequencing error correction without counting
Song, L., Florea, L., & Langmead, B. (2014) · Genome Biology · doi:10.1186/preaccept-9663167051308943 · Cited by 258
Self-citationFastflow: High‐Level and Efficient Streaming on Multicore
Aldinucci, M., Danelutto, M., Kilpatrick, P., & Torquati, M. (2017) · Programming multi‐core and many‐core computing systems · doi:10.1002/9781119332015.ch13 · Cited by 242
Cazzaniga, P., Nobile, M. S., Besozzi, D., Bellini, M., & Mauri, G. (2014) · BioMed Research International · doi:10.1155/2014/863298 · Cited by 202
Faster and More Accurate Sequence Alignment with SNAP
Zaharia, M., Bolosky, W. J., Curtis, K., Fox, A., Patterson, D. A., Shenker, S. J., Stoica, I. G., Karp, R. M., & Sittler, T. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1111.5572 · Cited by 202
Extending reference assembly models
Church, D. M., Schneider, V. A., Steinberg, K. M., Schatz, M. C., Quinlan, A. R., Chin, C.-S., Kitts, P. A., Aken, B., Marth, G. T., Hoffman, M. M., et al. (2015) · Genome Biology · doi:10.1186/s13059-015-0587-3 · Cited by 163
Phenotypic connections in surprising places
Linghu, B., & DeLisi, C. (2010) · Genome biology · doi:10.1186/gb-2010-11-4-116 · Cited by 128
RapMap: a rapid, sensitive and accurate tool for mapping RNA-seq reads to transcriptomes
Srivastava, A., Sarkar, H., Gupta, N., & Patro, R. (2016) · Bioinformatics · doi:10.1093/bioinformatics/btw277 · Cited by 128
Parallelising the Computation of Minimal Absent Words
Barton, C., Héliou, A., Mouchard, L., & Pissis, S. P. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-32152-3_23 · Cited by 60
Rustagi, N., Zhou, A., Watkins, W. S., Gedvilaite, E., Wang, S., Ramesh, N., Muzny, D. M., Gibbs, R. A., Jorde, L. B., Yu, F., et al. (2017) · BMC Genomics · doi:10.1186/s12864-017-3767-6 · Cited by 28
Sequence Alignment Tools: One Parallel Pattern to Rule Them All?
Misale, C., Ferrero, G., Torquati, M., & Aldinucci, M. (2014) · BioMed Research International · doi:10.1155/2014/539410 · Cited by 12
Lenis, J., & Senar, M. À. (2017) · Cluster Computing · doi:10.1007/s10586-017-1015-0 · Cited by 12
Accelerating Bowtie2 with a lock-less concurrency approach and memory affinity
Misale, C. (2014) · Euromicro International Conference on Parallel, Distributed and Network-Based Processing (PDP) · doi:10.1109/pdp.2014.50 · Cited by 9
Cited by
Improved metagenomic analysis with Kraken 2
Wood, D. E., Lu, J., & Langmead, B. (2019) · Genome Biology · doi:10.1186/s13059-019-1891-0 · Cited by 7,061
Self-citationThe PATRIC Bioinformatics Resource Center: expanding data and analysis capabilities
Davis, J. J., Wattam, A. R., Aziz, R. K., Brettin, T., Butler, R., Butler, R. M., Chlenski, P., Conrad, N., Dickerman, A., Dietrich, E. M., et al. (2019) · Nucleic Acids Research · doi:10.1093/nar/gkz943 · Cited by 902
The long-term genetic stability and individual specificity of the human gut microbiome
Chen, L., Wang, D., Garmaeva, S., Kurilshikov, A., Vich Vila, A., Gacesa, R., Sinha, T., Segal, E., Weersma, R. K., Wijmenga, C., et al. (2021) · Cell · doi:10.1016/j.cell.2021.03.024 · Cited by 345
Agostini, M. L., Pruijssers, A. J., Chappell, J. D., Gribble, J., Lu, X., Andres, E. L., Bluemling, G. R., Lockwood, M. A., Sheahan, T. P., Sims, A. C., et al. (2019) · Journal of Virology · doi:10.1128/jvi.01348-19 · Cited by 337
Chen, L., Zhernakova, D. V., Kurilshikov, A., Andreu-Sánchez, S., Wang, D., Augustijn, H. E., Vich Vila, A., Study, L. C., Weersma, R. K., Medema, M. H., et al. (2022) · Nature Medicine · doi:10.1038/s41591-022-02014-8 · Cited by 327
Metadata
- Authors
- Langmead, B., Wilks, C., Antonescu, V., & Charles, R.
- Venue
- Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2018-07-18
- Volume
- 35
- Issue
- 3
- Pages
- 421-432
- ISSN
- 1367-4803 (ISSN-L)
- 1367-4811
- OpenAlex
- W2952597168
- Cited by
- 942
- References
- 32
- FWCI
- 15.15
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.