The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Combining tumor genome simulation with crowdsourcing to benchmark somatic single-nucleotide-variant detection
Open accessAbstract
The first report of the ICGC-TCGA DREAM Somatic Mutation Calling Challenge introduces the BAMSurgeon tool for accurate tumor simulation and reports the performance of 248 submissions in calling single-nucleotide variants from three pairs of synthetic tumor–normal genome benchmarks. The detection of somatic mutations from cancer genome sequences is key to understanding the genetic basis of disease progression, patient survival and response to therapy. Benchmarking is needed for tool assessment and improvement but is complicated by a lack of gold standards, by extensive resource requirements and by difficulties in sharing personal genomic information. To resolve these issues, we launched the ICGC-TCGA DREAM Somatic Mutation Calling Challenge, a crowdsourced benchmark of somatic mutation detection algorithms. Here we report the BAMSurgeon tool for simulating cancer genomes and the results of 248 analyses of three in silico tumors created with it. Different algorithms exhibit characteristic error profiles, and, intriguingly, false positives show a trinucleotide profile very similar to one found in human tumors. Although the three simulated tumors differ in sequence contamination (deviation from normal cell sequence) and in subclonality, an ensemble of pipelines outperforms the best individual pipeline in all cases. BAMSurgeon is available at https://github.com/adamewing/bamsurgeon/ .
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Sequence Alignment/Map format and SAMtools
Li, H., Handsaker, B., Wysoker, A., Fennell, T., Ruan, J., Homer, N., Marth, G., Abecasis, G., Durbin, R., & 1000 Genome Project Data Processing Subgroup (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp352 · Cited by 62,041
Fast and accurate short read alignment with Burrows-Wheeler transform
Li, H., & Durbin, R. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp324 · Cited by 58,607
Fast gapped-read alignment with Bowtie 2
Langmead, B., & Salzberg, S. L. (2012) · Nature Methods · doi:10.1038/nmeth.1923 · Cited by 56,400
The Genome Analysis Toolkit: A MapReduce framework for analyzing next-generation DNA sequencing data
McKenna, A., Hanna, M., Banks, E., Sivachenko, A., Cibulskis, K., Kernytsky, A., Garimella, K., Altshuler, D., Gabriel, S., Daly, M., et al. (2010) · Genome Research · doi:10.1101/gr.107524.110 · Cited by 27,895
BEDTools: a flexible suite of utilities for comparing genomic features
Quinlan, A. R., & Hall, I. M. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq033 · Cited by 27,437
The variant call format and VCFtools
Danecek, P., Auton, A., Abecasis, G., Albers, C. A., Banks, E., DePristo, M. A., Handsaker, R. E., Lunter, G., Marth, G. T., Sherry, S. T., et al. (2011) · Bioinformatics · doi:10.1093/bioinformatics/btr330 · Cited by 16,200
Robinson, J. T., Thorvaldsdóttir, H., Winckler, W., Guttman, M., Lander, E. S., Getz, G., & Mesirov, J. P. (2011) · Nature Biotechnology · doi:10.1038/nbt.1754 · Cited by 15,390
Statistical significance for genomewide studies
Storey, J. D., & Tibshirani, R. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1530509100 · Cited by 9,692
Signatures of mutational processes in human cancer
Initiative, A. P. C. G., Alexandrov, L. B., ICGC Breast Cancer Consortium, ICGC MMML-Seq Consortium, PedBrain, I., Nik-Zainal, S., Wedge, D. C., Aparicio, S. A. J. R., Behjati, S., Biankin, A. V., et al. (2013) · Nature · doi:10.1038/nature12477 · Cited by 9,660
Integrated genomic characterization of endometrial carcinoma
The Cancer Genome Atlas Research Network, & Levine, D. A. (2013) · Nature · doi:10.1038/nature12113 · Cited by 5,784
Sensitive detection of somatic point mutations in impure and heterogeneous cancer samples
Cibulskis, K., Lawrence, M. S., Carter, S. L., Sivachenko, A., Jaffe, D., Sougnez, C., Gabriel, S., Meyerson, M., Lander, E. S., & Getz, G. (2013) · Nature Biotechnology · doi:10.1038/nbt.2514 · Cited by 4,981
Aligning sequence reads, clone sequences and assembly con*gs with BWA-MEM
Li, H. (2014) · arXiv (Cornell University) · doi:10.6084/m9.figshare.963153.v1 · Cited by 4,932
Bias in random forest variable importance measures: Illustrations, sources and a solution
Strobl, C., Boulesteix, A.-L., Zeileis, A., & Hothorn, T. (2007) · BMC Bioinformatics · doi:10.1186/1471-2105-8-25 · Cited by 3,688
Random Forest: A Classification and Regression Tool for Compound Classification and QSAR Modeling
Svetnik, V., Liaw, A., Tong, C., Culberson, J. C., Sheridan, R. P., & Feuston, B. P. (2003) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci034160g · Cited by 3,573
Conditional variable importance for random forests
Strobl, C., Boulesteix, A.-L., Kneib, T., Augustin, T., & Zeileis, A. (2008) · BMC Bioinformatics · doi:10.1186/1471-2105-9-307 · Cited by 3,254
Discovery and saturation analysis of cancer genes across 21 tumour types
Lawrence, M. S., Stojanov, P., Mermel, C. H., Robinson, J. T., Garraway, L. A., Golub, T. R., Meyerson, M., Gabriel, S. B., Lander, E. S., & Getz, G. (2014) · Nature · doi:10.1038/nature12912 · Cited by 3,096
Mutational Processes Molding the Genomes of 21 Breast Cancers
Nik-Zainal, S., Alexandrov, L. B., Wedge, D. C., Van Loo, P., Greenman, C. D., Raine, K., Jones, D., Hinton, J., Marshall, J., Stebbings, L. A., et al. (2012) · Cell · doi:10.1016/j.cell.2012.04.024 · Cited by 1,909
Fast and SNP-tolerant detection of complex variants and splicing in short reads
Wu, T. D., & Nacu, S. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq057 · Cited by 1,894
Wisdom of crowds for robust gene network inference
The DREAM5 Consortium, Marbach, D., Costello, J. C., Küffner, R., Vega, N. M., Prill, R. J., Camacho, D. M., Allison, K. R., Kellis, M., Collins, J. J., et al. (2012) · Nature Methods · doi:10.1038/nmeth.2016 · Cited by 1,667
Self-citationStrelka: accurate somatic small-variant calling from sequenced tumor–normal sample pairs
Saunders, C. T., Wong, W. S. W., Swamy, S., Becq, J., Murray, L. J., & Cheetham, R. K. (2012) · Bioinformatics · doi:10.1093/bioinformatics/bts271 · Cited by 1,635
Emerging landscape of oncogenic signatures across human cancers
Ciriello, G., Miller, M. L., Aksoy, B. A., Senbabaoglu, Y., Schultz, N., & Sander, C. (2013) · Nature Genetics · doi:10.1038/ng.2762 · Cited by 1,378
VarScan: variant detection in massively parallel sequencing of individual and pooled samples
Koboldt, D. C., Chen, K., Wylie, T., Larson, D. E., McLellan, M. D., Mardis, E. R., Weinstock, G. M., Wilson, R. K., & Ding, L. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp373 · Cited by 1,348
Hothorn, T. (2005) · Biostatistics · doi:10.1093/biostatistics/kxj011 · Cited by 684
SomaticSniper: identification of somatic point mutations in whole genome sequencing data
Larson, D. E., Harris, C. C., Chen, K., Koboldt, D. C., Abbott, T. E., Dooling, D. J., Ley, T. J., Mardis, E. R., Wilson, R. K., & Ding, L. (2012) · Bioinformatics · doi:10.1093/bioinformatics/btr665 · Cited by 661
Sequence-specific error profile of Illumina sequencers
Nakamura, K., Oshima, T., Morimoto, T., Ikeda, S., Yoshikawa, H., Shiwa, Y., Ishikawa, S., Linak, M. C., Hirai, A., Takahashi, H., et al. (2011) · Nucleic Acids Research · doi:10.1093/nar/gkr344 · Cited by 600
O'Rawe, J., Jiang, T., Sun, G., Wu, Y., Wang, W., Hu, J., Bodily, P., Tian, L., Hakonarson, H., Johnson, W. E., et al. (2013) · Genome Medicine · doi:10.1186/gm432 · Cited by 442
Identification and correction of systematic error in high-throughput sequence dataPreprint
Meacham, F., Boffelli, D., Dhahbi, J. M., Martin, D. I. K., Singer, M., & Pachter, L. S. (2011) · Nature Precedings · doi:10.1186/1471-2105-12-451 · Cited by 240
pIRS: Profile-based Illumina pair-end reads simulator
Hu, X., Yuan, J., Shi, Y., Lu, J., Liu, B., Li, Z., Chen, Y., Mu, D., Zhang, H., Li, N., et al. (2012) · Bioinformatics · doi:10.1093/bioinformatics/bts187 · Cited by 198
Cancer Genomics: Technology, Discovery, and Translation
Tran, B., Dancey, J. E., Kamel-Reid, S., McPherson, J. D., Bedard, P. L., Brown, A. M. K., Zhang, T., Shaw, P., Onetto, N., Stein, L., et al. (2012) · Journal of Clinical Oncology · doi:10.1200/jco.2011.39.2316 · Cited by 188
Margolin, A. A., Bilal, E., Huang, E. S., Norman, T., Ottestad, L., Mecham, B. H., Sauerwine, B., Kellen, M., Mangravite, L. M., Furia, M. D., et al. (2013) · Science Translational Medicine · doi:10.1126/scitranslmed.3006112 · Cited by 124
Self-citationOmberg, L., Ellrott, K., Yuan, Y., Kandoth, C., Wong, C., Kellen, M., Friend, S. H., Stuart, J. M., Liang, H., & Margolin, A. A. (2013) · Nature Genetics · doi:10.1038/ng.2761 · Cited by 114
Self-citationRADIA: RNA and DNA Integrated Analysis for Somatic Mutation Detection
Radenbaugh, A., Ma, S., Ewing, A. D., Stuart, J. M., Collisson, E. A., Zhu, J., & Haussler, D. H. (2014) · PLoS ONE · doi:10.1371/journal.pone.0111516 · Cited by 93
Self-citationTran, B., Brown, A. M. K., Bedard, P. L., Winquist, E., Goss, G. D., Hotte, S. J., Welch, S. A., Hirte, H. W., Zhang, T., Stein, L. D., et al. (2012) · International Journal of Cancer · doi:10.1002/ijc.27817 · Cited by 83
Discovering motifs that induce sequencing errors
Allhoff, M., Schönhuth, A., Martin, M., Costa, I. G., Rahmann, S., & Marschall, T. (2013) · BMC Bioinformatics · doi:10.1186/1471-2105-14-s5-s1 · Cited by 77
Evaluation of CASP8 model quality predictions
Cozzetto, D., Kryshtafovych, A., & Tramontano, A. L. (2009) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.22534 · Cited by 77
Comparing somatic mutation-callers: beyond Venn diagrams
Kim, S. Y., & Speed, T. P. (2013) · BMC Bioinformatics · doi:10.1186/1471-2105-14-189 · Cited by 66
Boutros, P. C., Ewing, A. D., Ellrott, K., Norman, T., Dang, K. K., Hu, Y., Kellen, M., Suver, C., Bare, J. C., Stein, L. D., et al. (2014) · Nature Genetics · doi:10.1038/ng.2932 · Cited by 44
Self-citationToward better benchmarking: challenge-based methods assessment in cancer genomics
Boutros, P. C., Margolin, A. A., Stuart, J. M., Califano, A., & Stolovitzky, G. A. (2014) · Genome biology · doi:10.1186/s13059-014-0462-7 · Cited by 42
Self-citationAdaptive BATTLE trial uses biomarkers to guide lung cancer treatment
(2010) · Nature Reviews Drug Discovery · doi:10.1038/nrd3199 · Cited by 14
SeqControl: process control for DNA sequencing
Chong, L. C., Albuquerque, M. A., Harding, N., Caloian, C., Chan-Seng-Yue, M., de Borja, R., Fraser, M., Denroche, R., Beck, T., van der Kwast, T., et al. (2014) · Nature Methods · doi:10.1038/nmeth.3094 · Cited by 10
Self-citation
Cited by
Best practices for benchmarking germline small-variant calls in human genomes
the Global Alliance for Genomics and Health Benchmarking Team, Krusche, P., Trigg, L., Boutros, P. C., Mason, C. E., De La Vega, F. M., Moore, B. L., Gonzalez-Porta, M., Eberle, M. A., Tezak, Z., et al. (2019) · Nature Biotechnology · doi:10.1038/s41587-019-0054-x · Cited by 429
Self-citationOlson, N. D., Wagner, J., McDaniel, J., Stephens, S. H., Westreich, S. T., Prasanna, A. G., Johanson, E., Boja, E., Maier, E. J., Serang, O., et al. (2022) · Cell Genomics · doi:10.1016/j.xgen.2022.100129 · Cited by 202
McFadden, D. G., Politi, K., Bhutkar, A., Chen, F. K., Song, X., Pirun, M., Santiago, P. M., Kim-Kiselak, C., Platt, J. T., Lee, E., et al. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1613601113 · Cited by 194
Transposable element detection from whole genome sequence data
Ewing, A. D. (2015) · Mobile DNA · doi:10.1186/s13100-015-0055-3 · Cited by 155
Self-citationSpearheading future omics analyses using dyngen, a multi-modal simulator of single cells
Cannoodt, R., Saelens, W., Deconinck, L., & Saeys, Y. (2021) · Nature Communications · doi:10.1038/s41467-021-24152-2 · Cited by 124
Metadata
- Authors
- participants, I.-T. D. S. M. C. C., Ewing, A. D., Houlahan, K. E., Hu, Y., Ellrott, K., Caloian, C., Yamaguchi, T. N., Bare, J. C., P'ng, C., Waggott, D., Sabelnykova, V. Y., Kellen, M. R., Norman, T. C., Haussler, D., Friend, S. H., Stolovitzky, G., Margolin, A. A., Stuart, J. M., & Boutros, P. C.
- Venue
- Nature Methods
- Published
- 2015-05-18
- Volume
- 12
- Issue
- 7
- Pages
- 623-630
- ISSN
- 1548-7091 (ISSN-L)
- 1548-7105
- OpenAlex
- W1565378970
- Cited by
- 332
- References
- 40
- FWCI
- 10.70
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
