The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Assuring the quality of next-generation sequencing in clinical laboratory practice
Open accessAbstract
To the Editor: We direct your readers’ attention to the principles and guidelines (Supplementary Guidelines) developed by the Nextgeneration Sequencing: Standardization of Clinical Testing (Nex-StoCT) workgroup. These guidelines represent initial steps to ensure that results from tests based on nextgeneration sequencing (NGS) are reliable and useful for clinical decision making. The US Centers for Disease Control and Prevention (CDC) convened this national workgroup, which collaborated to define platform-independent approaches for establishing technical process elements of a quality management system (QMS) to assure the analytical validity and compliance of NGS tests with existing regulatory and professional quality standards. The workgroup identified and addressed gaps in quality practices that could compromise the quality of both clinical laboratory services and translational efforts needed to advance the implementation and utility of NGS in clinical settings. The workgroup was composed of experts with knowledge of and experience with NGS and included clinical laboratory directors, clinicians, platform and software developers and informaticians, as well as individuals actively engaged in NGS guideline development from accreditation bodies and professional organizations. Representatives from US government agencies also participated. These guidelines address four topics that are components of quality management in a clinical environment: (i) test validation, (ii) quality control (QC) procedures to assure and maintain accurate test results, (iii) the independent assessment of test performance through proficiency testing (PT) or alternative approaches and (iv) reference materials (RMs). Discussions were limited to the analytic and informatics processes required for accurate variant calling. The workgroup did not address how variants are prioritized, interpreted or reported. The workgroup recommendations are summarized in Table 1. Although the workgroup focused on detection of DNA sequence variations associated with heritable human disorders, many of the principles and recommendations described are also relevant to the application of NGS to other areas of laboratory medicine, including the diagnosis, prognosis and treatment of cancer and infectious-disease testing. Validation is the process of establishing analytical performance specifications for a clinical test system developed in house to confirm that the system is suitable for its intended use1. During the validation process, the laboratory must demonstrate that the assay functions as expected and provides
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
DNA sequencing with chain-terminating inhibitors
Sanger, F., Nicklen, S., & Coulson, A. R. (1977) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.74.12.5463 · Cited by 68,572
The Sequence Alignment/Map format and SAMtools
Li, H., Handsaker, B., Wysoker, A., Fennell, T., Ruan, J., Homer, N., Marth, G., Abecasis, G., Durbin, R., & 1000 Genome Project Data Processing Subgroup (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp352 · Cited by 62,041
The variant call format and VCFtools
Danecek, P., Auton, A., Abecasis, G., Albers, C. A., Banks, E., DePristo, M. A., Handsaker, R. E., Lunter, G., Marth, G. T., Sherry, S. T., et al. (2011) · Bioinformatics · doi:10.1093/bioinformatics/btr330 · Cited by 16,200
ANNOVAR: functional annotation of genetic variants from high-throughput sequencing data
Wang, K., Li, M., & Hakonarson, H. (2010) · Nucleic Acids Research · doi:10.1093/nar/gkq603 · Cited by 14,621
International Organization for Standardization
(2011) · SpringerReference · doi:10.1007/springerreference_16847 · Cited by 12,534
A framework for variation discovery and genotyping using next-generation DNA sequencing data
DePristo, M. A., Banks, E., Poplin, R., Garimella, K. V., Maguire, J. R., Hartl, C., Philippakis, A. A., del Angel, G., Rivas, M. A., Hanna, M., et al. (2011) · Nature Genetics · doi:10.1038/ng.806 · Cited by 11,456
<tt>BLAT</tt> —The <tt>BLAST</tt> -Like Alignment Tool
Kent, W. J. (2002) · Genome Research · doi:10.1101/gr.229202 · Cited by 8,480
A map of human genome variation from population-scale sequencing.
The 1000 Genomes Project Consortium (2010) · Nature · doi:10.1038/nature09534 · Cited by 7,877
Sequencing technologies – the next generation
Metzker, M. L. (2010) · Nature Reviews Genetics · doi:10.1038/nrg2626 · Cited by 7,066
International Organization for Standardization
(2015) · Encyclopedia of Astrobiology · doi:10.1007/978-3-662-44185-5_100574 · Cited by 6,716
Clinical and Laboratory Standards Institute
(2019) · Springer Reference Medizin · doi:10.1007/978-3-662-48986-4_300416 · Cited by 5,091
Next-generation DNA sequencing
Shendure, J., & Ji, H. (2008) · Nature Biotechnology · doi:10.1038/nbt1486 · Cited by 4,509
Integrating common and rare genetic variation in diverse human populations
The International HapMap 3 Consortium (2010) · Nature · doi:10.1038/nature09298 · Cited by 3,026
Next-Generation DNA Sequencing Methods
Mardis, E. R. (2008) · Annual Review of Genomics and Human Genetics · doi:10.1146/annurev.genom.9.081307.164359 · Cited by 2,369
Self-citationAn integrated semiconductor device enabling non-optical genome sequencing
Rothberg, J. M., Hinz, W., Rearick, T. M., Schultz, J., Mileski, W., Davey, M., Leamon, J. H., Johnson, K., Milgrew, M. J., Edwards, M., et al. (2011) · Nature · doi:10.1038/nature10242 · Cited by 2,172
Cock, P. J. A., Fields, C. J., Goto, N., Heuer, M. L., & Rice, P. M. (2010) · Nucleic Acids Research · doi:10.1093/nar/gkp1137 · Cited by 1,879
Target-enrichment strategies for next-generation sequencing
Mamanova, L., Coffey, A. J., Scott, C. E., Kozarewa, I., Turner, E. H., Kumar, A., Howard, E., Shendure, J., & Turner, D. J. (2010) · Nature Methods · doi:10.1038/nmeth.1419 · Cited by 1,219
Human Genome Sequencing Using Unchained Base Reads on Self-Assembling DNA Nanoarrays
Drmanac, R., Sparks, A. B., Callow, M. J., Halpern, A. L., Burns, N. L., Kermani, B. G., Carnevali, P., Nazarenko, I., Nilsen, G. B., Yeung, G., et al. (2010) · Science · doi:10.1126/science.1181498 · Cited by 1,212
A survey of sequence alignment algorithms for next-generation sequencing
Li, H., & Homer, N. (2010) · Briefings in Bioinformatics · doi:10.1093/bib/bbq015 · Cited by 875
Next-Generation Sequencing: From Basic Research to Diagnostics
Voelkerding, K. V., Dames, S. A., & Durtschi, J. D. (2009) · Clinical Chemistry · doi:10.1373/clinchem.2008.112789 · Cited by 839
Self-citationWorthey, E. A., Mayer, A. N., Syverson, G. D., Helbling, D., Bonacci, B. B., Decker, B., Serpe, J. M., Dasu, T., Tschannen, M. R., Veith, R. L., et al. (2011) · Genetics in Medicine · doi:10.1097/gim.0b013e3182088158 · Cited by 711
Self-citationCarrier testing for severe childhood recessive diseases by next-generation sequencing
Bell, C. J., Dinwiddie, D. L., Miller, N. A., Hateley, S. L., Ganusova, E. E., Mudge, J., Langley, R. J., Zhang, L., Lee, C. C., Schilkey, F. D., et al. (2011) · Science Translational Medicine · doi:10.1126/scitranslmed.3001756 · Cited by 706
The impact of next-generation sequencing on genomics
Zhang, J., Chiodini, R., Badr, A., & Zhang, G. (2011) · Journal of Genetics and Genomics · doi:10.1016/j.jgg.2011.02.003 · Cited by 577
McKernan, K. J., Peckham, H. E., Costa, G. L., McLaughlin, S. F., Fu, Y., Tsung, E. F., Clouser, C. R., Duncan, C., Ichikawa, J. K., Lee, C. C., et al. (2009) · Genome Research · doi:10.1101/gr.091868.109 · Cited by 528
Self-citationPerformance comparison of exome DNA sequencing technologies
Clark, M. J., Chen, R., Lam, H. Y. K., Karczewski, K. J., Chen, R., Euskirchen, G., Butte, A. J., & Snyder, M. (2011) · Nature Biotechnology · doi:10.1038/nbt.1975 · Cited by 511
Complete Khoisan and Bantu genomes from southern Africa
Schuster, S. C., Miller, W., Ratan, A., Tomsho, L. P., Giardine, B., Kasson, L. R., Harris, R. S., Petersen, D. C., Zhao, F., Qi, J., et al. (2010) · Nature · doi:10.1038/nature08795 · Cited by 499
Self-citationAssembly of large genomes using second-generation sequencing
Schatz, M. C., Delcher, A. L., & Salzberg, S. L. (2010) · Genome Research · doi:10.1101/gr.101360.109 · Cited by 499
Massively Parallel Sequencing: The Next Big Thing in Genetic Medicine
Tucker, T., Marra, M., & Friedman, J. M. (2009) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2009.06.022 · Cited by 386
Large-Scale and Automated DNA Sequence Determination
Hunkapiller, T., Kaiser, R. J., Koop, B. F., & Hood, L. (1991) · Science · doi:10.1126/science.1925562 · Cited by 361
Sense from sequence reads: methods for alignment and assembly
Flicek, P., & Birney, E. (2009) · Nature Methods · doi:10.1038/nmeth.1376 · Cited by 358
Detecting Heteroplasmy from High-Throughput Sequencing of Complete Human Mitochondrial DNA Genomes
Li, M., Schönberg, A., Schaefer, M., Schroeder, R., Nasidze, I., & Stoneking, M. (2010) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2010.07.014 · Cited by 325
Performance comparison of whole-genome sequencing platforms
Lam, H. Y. K., Clark, M. J., Chen, R., Chen, R., Natsoulis, G., O'Huallachain, M., Dewey, F. E., Habegger, L., Ashley, E. A., Gerstein, M. B., et al. (2012) · Nature Biotechnology · doi:10.1038/nbt.2065 · Cited by 308
The ClinSeq Project: Piloting large-scale genome sequencing for research in genomic medicine
Biesecker, L. G., Mullikin, J. C., Facio, F. M., Turner, C., Cherukuri, P. F., Blakesley, R. W., Bouffard, G. G., Chines, P. S., Cruz, P., Hansen, N. F., et al. (2009) · Genome Research · doi:10.1101/gr.092841.109 · Cited by 260
Self-citationUse of Whole-Genome Sequencing to Diagnose a Cryptic Fusion Oncogene
Welch, J. S. (2011) · JAMA · doi:10.1001/jama.2011.497 · Cited by 252
Accurate and comprehensive sequencing of personal genomes
Ajay, S. S., Parker, S. C. J., Ozel Abaan, H., Fuentes Fajardo, K. V., & Margulies, E. H. (2011) · Genome Research · doi:10.1101/gr.123638.111 · Cited by 211
A probabilistic disease-gene finder for personal genomes
Yandell, M., Huff, C., Hu, H., Singleton, M., Moore, B., Xing, J., Jorde, L. B., & Reese, M. G. (2011) · Genome Research · doi:10.1101/gr.123158.111 · Cited by 202
Self-citationKeeping Up With the Next Generation
ten Bosch, J. R., & Grody, W. W. (2008) · The Journal of Molecular Diagnostics · doi:10.2353/jmoldx.2008.080027 · Cited by 200
A statistical method for the detection of variants from next-generation resequencing of DNA pools
Bansal, V. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq214 · Cited by 186
Next-generation sequencing and its applications in molecular diagnostics
Su, Z., Ning, B., Fang, H., Hong, H., Perkins, R., Tong, W., & Shi, L. (2011) · Expert Review of Molecular Diagnostics · doi:10.1586/erm.11.3 · Cited by 179
Whole exome and whole genome sequencing
Bick, D. P., & Dimmock, D. (2011) · Current Opinion in Pediatrics · doi:10.1097/mop.0b013e32834b20ec · Cited by 173
Self-citationVoelkerding, K. V., Dames, S. A., & Durtschi, J. (2010) · Journal of Molecular Diagnostics · doi:10.2353/jmoldx.2010.100043 · Cited by 154
Self-citationPhased Whole-Genome Genetic Risk in a Family Quartet Using a Major Allele Reference Sequence
Dewey, F. E., Chen, R., Cordero, S. P., Ormond, K. E., Caleshu, C. A., Karczewski, K. J., Whirl‐Carrillo, M., Wheeler, M. T., Dudley, J. T., Byrnes, J., et al. (2011) · PLoS Genetics · doi:10.1371/journal.pgen.1002280 · Cited by 151
Self-citationGood laboratory practices for molecular genetic testing for heritable diseases and conditions.
Chen, B., Gagnon, M., Shahangian, S., Anderson, N., Howerton, D., & Boone, J. (2009) · PubMed · Cited by 148
Self-citationNext Generation DNA Sequencing and the Future of Genomic Medicine
Anderson, M. W., & Schrijver, I. (2010) · Genes · doi:10.3390/genes1010038 · Cited by 127
A standard variation file format for human genome sequences
Reese, M. G., Moore, B., Batchelor, C. R., Salas, F., Cunningham, F. M., Marth, G., Stein, L. D., Flicek, P., Yandell, M. D., & Eilbeck, K. L. (2010) · Genome biology · doi:10.1186/gb-2010-11-8-r88 · Cited by 112
Self-citationProbabilistic base calling of Solexa sequencing data
Rougemont, J., Amzallag, A., Iseli, C., Farinelli, L., Xénarios, I., & Naef, F. (2008) · BMC Bioinformatics · doi:10.1186/1471-2105-9-431 · Cited by 104
Detection of low prevalence somatic mutations in solid tumors with ultra-deep targeted sequencing
Harismendy, O., Schwab, R. B., Bao, L., Olson, J., Rozenzhak, S., Kotsopoulos, S. K., Pond, S. J. K., Crain, B., Chee, M. S., Messer, K. S., et al. (2011) · Genome biology · doi:10.1186/gb-2011-12-12-r124 · Cited by 98
Jones, M. A., Bhide, S., Chin, E., Ng, B. G., Rhodenizer, D., Zhang, V. W., Sun, J., Tanner, A. K., Freeze, H. H., & Hegde, M. (2011) · Genetics in Medicine · doi:10.1097/gim.0b013e318226fbf2 · Cited by 91
Self-citationMicroarray analysis for constitutional cytogenetic abnormalities
Shaffer, L. G., Beaudet, A. L., Brothman, A. R., Hirsch, B. A., Levy, B., Martin, C. L., Mascarello, J. T., & Rao, K. W. (2007) · Genetics in Medicine · doi:10.1097/gim.0b013e31814ce3d9 · Cited by 86
Chou, L., Liu, C.-S. J., Boese, B., Zhang, X., & Mao, R. (2009) · Clinical Chemistry · doi:10.1373/clinchem.2009.132639 · Cited by 67
Self-citationSequencing and Genome Assembly Using Next-Generation Technologies
Nagarajan, N., & Pop, M. (2010) · Methods in molecular biology · doi:10.1007/978-1-60761-842-3_1 · Cited by 62
Gowrisankar, S., Lerner‐Ellis, J. P., Cox, S. W., White, E. T., Manion, M. L., LeVan, K., Liu, J., Farwell, L. M., Iartchouk, O., Rehm, H. L., et al. (2010) · Journal of Molecular Diagnostics · doi:10.2353/jmoldx.2010.100014 · Cited by 43
Self-citationDesign and Analytical Validation of Clinical DNA Sequencing Assays
Pont-Kingdon, G. A., Gedge, F. E. H., Wooderchak‐Donahue, W. L., et al. (2011) · Archives of Pathology & Laboratory Medicine · doi:10.5858/arpa.2010-0623-oa · Cited by 38
Capillary Electrophoresis for DNA Sequencing
Dovic̀hi, N. J. (1997) · Chromatographia CE series · doi:10.1007/978-3-322-91015-8_10 · Cited by 24
Cited by
Coming of age: ten years of next-generation sequencing technologies
Goodwin, S., McPherson, J. D., & McCombie, W. R. (2016) · Nature Reviews Genetics · doi:10.1038/nrg.2016.49 · Cited by 4,352
Ultrafast one‐pass FASTQ data preprocessing, quality control, and deduplication using fastp
Chen, S. (2023) · iMeta · doi:10.1002/imt2.107 · Cited by 2,166
Frampton, G. M., Fichtenholtz, A., Otto, G. A., Wang, K., Downing, S. R., He, J., Schnall-Levin, M., White, J., Sanford, E. M., An, P., et al. (2013) · Nature Biotechnology · doi:10.1038/nbt.2696 · Cited by 2,157
Guidelines for investigating causality of sequence variants in human disease
MacArthur, D. G., Manolio, T. A., Dimmock, D. P., Rehm, H. L., Shendure, J., Abecasis, G. R., Adams, D. R., Altman, R. B., Antonarakis, S. E., Ashley, E. A., et al. (2014) · Nature · doi:10.1038/nature13127 · Cited by 1,224
Self-citationTumour heterogeneity in the clinic
Bedard, P. L., Hansen, A. R., Ratain, M. J., & Siu, L. L. (2013) · Nature · doi:10.1038/nature12627 · Cited by 1,211
Metadata
- Authors
- Gargis, A. S., Kalman, L., Berry, M. W., Bick, D. P., Dimmock, D. P., Hambuch, T., Lu, F., Lyon, E., Voelkerding, K. V., Zehnbauer, B. A., Agarwala, R., Bennett, S. F., Chen, B., Chin, E. L. H., Compton, J. G., Das, S., Farkas, D. H., Ferber, M. J., Funke, B. H., Furtado, M. R., Ganova-Raeva, L. M., Geigenmüller, U., Gunselman, S. J., Hegde, M. R., Johnson, P. L. F., Kasarskis, A., Kulkarni, S., Lenk, T., Liu, C. S. J., Manion, M., Manolio, T. A., Mardis, E. R., Merker, J. D., Rajeevan, M. S., Reese, M. G., Rehm, H. L., Simen, B. B., Yeakley, J. M., Zook, J. M., & Lubin, I. M.
- Venue
- Nature Biotechnology
- Published
- 2012-11
- Volume
- 30
- Issue
- 11
- Pages
- 1033-1036
- ISSN
- 0733-222X (ISSN-L)
- 1087-0156
- 1546-1696
- OpenAlex
- W2159265519
- Cited by
- 461
- References
- 55
- FWCI
- 30.12
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.