Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.

Accuracy and efficiency of germline variant calling pipelines for human genome data

Open access

Published version of a preprint

Abstract

Advances in next-generation sequencing technology have enabled whole genome sequencing (WGS) to be widely used for identification of causal variants in a spectrum of genetic-related disorders, and provided new insight into how genetic polymorphisms affect disease phenotypes. The development of different bioinformatics pipelines has continuously improved the variant analysis of WGS data. However, there is a necessity for a systematic performance comparison of these pipelines to provide guidance on the application of WGS-based scientific and clinical genomics. In this study, we evaluated the performance of three variant calling pipelines (GATK, DRAGEN and DeepVariant) using the Genome in a Bottle Consortium, “synthetic-diploid” and simulated WGS datasets. DRAGEN and DeepVariant show better accuracy in SNP and indel calling, with no significant differences in their F1-score. DRAGEN platform offers accuracy, flexibility and a highly-efficient execution speed, and therefore superior performance in the analysis of WGS data on a large scale. The combination of DRAGEN and DeepVariant also suggests a good balance of accuracy and efficiency as an alternative solution for germline variant detection in further applications. Our results facilitate the standardization of benchmarking analysis of bioinformatics pipelines for reliable variant detection, which is critical in genetics-based medical research and clinical applications.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1038/s41598-020-77218-4

Cites

44 of 44 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 The flowchart of benchmarking analysis of different variant calling pipeline (GATK, DRAGEN and DeepVariant) combinations.
Figure 1 The flowchart of benchmarking analysis of different variant calling pipeline (GATK, DRAGEN and DeepVariant) combinations.CC BY · PubMed Central
Figure 2 Accuracy evaluation of variant calling pipelines on real WGS datasets NA12878_PrecisionFDA (A,B), NA12878_SRR6794144 (C,D) and “synthetic-diploid” CHM1-13 (E,F for replicate ERR1341793, G,H for replicate ERR1341796). For each dataset, seven different combinations (i.e. DV_gatk4, DV_dragen3, Dragen3_raw, Dragen3_vqsr, GATK4_raw, GATK4_vqsr and Merged) were compared. The performance metrics (F1-score, Recall and Precision) of SNP and indel calls were estimated using a “genotype match” approach for NA12878 and a “local match” approach for the “synthetic-diploid” CHM1-13.
Figure 2 Accuracy evaluation of variant calling pipelines on real WGS datasets NA12878_PrecisionFDA (A,B), NA12878_SRR6794144 (C,D) and “synthetic-diploid” CHM1-13 (E,F for replicate ERR1341793, G,H for replicate ERR1341796). For each dataset, seven different combinations (i.e. DV_gatk4, DV_dragen3, Dragen3_raw, Dragen3_vqsr, GATK4_raw, GATK4_vqsr and Merged) were compared. The performance metrics (F1-score, Recall and Precision) of SNP and indel calls were estimated using a “genotype match” approach for NA12878 and a “local match” approach for the “synthetic-diploid” CHM1-13.CC BY · PubMed Central
Figure 3 Venn diagrams showing the intersection of variants called by different pipeline combinations on NA12878_PrecisionFDA (A), NA12878_SRR6794144 (B), “synthetic-diploid” CHM1-13 (C—replicate ERR1341793; D—replicate ERR1341796) and two simulated WGS datasets (E—random mutation profile; F—user defined mutation profile). The number of SNP and indel variants are shown together using separator ‘/’. The callsets Dragen3_vqsr and GATK4_vqsr are not included in the comparison as they are subsets of Dragen3_raw and GATK4_raw, respectively.
Figure 3 Venn diagrams showing the intersection of variants called by different pipeline combinations on NA12878_PrecisionFDA (A), NA12878_SRR6794144 (B), “synthetic-diploid” CHM1-13 (C—replicate ERR1341793; D—replicate ERR1341796) and two simulated WGS datasets (E—random mutation profile; F—user defined mutation profile). The number of SNP and indel variants are shown together using separator ‘/’. The callsets Dragen3_vqsr and GATK4_vqsr are not included in the comparison as they are subsets of Dragen3_raw and GATK4_raw, respectively.CC BY · PubMed Central
Figure 4 Variant calling runtime of six pipeline combinations (DV_gatk4, DV_dragen3, Dragen3_raw, Dragen3_vqsr, GATK4_raw and GATK4_vqsr) benchmarked on a HPC cluster (A,B—NA12878_PrecisionFDA and NA12878_SRR6794144 datasets; C,D—“synthetic-diploid” ERR1341793 and ERR1341796 datasets; E,F—simulated data based on a random and a user defined mutation profile).
Figure 4 Variant calling runtime of six pipeline combinations (DV_gatk4, DV_dragen3, Dragen3_raw, Dragen3_vqsr, GATK4_raw and GATK4_vqsr) benchmarked on a HPC cluster (A,B—NA12878_PrecisionFDA and NA12878_SRR6794144 datasets; C,D—“synthetic-diploid” ERR1341793 and ERR1341796 datasets; E,F—simulated data based on a random and a user defined mutation profile).CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 42 references

Cited by

See all 121

Metadata

Authors
Zhao, S., Agafonov, O., Azab, A., Stokowy, T., & Hovig, E.
Affiliations
  • Oslo University Hospital (NO)
  • DNV (Norway) (NO)
  • University of Oslo (NO)
  • University of Bergen (NO)
Corresponding author
Hovig, Eivind
Venue
Scientific Reports
Published
2020-11-19
Volume
10
Issue
1
Pages
20222-20222
ISSN
2045-2322 (ISSN-L)
OpenAlex
W3101579057
Cited by
118
References
42
Citations by year
2026: 7 · 2025: 23 · 2024: 22 · 2023: 22 · 2022: 29 · 2021: 13 · 2020: 2
FWCI
5.35
Type
journal article
Language
en
Open access
Licence
Locations
  • Scientific Reports (publishedVersion, cc-by)
  • bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nc-nd)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • NORA - Norwegian Open Research Archives (submittedVersion, cc-by)
Funders
Norges Forskningsråd
Topics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genomics and Rare Diseases
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Associations and Epidemiology
Keywords
germline variant calling, variant calling pipeline, whole genome sequencing, GATK, DRAGEN, DeepVariant, simulated sequencing data, accuracy-efficiency trade-off, clinical genomics
MeSH terms
Whole Genome Sequencing, Humans, Genome, Human, Germ-Line Mutation, Computational Biology, Databases, Genetic, High-Throughput Nucleotide Sequencing

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Accuracy and efficiency of germline variant calling pipelines for human genome data. https://app.cochat.ai/papers/10.1038/s41598-020-77218-4
The paper
Zhao, S., Agafonov, O., Azab, A., Stokowy, T., & Hovig, E. (2020). Accuracy and efficiency of germline variant calling pipelines for human genome data. Scientific Reports. https://doi.org/10.1038/s41598-020-77218-4

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.