Scalability and cost-effectiveness analysis of whole genome-wide association studies on Google Cloud Platform and Amazon Web Services
Open accessThe DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
Objective: Advancements in human genomics have generated a surge of available data, fueling the growth and accessibility of databases for more comprehensive, in-depth genetic studies. Methods: We provide a straightforward and innovative methodology to optimize cloud configuration in order to conduct genome-wide association studies. We utilized Spark clusters on both Google Cloud Platform and Amazon Web Services, as well as Hail (http://doi.org/10.5281/zenodo.2646680) for analysis and exploration of genomic variants dataset. Results: Comparative evaluation of numerous cloud-based cluster configurations demonstrate a successful and unprecedented compromise between speed and cost for performing genome-wide association studies on 4 distinct whole-genome sequencing datasets. Results are consistent across the 2 cloud providers and could be highly useful for accelerating research in genetics. Conclusions: We present a timely piece for one of the most frequently asked questions when moving to the cloud: what is the trade-off between speed and cost?
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Relatedly [13], benchmarked GWAS workflows using Spark Clusters (not NVIDIA Parabricks) on Google Cloud Platform (GCP; using standard n2 machines) and AWS (machines not specified) and found comparable performance between cloud platforms.”
From Accelerating genomic workflows using NVIDIA Parabricks (2023) · cites this paper as [13]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Sequence Alignment/Map format and SAMtools
Li, H., Handsaker, B., Wysoker, A., Fennell, T., Ruan, J., Homer, N., Marth, G., Abecasis, G., Durbin, R., & 1000 Genome Project Data Processing Subgroup (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp352 · Cited by 62,041 · cited 1×
“We combined VCF files using the function merge in bcftools 24 of the dbGap database (see Table 1 and Supplementary Appendix File 1).”
MethodAdvances in Neural Information Processing Systems 19
(2007) · The MIT Press eBooks · doi:10.52202/085713 · Cited by 15,539
Advances in neural information processing systems 7
(1996) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(96)90463-0 · Cited by 14,281
The UK Biobank resource with deep phenotyping and genomic data
Bycroft, C., Freeman, C., Petkova, D., Band, G., Elliott, L. T., Sharp, K., Motyer, A., Vukcevic, D., Delaneau, O., O’Connell, J., et al. (2018) · Nature · doi:10.1038/s41586-018-0579-z · Cited by 8,876
An integrated map of genetic variation from 1,092 human genomes
The 1000 Genomes Project Consortium (2012) · Nature · doi:10.1038/nature11632 · Cited by 7,711
Population Structure and Eigenanalysis
Patterson, N., Price, A. L., & Reich, D. (2006) · PLoS Genetics · doi:10.1371/journal.pgen.0020190 · Cited by 5,280
An integrated map of structural variation in 2,504 human genomes
Sudmant, P. H., Rausch, T., Gardner, E. J., Handsaker, R. E., Abyzov, A., Huddleston, J., Zhang, Y., Ye, K., Jun, G., Hsi-Yang Fritz, M., et al. (2015) · Nature · doi:10.1038/nature15394 · Cited by 2,354
Big Data: Astronomical or Genomical?
Stephens, Z. D., Lee, S. Y., Faghri, F., Campbell, R. H., Zhai, C., Efron, M. J., Iyer, R., Schatz, M. C., Sinha, S., & Robinson, G. E. (2015) · PLOS Biology · doi:10.1371/journal.pbio.1002195 · Cited by 1,340
Howard, D. M., Adams, M. J., Shirali, M., Clarke, T.-K., Marioni, R. E., Davies, G., Coleman, J. R. I., Alloza, C., Shen, X., Barbu, M. C., et al. (2018) · Nature Communications · doi:10.1038/s41467-018-03819-3 · Cited by 612
Searching for SNPs with cloud computing
Langmead, B., Schatz, M. C., Lin, J., Pop, M., & Salzberg, S. L. (2009) · Genome Biology · doi:10.1186/gb-2009-10-11-r134 · Cited by 484
The 100 000 Genomes Project: bringing whole genome sequencing to the NHS
Turnbull, C., Scott, R. H., Thomas, E., Jones, L., Murugaesu, N., Pretty, F. B., Halai, D., Baple, E., Craig, C., Hamblin, A., et al. (2018) · BMJ · doi:10.1136/bmj.k1687 · Cited by 444
Prioritizing diversity in human genomics research
Hindorff, L. A., Bonham, V. L., Brody, L. C., Ginoza, M. E. C., Hutter, C. M., Manolio, T. A., & Green, E. D. (2018) · Nature Reviews Genetics · doi:10.1038/nrg.2017.89 · Cited by 386
Quality Control Procedures for Genome‐Wide Association Studies
Turner, S., Armstrong, L. L., Bradford, Y., Carlson, C. S., Crawford, D. C., Crenshaw, A. T., de Andrade, M., Doheny, K. F., Haines, J. L., Hayes, G., et al. (2011) · Current Protocols in Human Genetics · doi:10.1002/0471142905.hg0119s68 · Cited by 356 · cited 11×
“Overall, total time for GWAS analysis of each data-set was 2 hours, evidencing the high-performance capacity of cloud parallel processing at scale (see Supplementary Appendices 2 and 3).”
MethodInfluentialCloud computing for genomic data analysis and collaboration
Langmead, B., & Nellore, A. (2018) · Nature Reviews Genetics · doi:10.1038/nrg.2017.113 · Cited by 310
The $1,000 genome, the $100,000 analysis?
Mardis, E. R. (2010) · Genome Medicine · doi:10.1186/gm205 · Cited by 241
Lau, J. W., Lehnert, E., Sethi, A., Malhotra, R., Kaushik, G., Onder, Z., Groves-Kirkby, N., Mihajlovic, A., DiGiovanna, J., Srdic, M., et al. (2017) · Cancer Research · doi:10.1158/0008-5472.can-17-0387 · Cited by 170 · cited 1×
“We anticipate that researchers will increasingly utilize cloud computing, especially as the challenges mount around prominent initiatives, such as the 100 000 Genomes Project, the Cancer Genomics Cloud, 28 and the Precision Medicine Initiative.”
MethodGenome-wide rare variant analysis for thousands of phenotypes in over 70,000 exomes from two cohorts
Cirulli, E. T., White, S., Read, R. W., Elhanan, G., Metcalf, W. J., Tanudjaja, F., Fath, D. M., Sandoval, E., Isaksson, M., Schlauch, K. A., et al. (2020) · Nature Communications · doi:10.1038/s41467-020-14288-y · Cited by 139
Cloud computing for comparative genomics
Wall, D. P., Kudtarkar, P., Fusaro, V. A., Pivovarov, R., Patil, P., & Tonellato, P. J. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-259 · Cited by 123
Wiewiórka, M. S., Messina, A., Pacholewska, A., Maffioletti, S., Gawrysiak, P., & Okoniewski, M. J. (2014) · Bioinformatics · doi:10.1093/bioinformatics/btu343 · Cited by 108
Bionimbus: a cloud for managing, analyzing and sharing large genomics datasets
Heath, A. P., Greenway, M., Powell, R., Spring, J., Suarez, R., Hanley, D., Bandlamudi, C., McNerney, M. E., White, K. P., & Grossman, R. L. (2014) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2013-002155 · Cited by 78
Rainbow: a tool for large-scale whole-genome sequencing data analysis using cloud computing
Zhao, S., Prenger, K., Smith, L., Messina, T., Fan, H., Jaeger, E., & Stephens, S. (2013) · BMC Genomics · doi:10.1186/1471-2164-14-425 · Cited by 57
Whole exome sequencing analysis in severe chronic obstructive pulmonary disease
Qiao, D., Ameli, A., Prokopenko, D., Chen, H., Kho, A. T., Parker, M. M., Morrow, J. D., Hobbs, B. D., Liu, Y., Beaty, T. H., et al. (2018) · Human Molecular Genetics · doi:10.1093/hmg/ddy269 · Cited by 37 · cited 1×
“TOPMed focuses on the integration of thousands of whole genomes 7,8 gathered across several studies.”
BackgroundChallenges of Identifying Clinically Actionable Genetic Variants for Precision Medicine
Carter, T. C., & He, M. M. (2016) · Journal of Healthcare Engineering · doi:10.1155/2016/3617572 · Cited by 36 · cited 1×
“27 With an eye toward enabling new biological discovery, we champion the performance benefits provided by the cloud, while emphasizing the boundaries of cluster size and utilization of computational resources.”
BackgroundA Review of Scalable Bioinformatics Pipelines
Fjukstad, B., & Bongo, L. A. (2017) · Data Science and Engineering · doi:10.1007/s41019-017-0047-z · Cited by 36
Lacaze, P. A., Pinese, M., Kaplan, W. H., Stone, A. M., Brion, M., Woods, R. L., McNamara, M., McNeil, J. J., Dinger, M. E., & Thomas, D. M. (2018) · European Journal of Human Genetics · doi:10.1038/s41431-018-0279-z · Cited by 33
Chung, W.-C., Chen, C.-C., Ho, J.-M., Lin, C., Hsu, W., Wang, Y.-C., Lee, D. T., Lai, F., Huang, C., & Chang, Y.-J. (2014) · PLoS ONE · doi:10.1371/journal.pone.0098146 · Cited by 28
GenomeVIP: a cloud platform for genomic variant discovery and interpretationPreprint
Mashl, R. J., Scott, A. D., Huang, K.-L., Wyczalkowski, M. A., Yoon, C. J., Niu, B., DeNardo, E. K., Yellapantula, V. D., Handsaker, R. E., Chen, K., et al. (2017) · Genome Research · doi:10.1101/gr.211656.116 · Cited by 23
Maarala, A. I., Bzhalava, Z., Dillner, J., Heljanko, K., & Bzhalava, D. (2017) · Bioinformatics · doi:10.1093/bioinformatics/btx702 · Cited by 16
Cloud-based interactive analytics for terabytes of genomic variants data
Pan, C., McInnes, G., Deflaux, N. A., Snyder, M. P., Bingham, J., Datta, S., & Tsao, P. S. (2017) · Bioinformatics · doi:10.1093/bioinformatics/btx468 · Cited by 13
Automated quality control for genome wide association studies
Ellingson, S. R., & Fardo, D. W. (2016) · F1000Research · doi:10.12688/f1000research.9271.1 · Cited by 11
Genome-wide rare variant analysis for thousands of phenotypes in 54,000 exomesPreprint
Cirulli, E. T., White, S. J., Read, R. W., et al. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/692368 · Cited by 9
Cited by
Reproducible, scalable, and shareable analysis pipelines with bioinformatics workflow managers
Wratten, L., Wilm, A., & Göke, J. (2021) · Nature Methods · doi:10.1038/s41592-021-01254-9 · Cited by 225
“Scalability of pipe-lines encompasses two aspects: efficient resource management and the ability to handle any size and quantity of input data 35,36 .”
BackgroundAccelerating genomic workflows using NVIDIA Parabricks
O’Connell, K. A., Yosufzai, Z. B., Campbell, R. A., Lobb, C. J., Engelken, H. T., Gorrell, L. M., Carlson, T. B., Catana, J. J., Mikdadi, D., Bonazzi, V. R., et al. (2023) · BMC Bioinformatics · doi:10.1186/s12859-023-05292-2 · Cited by 62
“each variant caller to help optimize the ideal CPU machine type, particularly for designing cloud-based computing clusters [13].”
BackgroundMethodInfluentialAdvances in sustainable biomaterials: characterizations, and applications in medicine
Vinchurkar, K., Bukke, S. P. N., Jain, P., Bhadoria, J., Likhariya, M., Mane, S., Suryawanshi, M. V., Veerabhadrappa, K. V., Eftekhari, Z., & Onohuean, H. (2025) · Discover Polymers. · doi:10.1007/s44347-025-00014-8 · Cited by 58
Yuhong, G., Liu, S.-H., Zhang, Z., Wei, J., Wang, H., Liu, L. N., Bai, Q., Qin, Q., Zhao, C., Zhang, S., et al. (2025) · Plants · doi:10.3390/plants14050671 · Cited by 45
“Due to its nature of relying only on natural occurrences of genetic differences, GWAS is less restrictive to GMO legislation and consequently easier to develop for commercial utilization [83].”
Dementia Prevention in Clinical Practice
Niotis, K., Akiyoshi, K., Carlton, C., & Isaacson, R. (2022) · Seminars in Neurology · doi:10.1055/s-0042-1759580 · Cited by 28
Metadata
- Authors
- Krissaane, I., De Niz, C., Gutiérrez-Sacristán, A., Korodi, G., Ede, N., Kumar, R., Lyons, J., Manrai, A., Patel, C., Kohane, I., & Avillach, P.
- Affiliations
- Harvard University (US)
- Corresponding author
- Avillach, Paul
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2020-07-27
- Volume
- 27
- Issue
- 9
- Pages
- 1425-1430
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC7534581
- OpenAlex
- W3045563287
- Cited by
- 28
- References
- 30
- Citations by year
- 2026: 2 · 2025: 8 · 2024: 1 · 2023: 7 · 2022: 6 · 2021: 3 · 2020: 1
- FWCI
- 4.00
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Journal of the American Medical Informatics Association (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (acceptedVersion)
- Funders
- National Institutes of Health (1OT3OD025466-0)
- National Heart, Lung, and Blood Institute DataSTAGE (1OT3HL142480-01)
- Amazon
- Topics
- Physical Sciences › Computer Science › Information Systems › Cloud Computing and Resource Management
- Social Sciences › Decision Sciences › Information Systems and Management › Scientific Computing and Data Management
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genetics, Bioinformatics, and Biomedical Research
- Keywords
- cloud computing, scalability, cost-effectiveness, Google Cloud Platform, Amazon Web Services, hail, genomic variant data
- MeSH terms
- Cloud Computing, Computer Communication Networks, Cost-Benefit Analysis, Humans, Genomics, Genome-Wide Association Study
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.