Scalability and cost-effectiveness analysis of whole genome-wide association studies on Google Cloud Platform and Amazon Web Services
Open accessThe DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
Objective: Advancements in human genomics have generated a surge of available data, fueling the growth and accessibility of databases for more comprehensive, in-depth genetic studies. Methods: We provide a straightforward and innovative methodology to optimize cloud configuration in order to conduct genome-wide association studies. We utilized Spark clusters on both Google Cloud Platform and Amazon Web Services, as well as Hail (http://doi.org/10.5281/zenodo.2646680) for analysis and exploration of genomic variants dataset. Results: Comparative evaluation of numerous cloud-based cluster configurations demonstrate a successful and unprecedented compromise between speed and cost for performing genome-wide association studies on 4 distinct whole-genome sequencing datasets. Results are consistent across the 2 cloud providers and could be highly useful for accelerating research in genetics. Conclusions: We present a timely piece for one of the most frequently asked questions when moving to the cloud: what is the trade-off between speed and cost?
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Relatedly [13], benchmarked GWAS workflows using Spark Clusters (not NVIDIA Parabricks) on Google Cloud Platform (GCP; using standard n2 machines) and AWS (machines not specified) and found comparable performance between cloud platforms.”
From Accelerating genomic workflows using NVIDIA Parabricks (2023) · cites this paper as [13]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Sequence Alignment/Map format and SAMtools
Li, H., Handsaker, B., Wysoker, A., Fennell, T., Ruan, J., Homer, N., Marth, G., Abecasis, G., Durbin, R., & 1000 Genome Project Data Processing Subgroup (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp352 · Cited by 62,041 · cited 1×
“We combined VCF files using the function merge in bcftools 24 of the dbGap database (see Table 1 and Supplementary Appendix File 1).”
MethodAdvances in Neural Information Processing Systems 19
(2007) · The MIT Press eBooks · doi:10.52202/085713 · Cited by 15,539
Advances in neural information processing systems 7
(1996) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(96)90463-0 · Cited by 14,281
The UK Biobank resource with deep phenotyping and genomic data
Bycroft, C., Freeman, C., Petkova, D., Band, G., Elliott, L. T., Sharp, K., Motyer, A., Vukcevic, D., Delaneau, O., O’Connell, J., et al. (2018) · Nature · doi:10.1038/s41586-018-0579-z · Cited by 8,876
An integrated map of genetic variation from 1,092 human genomes
The 1000 Genomes Project Consortium (2012) · Nature · doi:10.1038/nature11632 · Cited by 7,711
Population Structure and Eigenanalysis
Patterson, N., Price, A. L., & Reich, D. (2006) · PLoS Genetics · doi:10.1371/journal.pgen.0020190 · Cited by 5,280
An integrated map of structural variation in 2,504 human genomes
Sudmant, P. H., Rausch, T., Gardner, E. J., Handsaker, R. E., Abyzov, A., Huddleston, J., Zhang, Y., Ye, K., Jun, G., Hsi-Yang Fritz, M., et al. (2015) · Nature · doi:10.1038/nature15394 · Cited by 2,354
Big Data: Astronomical or Genomical?
Stephens, Z. D., Lee, S. Y., Faghri, F., Campbell, R. H., Zhai, C., Efron, M. J., Iyer, R., Schatz, M. C., Sinha, S., & Robinson, G. E. (2015) · PLOS Biology · doi:10.1371/journal.pbio.1002195 · Cited by 1,340
Howard, D. M., Adams, M. J., Shirali, M., Clarke, T.-K., Marioni, R. E., Davies, G., Coleman, J. R. I., Alloza, C., Shen, X., Barbu, M. C., et al. (2018) · Nature Communications · doi:10.1038/s41467-018-03819-3 · Cited by 612
Searching for SNPs with cloud computing
Langmead, B., Schatz, M. C., Lin, J., Pop, M., & Salzberg, S. L. (2009) · Genome Biology · doi:10.1186/gb-2009-10-11-r134 · Cited by 484
Cited by
Reproducible, scalable, and shareable analysis pipelines with bioinformatics workflow managers
Wratten, L., Wilm, A., & Göke, J. (2021) · Nature Methods · doi:10.1038/s41592-021-01254-9 · Cited by 225
“Scalability of pipe-lines encompasses two aspects: efficient resource management and the ability to handle any size and quantity of input data 35,36 .”
BackgroundAccelerating genomic workflows using NVIDIA Parabricks
O’Connell, K. A., Yosufzai, Z. B., Campbell, R. A., Lobb, C. J., Engelken, H. T., Gorrell, L. M., Carlson, T. B., Catana, J. J., Mikdadi, D., Bonazzi, V. R., et al. (2023) · BMC Bioinformatics · doi:10.1186/s12859-023-05292-2 · Cited by 62
“each variant caller to help optimize the ideal CPU machine type, particularly for designing cloud-based computing clusters [13].”
BackgroundMethodInfluentialAdvances in sustainable biomaterials: characterizations, and applications in medicine
Vinchurkar, K., Bukke, S. P. N., Jain, P., Bhadoria, J., Likhariya, M., Mane, S., Suryawanshi, M. V., Veerabhadrappa, K. V., Eftekhari, Z., & Onohuean, H. (2025) · Discover Polymers. · doi:10.1007/s44347-025-00014-8 · Cited by 58
Yuhong, G., Liu, S.-H., Zhang, Z., Wei, J., Wang, H., Liu, L. N., Bai, Q., Qin, Q., Zhao, C., Zhang, S., et al. (2025) · Plants · doi:10.3390/plants14050671 · Cited by 45
“Due to its nature of relying only on natural occurrences of genetic differences, GWAS is less restrictive to GMO legislation and consequently easier to develop for commercial utilization [83].”
Dementia Prevention in Clinical Practice
Niotis, K., Akiyoshi, K., Carlton, C., & Isaacson, R. (2022) · Seminars in Neurology · doi:10.1055/s-0042-1759580 · Cited by 28
Metadata
- Authors
- Krissaane, I., De Niz, C., Gutiérrez-Sacristán, A., Korodi, G., Ede, N., Kumar, R., Lyons, J., Manrai, A., Patel, C., Kohane, I., & Avillach, P.
- Affiliations
- Harvard University (US)
- Corresponding author
- Avillach, Paul
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2020-07-27
- Volume
- 27
- Issue
- 9
- Pages
- 1425-1430
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC7534581
- OpenAlex
- W3045563287
- Cited by
- 28
- References
- 30
- Citations by year
- 2026: 2 · 2025: 8 · 2024: 1 · 2023: 7 · 2022: 6 · 2021: 3 · 2020: 1
- FWCI
- 4.00
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Journal of the American Medical Informatics Association (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (acceptedVersion)
- Funders
- National Institutes of Health (1OT3OD025466-0)
- National Heart, Lung, and Blood Institute DataSTAGE (1OT3HL142480-01)
- Amazon
- Topics
- Physical Sciences › Computer Science › Information Systems › Cloud Computing and Resource Management
- Social Sciences › Decision Sciences › Information Systems and Management › Scientific Computing and Data Management
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genetics, Bioinformatics, and Biomedical Research
- Keywords
- cloud computing, scalability, cost-effectiveness, Google Cloud Platform, Amazon Web Services, hail, genomic variant data
- MeSH terms
- Cloud Computing, Computer Communication Networks, Cost-Benefit Analysis, Humans, Genomics, Genome-Wide Association Study
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.