Scalability and cost-effectiveness analysis of whole genome-wide association studies on Google Cloud Platform and Amazon Web Services
Open accessThe DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
Objective: Advancements in human genomics have generated a surge of available data, fueling the growth and accessibility of databases for more comprehensive, in-depth genetic studies. Methods: We provide a straightforward and innovative methodology to optimize cloud configuration in order to conduct genome-wide association studies. We utilized Spark clusters on both Google Cloud Platform and Amazon Web Services, as well as Hail (http://doi.org/10.5281/zenodo.2646680) for analysis and exploration of genomic variants dataset. Results: Comparative evaluation of numerous cloud-based cluster configurations demonstrate a successful and unprecedented compromise between speed and cost for performing genome-wide association studies on 4 distinct whole-genome sequencing datasets. Results are consistent across the 2 cloud providers and could be highly useful for accelerating research in genetics. Conclusions: We present a timely piece for one of the most frequently asked questions when moving to the cloud: what is the trade-off between speed and cost?
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Relatedly [13], benchmarked GWAS workflows using Spark Clusters (not NVIDIA Parabricks) on Google Cloud Platform (GCP; using standard n2 machines) and AWS (machines not specified) and found comparable performance between cloud platforms.”
From Accelerating genomic workflows using NVIDIA Parabricks (2023) · cites this paper as [13]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Sequence Alignment/Map format and SAMtools
Li, H., Handsaker, B., Wysoker, A., Fennell, T., Ruan, J., Homer, N., Marth, G., Abecasis, G., Durbin, R., & 1000 Genome Project Data Processing Subgroup (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp352 · Cited by 62,041 · cited 1×
“We combined VCF files using the function merge in bcftools 24 of the dbGap database (see Table 1 and Supplementary Appendix File 1).”
MethodAdvances in Neural Information Processing Systems 19
(2007) · The MIT Press eBooks · doi:10.52202/085713 · Cited by 15,539
Advances in neural information processing systems 7
(1996) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(96)90463-0 · Cited by 14,281
The UK Biobank resource with deep phenotyping and genomic data
Bycroft, C., Freeman, C., Petkova, D., Band, G., Elliott, L. T., Sharp, K., Motyer, A., Vukcevic, D., Delaneau, O., O’Connell, J., et al. (2018) · Nature · doi:10.1038/s41586-018-0579-z · Cited by 8,876
An integrated map of genetic variation from 1,092 human genomes
The 1000 Genomes Project Consortium (2012) · Nature · doi:10.1038/nature11632 · Cited by 7,711
Population Structure and Eigenanalysis
Patterson, N., Price, A. L., & Reich, D. (2006) · PLoS Genetics · doi:10.1371/journal.pgen.0020190 · Cited by 5,280
An integrated map of structural variation in 2,504 human genomes
Sudmant, P. H., Rausch, T., Gardner, E. J., Handsaker, R. E., Abyzov, A., Huddleston, J., Zhang, Y., Ye, K., Jun, G., Hsi-Yang Fritz, M., et al. (2015) · Nature · doi:10.1038/nature15394 · Cited by 2,354
Big Data: Astronomical or Genomical?
Stephens, Z. D., Lee, S. Y., Faghri, F., Campbell, R. H., Zhai, C., Efron, M. J., Iyer, R., Schatz, M. C., Sinha, S., & Robinson, G. E. (2015) · PLOS Biology · doi:10.1371/journal.pbio.1002195 · Cited by 1,340
Howard, D. M., Adams, M. J., Shirali, M., Clarke, T.-K., Marioni, R. E., Davies, G., Coleman, J. R. I., Alloza, C., Shen, X., Barbu, M. C., et al. (2018) · Nature Communications · doi:10.1038/s41467-018-03819-3 · Cited by 612
Searching for SNPs with cloud computing
Langmead, B., Schatz, M. C., Lin, J., Pop, M., & Salzberg, S. L. (2009) · Genome Biology · doi:10.1186/gb-2009-10-11-r134 · Cited by 484
Cited by
Reproducible, scalable, and shareable analysis pipelines with bioinformatics workflow managers
Wratten, L., Wilm, A., & Göke, J. (2021) · Nature Methods · doi:10.1038/s41592-021-01254-9 · Cited by 225
“Scalability of pipe-lines encompasses two aspects: efficient resource management and the ability to handle any size and quantity of input data 35,36 .”
BackgroundAccelerating genomic workflows using NVIDIA Parabricks
O’Connell, K. A., Yosufzai, Z. B., Campbell, R. A., Lobb, C. J., Engelken, H. T., Gorrell, L. M., Carlson, T. B., Catana, J. J., Mikdadi, D., Bonazzi, V. R., et al. (2023) · BMC Bioinformatics · doi:10.1186/s12859-023-05292-2 · Cited by 62
“each variant caller to help optimize the ideal CPU machine type, particularly for designing cloud-based computing clusters [13].”
BackgroundMethodInfluentialAdvances in sustainable biomaterials: characterizations, and applications in medicine
Vinchurkar, K., Bukke, S. P. N., Jain, P., Bhadoria, J., Likhariya, M., Mane, S., Suryawanshi, M. V., Veerabhadrappa, K. V., Eftekhari, Z., & Onohuean, H. (2025) · Discover Polymers. · doi:10.1007/s44347-025-00014-8 · Cited by 58
Yuhong, G., Liu, S.-H., Zhang, Z., Wei, J., Wang, H., Liu, L. N., Bai, Q., Qin, Q., Zhao, C., Zhang, S., et al. (2025) · Plants · doi:10.3390/plants14050671 · Cited by 45
“Due to its nature of relying only on natural occurrences of genetic differences, GWAS is less restrictive to GMO legislation and consequently easier to develop for commercial utilization [83].”
Dementia Prevention in Clinical Practice
Niotis, K., Akiyoshi, K., Carlton, C., & Isaacson, R. (2022) · Seminars in Neurology · doi:10.1055/s-0042-1759580 · Cited by 28
Knosp, B. M., Craven, C. K., Dorr, D. A., Bernstam, E. V., & Campion, T. R. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab256 · Cited by 27
Building a collaborative cloud platform to accelerate heart, lung, blood, and sleep research
Ahalt, S. C., Avillach, P., Boyles, R., Bradford, K., Cox, S., Davis‐Dusenbery, B. N., Grossman, R. L., Krishnamurthy, A. K., Manning, A. K., Paten, B., et al. (2023) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocad048 · Cited by 28
Self-citationTranscriptomics and epigenetic data integration learning module on Google Cloud
Ruprecht, N. A., Kennedy, J. D., Bansal, B., Singhal, S., Sens, D. A., Maggio, A., Doe, V., Hawkins, D., Campbel, R., O’Connell, K. A., et al. (2024) · Briefings in Bioinformatics · doi:10.1093/bib/bbae352 · Cited by 16
“…flexibility of GC’s computational resources (and integrated tools for collaboration and storing and visualizingdata) enable the analysis and processing of information by investigators to be performed expediently and at reasonable expense [23], making GC a robust bioinformatics research platform.”
BackgroundMaking genomic data FAIR through effective Data Portals
Speir, M. L., Teh, W. K., Perry, M. D., Schwartz, R., Nejad, P., Harris, T., Fischer, C., Diekhans, M., Lee, B. T., Paten, B., et al. (2025) · Scientific Data · doi:10.1038/s41597-025-06142-x · Cited by 8
Kiryu, Y. (2023) · YAKUGAKU ZASSHI · doi:10.1248/yakushi.22-00179-4 · Cited by 6
Cloud Platforms and Technologies for Big Satellite Data Processing
Kussul, N., Шелестов, А. Ю., & Яйлимов, Б. Я. (2023) · Lecture notes in networks and systems · doi:10.1007/978-3-031-46880-3_19 · Cited by 4
Accelerating genomic workflows using NVIDIA ParabricksPreprint
O’Connell, K. A., Yosufzai, Z. B., Campbell, R. A., Lobb, C. J., Engelken, H. T., Gorrell, L. M., Carlson, T. B., Catana, J. J., Mikdadi, D., Bonazzi, V. R., et al. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.07.20.498972 · Cited by 4
Ibrahim, S., Yue, C., Yang, C., Yiting, R., Xie, B., Yang, Q., Mkuye, R., Liang, H., & Deng, Y. (2025) · Annals of Animal Science · doi:10.2478/aoas-2025-0078 · Cited by 6
“…services (e.g., AWS, Google Cloud) offer potential solutions, their implementation remains cost-prohibitive for routine aquaculture applications (Krissaane et al., 2020), with many operations lacking funding for essential bioinformatics software licenses and HPC access (Rana et al., 2020).”
Data Innovation Provides a Smooth Road to Production: Bioinformatics Needs to Accelerate
Dwight, Z. (2021) · Clinical Chemistry · doi:10.1093/clinchem/hvab247 · Cited by 3
Asadi, M., & Karimian, Z. (2025) · Health Science Reports · doi:10.1002/hsr2.71171 · Cited by 6
“It enables simultaneous assessment of many learners without compromising quality, and often results in lower costs than traditional methods [11, 12].”
A Web/Cloud based Digital Pathology Platform Framework for AI Development and DeploymentPreprint
Akkus, Z., Dangott, B. J., & Nassar, A. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.11.04.514741 · Cited by 6
“We built a web/cloud based digital pathology platform that allows slide storage and management in local and remote sites, slide viewing and annotation through a web viewer 9,10 , and development and deployment of AI models through google cloud computing services 11 .”
MethodGalema, J. E. L. (2025) · International Journal of Research Publications · doi:10.47119/ijrp1001731520257963 · Cited by 1
Cloud-native distributed genomic pileup operations
Wiewiórka, M. S., Szmurło, A., Stankiewicz, P., & Gambin, T. (2022) · Bioinformatics · doi:10.1093/bioinformatics/btac804 · Cited by 1
“SeQuiLa has been successfully deployed to both popular managed Hadoop services like Google Dataproc (utilized also in Krissaane et al. , 2020 and managed Kubernetes services like Google Kubernetes Engine (GKE) or Azure Kubernetes Service.”
MethodArtificial Intelligence Industry and the Domain of Life Sciences
Ghosh, S., & Dasgupta, R. (2022) · Springer eBooks · doi:10.1007/978-981-16-8881-2_19 · Cited by 1
Oyola, S. O. (2023) · Research Square · doi:10.21203/rs.3.rs-3457875/v1 · Cited by 1
Pardo-García, C. E., Diaz-Leal, N. R., & Gómez-Llanez, C. Y. (2020) · Aibi revista de investigación administración e ingeniería · doi:10.15649/2346030x.734
“Equipos en la Nube ● Equipo servidor para el soporte del sistema operativo y el software PBX. Configurado en la nube aprovechando los servicios con que cuenta la UFPS con Amazon Cloud AWS [28].”
BackgroundInfluentialRavele, K. J., & Mtotywa, M. M. (2022) · International Journal of Research in Business and Social Science (2147-4478) · doi:10.20525/ijrbs.v11i7.2027 · Cited by 2
Panduro, P. R. C. (2023) · Revista de Climatología · doi:10.59427/rcli/2023/v23cs.1527-1543 · Cited by 1
Aguilar, P., Salazar, C. M. N., Rodriguez, L., & Chango, W. G. (2025) · Lecture notes in networks and systems · doi:10.1007/978-3-031-87704-9_28
Baker, J. N., Stricker, E., Coleman, J. R., Ketkar, S., Tan, T., Butler, A. M., Williams, L. C., Hammonds-Odie, L. P., Murray, D., Lee, B., et al. (2025) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2025.06.018 · Cited by 1
Additional file 1 of Accelerating genomic workflows using NVIDIA Parabricks
O’Connell, K. A., Yosufzai, Z., Campbell, R. A., Lobb, C. J., Engelken, H. T., Gorrell, L., Carlson, T. B., Catana, J. J., Mikdadi, D., Bonazzi, V. R., et al. (2023) · Figshare · doi:10.6084/m9.figshare.23273428
Montalvo‐Ortiz, J. L., Martínez‐Magaña, J. J., Brito, D. E. A., Trichia, E., Rivera-Hernández, M., Porras, L. M., Sullivan, K. A., Jacobson, D., Kember, R. L., Núñez, D., et al. (2026) · Research Square · doi:10.21203/rs.3.rs-8789707/v1
GROMTools: scalable individual-level GReX imputation for mega-biobank-scale cohorts
Anyfantakis, M., Venkatesh, S., Bennett, J. J. R., Liu, C., Hoffman, G. E., Roussos, P., & Voloudakis, G. (2026) · Bioinformatics · doi:10.1093/bioinformatics/btag719
“In shared and fee-for-service settings, runtime, memory use, and I/O thus directly affect both cost and through-put (Krissaane et al. 2020; McDonald et al. 2012).”
Metadata
- Authors
- Krissaane, I., De Niz, C., Gutiérrez-Sacristán, A., Korodi, G., Ede, N., Kumar, R., Lyons, J., Manrai, A., Patel, C., Kohane, I., & Avillach, P.
- Affiliations
- Harvard University (US)
- Corresponding author
- Avillach, Paul
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2020-07-27
- Volume
- 27
- Issue
- 9
- Pages
- 1425-1430
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC7534581
- OpenAlex
- W3045563287
- Cited by
- 28
- References
- 30
- Citations by year
- 2026: 2 · 2025: 8 · 2024: 1 · 2023: 7 · 2022: 6 · 2021: 3 · 2020: 1
- FWCI
- 4.00
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Journal of the American Medical Informatics Association (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (acceptedVersion)
- Funders
- National Institutes of Health (1OT3OD025466-0)
- National Heart, Lung, and Blood Institute DataSTAGE (1OT3HL142480-01)
- Amazon
- Topics
- Physical Sciences › Computer Science › Information Systems › Cloud Computing and Resource Management
- Social Sciences › Decision Sciences › Information Systems and Management › Scientific Computing and Data Management
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genetics, Bioinformatics, and Biomedical Research
- Keywords
- cloud computing, scalability, cost-effectiveness, Google Cloud Platform, Amazon Web Services, hail, genomic variant data
- MeSH terms
- Cloud Computing, Computer Communication Networks, Cost-Benefit Analysis, Humans, Genomics, Genome-Wide Association Study
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.