Combining Multiple Hypothesis Testing with Machine Learning Increases the Statistical Power of Genome-wide Association Studies
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
The standard approach to the analysis of genome-wide association studies (GWAS) is based on testing each position in the genome individually for statistical significance of its association with the phenotype under investigation. To improve the analysis of GWAS, we propose a combination of machine learning and statistical testing that takes correlation structures within the set of SNPs under investigation in a mathematically well-controlled manner into account. The novel two-step algorithm, COMBI, first trains a support vector machine to determine a subset of candidate SNPs and then performs hypothesis tests for these SNPs together with an adequate threshold correction. Applying COMBI to data from a WTCCC study (2007) and measuring performance as replication by independent GWAS published within the 2008–2015 period, we show that our method outperforms ordinary raw p -value thresholding as well as other state-of-the-art methods. COMBI presents higher power and precision than the examined alternatives while yielding fewer false ( i.e . non-replicated) and more true ( i.e . replicated) discoveries when its results are validated on later GWAS studies. More than 80% of the discoveries made by COMBI upon WTCCC data have been validated by independent studies. Implementations of the COMBI method are available as a part of the GWASpi toolbox 2.0.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Agresti, A. (2002) · Wiley Series in Probability and Statistics · doi:10.1002/0471249688 · Cited by 6,746
Hindorff, L. A., Sethupathy, P., Junkins, H. A., Ramos, E. M., Mehta, J. P., Collins, F. S., & Manolio, T. A. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0903103106 · Cited by 4,013
The NHGRI GWAS Catalog, a curated resource of SNP-trait associations
Welter, D., MacArthur, J., Morales, J., Burdett, T., Hall, P., Junkins, H., Klemm, A., Flicek, P., Manolio, T., Hindorff, L., et al. (2014) · Nucleic Acids Research · doi:10.1093/nar/gkt1229 · Cited by 2,707 · cited 2×
“Additive, infinitesimal models have been shown to work well in the research area of quantitative genetics and, indeed, most GWAS hits seem to behave additively 7,8,9 .”
BackgroundMethodVisscher, P. M., Brown, M. A., McCarthy, M. I., & Yang, J. (2012) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2011.11.029 · Cited by 2,425
The mystery of missing heritability: Genetic interactions create phantom heritability
Zuk, O., Hechter, E., Sunyaev, S. R., & Lander, E. S. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1119675109 · Cited by 1,542
Efficient Bayesian mixed-model analysis increases association power in large cohorts
Loh, P.-R., Tucker, G., Bulik-Sullivan, B. K., Vilhjálmsson, B. J., Finucane, H. K., Salem, R. M., Chasman, D. I., Ridker, P. M., Neale, B. M., Berger, B., et al. (2015) · Nature Genetics · doi:10.1038/ng.3190 · Cited by 1,507
Genome-wide association analysis identifies 13 new risk loci for schizophrenia
Multicenter Genetic Studies of Schizophrenia Consortium, Ripke, S., Psychosis Endophenotypes International Consortium, Wellcome Trust Case Control Consortium 2, O'Dushlaine, C., Chambert, K., Moran, J. L., Kähler, A. K., Akterin, S., Bergen, S. E., et al. (2013) · Nature Genetics · doi:10.1038/ng.2742 · Cited by 1,496
Analysis of immune-related loci identifies 48 new susceptibility variants for multiple sclerosis
International Multiple Sclerosis Genetics Consortium (IMSGC) (2013) · Nature Genetics · doi:10.1038/ng.2770 · Cited by 1,386 · cited 2×
“Most importantly it is the standard model in the field of SNP effect estimation, genome risk score computation and other related problems 5,6 .”
Rare and common variants: twenty arguments
Gibson, G. (2012) · Nature Reviews Genetics · doi:10.1038/nrg3118 · Cited by 1,278 · cited 3×
“In order to investigate and compare performance of the COMBI method to other machine learning approaches, the work of Roshan et al. 30 , Wasserman and Roeder 27 and Meinshausen et al. 26 are selected as representative baseline methods.”
MethodFaST linear mixed models for genome-wide association studies
Lippert, C., Listgarten, J., Liu, Y., Kadie, C. M., Davidson, R. I., & Heckerman, D. (2011) · Nature Methods · doi:10.1038/nmeth.1681 · Cited by 1,209 · cited 3×
“Alternatively, one could perform a different statistical test in the final step of the COMBI method, such as procedures correcting for population structures or other confounding factors 72,77 .”
MethodResultInfluentialEstimating Missing Heritability for Disease from Genome-wide Association Studies
Lee, S. H., Wray, N. R., Goddard, M. E., & Visscher, P. M. (2011) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2011.02.002 · Cited by 1,064 · cited 5×
“The proposed COMBI method is compared to the standard RPVT procedure using a Westfall-Young correction as well as the approach of Meinshausen et al. 10 (which itself is an extension of the method of Wasserman and Roeder 11 ).”
BackgroundMethodInfluentialEfficient multivariate linear mixed model algorithms for genome-wide association studies
Zhou, X., & Stephens, M. (2014) · Nature Methods · doi:10.1038/nmeth.2848 · Cited by 841
Beyond GWASs: Illuminating the Dark Road from Association to Function
Edwards, S. L., Beesley, J., French, J. D., & Dunning, A. M. (2013) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2013.10.012 · Cited by 784 · cited 3×
“, wd according to (3) 3: let w*(k) denote the k-th largest of the wj’s in absolute value and re-number the corresponding positions from 1, .”
BackgroundMethodThe genetic interpretation of area under the ROC curve in genomic profiling
Wray, N. R., Yang, J., Goddard, M. E., & Visscher, P. M. (2010) · PLoS Genetics · doi:10.1371/journal.pgen.1000864 · Cited by 334
On safari to Random Jungle: a fast implementation of Random Forests for high-dimensional data
Schwarz, D. F., König, I. R., & Ziegler, A. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq257 · Cited by 269
Association screening of common and rare genetic variants by penalized regression
Zhou, H., Sehl, M. E., Sinsheimer, J. S., & Lange, K. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq448 · Cited by 137
Cited by
Biomarkers in Lung Cancer Screening: Achievements, Promises, and Challenges
Seijo, L. M., Peled, N., Ajona, D., Boeri, M., Field, J. K., Sozzi, G., Pio, R., Zulueta, J. J., Spira, A., Massion, P. P., et al. (2019) · Journal of Thoracic Oncology · doi:10.1016/j.jtho.2018.11.023 · Cited by 539
Nicholls, H. L., John, C. R., Watson, D. S., Munroe, P. B., Barnes, M. R., & Cabrera, C. P. (2020) · Frontiers in Genetics · doi:10.3389/fgene.2020.00350 · Cited by 155
Artificial intelligence for dementia genetics and omics
Bettencourt, C., Skene, N., Bandres‐Ciga, S., Anderson, E., Winchester, L. M., Foote, I. F., Schwartzentruber, J., Botia, J. A., Nalls, M., Singleton, A., et al. (2023) · Alzheimer's & Dementia · doi:10.1002/alz.13427 · Cited by 30
Social-Science Genomics: Progress, Challenges, and Future Directions
Benjamin, D., Cesarini, D., Turley, P., & Young, A. S. (2024) · doi:10.3386/w32404 · Cited by 20
Metadata
- Authors
- Mieth, B., Kloft, M., Rodríguez, J. A., Sonnenburg, S., Vobruba, R., Morcillo-Suárez, C., Farré, X., Marigorta, U. M., Fehr, E., Dickhaus, T., Blanchard, G., Schunk, D., Navarro, A., & Müller, K.-R.
- Venue
- Scientific Reports
- Published
- 2016-11-28
- Volume
- 6
- Issue
- 1
- Pages
- 36671-36671
- ISSN
- 2045-2322 (ISSN-L)
- OpenAlex
- W2558493806
- Cited by
- 80
- References
- 18
- FWCI
- 4.40
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.