Replicability and Prediction: Lessons and Challenges from GWAS
Open accessThe DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Abstract
Since the publication of the Wellcome Trust Case Control Consortium (WTCCC) landmark study a decade ago, genome-wide association studies (GWAS) have led to the discovery of thousands of risk variants involved in disease aetiology. This successful story has two angles that are often overlooked. First, GWAS findings are highly replicable. This is an unprecedented phenomenon in complex trait genetics, and indeed in many areas of science, which in past decades had been plagued by false positives. At a time of increasing concerns about the lack of reproducibility, we examine the biological and methodological reasons that account for the replicability of GWAS and identify the challenges ahead. In contrast to the exemplary success at disease gene discovery, at present GWAS findings are not useful to predict phenotypes. We close with an overview of the prospects for individualized prediction of disease risk and its foreseeable impact in clinical practice.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Genome-wide association study of 14,000 cases of seven common diseases and 3,000 shared controls
The Wellcome Trust Case Control Consortium, Management Committee, Burton, P. R., Clayton, D. G., Cardon, L. R., Craddock, N., Deloukas, P., Duncanson, A., Kwiatkowski, D. P., McCarthy, M. I., et al. (2007) · Nature · doi:10.1038/nature05911 · Cited by 9,442
Influence of life stress on depression: moderation by a polymorphism in the 5-HTT gene
Caspi, A., Sugden, K., Moffitt, T. E., Taylor, A., Craig, I. W., Harrington, H., McClay, J., Mill, J., Martin, J., Braithwaite, A., et al. (2003) · Science · doi:10.1126/science.1083968 · Cited by 8,120
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 1×
“This degree of success is an unprecedented phenomenon in the field of complex trait genetics and, even more generally, in many scientific fields [5], which some argue are plagued by false positive findings that generate a sense of “Replicability Crisis” that may be fuel for anti-science movements [6].”
BackgroundComplement factor H polymorphism in age-related macular degeneration
Klein, R. J., Zeiss, C., Chew, E. Y., Tsai, J.-Y., Sackler, R. S., Haynes, C., Henning, A. K., SanGiovanni, J. P., Mane, S. M., Mayne, S. T., et al. (2005) · Science · doi:10.1126/science.1109557 · Cited by 4,492
10 Years of GWAS Discovery: Biology, Function, and Translation
Visscher, P. M., Wray, N. R., Zhang, Q., Sklar, P., McCarthy, M. I., Brown, M. A., & Yang, J. (2017) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2017.06.005 · Cited by 3,719 · cited 3×
“They have revolutionized human genetics with the discovery of thousands of alleles that influence disease risk [1].”
BackgroundMethodAn Expanded View of Complex Traits: From Polygenic to Omnigenic
Boyle, E. A., Li, Y. I., & Pritchard, J. K. (2017) · Cell · doi:10.1016/j.cell.2017.05.038 · Cited by 2,851
Genome-wide association analysis identifies loci for type 2 diabetes and triglyceride levels
Saxena, R., Voight, B. F., Lyssenko, V., Burtt, N. P., de Bakker, P. I. W., Chen, H., Roix, J. J., Kathiresan, S., Hirschhorn, J. N., Daly, M. J., et al. (2007) · Science · doi:10.1126/science.1142358 · Cited by 2,843
Redefine statistical significance
Benjamin, D. J., Berger, J. O., Johannesson, M., Nosek, B. A., Wagenmakers, E.-J., Berk, R., Bollen, K. A., Brembs, B., Brown, L., Camerer, C., et al. (2017) · Nature Human Behaviour · doi:10.1038/s41562-017-0189-z · Cited by 2,772
A genome-wide association study of type 2 diabetes in Finns detects multiple susceptibility variants
Scott, L. J., Mohlke, K. L., Bonnycastle, L. L., Willer, C. J., Li, Y., Duren, W. L., Erdos, M. R., Stringham, H. M., Chines, P. S., Jackson, A. U., et al. (2007) · Science · doi:10.1126/science.1142382 · Cited by 2,753
Integrative approaches for large-scale transcriptome-wide association studies
Gusev, A., Ko, A., Shi, H., Bhatia, G., Chung, W., Penninx, B. W. J. H., Jansen, R., de Geus, E. J. C., Boomsma, D. I., Wright, F. A., et al. (2016) · Nature Genetics · doi:10.1038/ng.3506 · Cited by 2,479
Visscher, P. M., Brown, M. A., McCarthy, M. I., & Yang, J. (2012) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2011.11.029 · Cited by 2,425
Lohmueller, K. E., Pearce, C. L., Pike, M., Lander, E. S., & Hirschhorn, J. N. (2003) · Nature Genetics · doi:10.1038/ng1071 · Cited by 1,900 · cited 1×
“For over two decades, the literature in medical genetics has been tormented by promising but later discredited discoveries [32, 33].”
BackgroundThe Electronic Medical Records and Genomics (eMERGE) Consortium, Wood, A. R., The MIGen Consortium, The PAGE Consortium, Study, T. L. C., Esko, T., Yang, J., Vedantam, S., Pers, T. H., Gustafsson, S., et al. (2014) · Nature Genetics · doi:10.1038/ng.3097 · Cited by 1,853 · cited 2×
“For instance, the 2014 meta-analysis for height by the GIANT consortium focused on the overall concordance of effects between discovery and independent cohorts [47].”
BackgroundMethodPersonal genomes: The case of the missing heritability
Maher, B. (2008) · Nature · doi:10.1038/456018a · Cited by 1,737
A comprehensive review of genetic association studies
Hirschhorn, J. N., Lohmueller, K., Byrne, E., & Hirschhorn, K. (2002) · Genetics in Medicine · doi:10.1097/00125817-200203000-00002 · Cited by 1,674 · cited 3×
“Many factors have contributed to the poor track record of candidate-gene reproducibility, including insufficient availability of genetic markers, inadequate handling of population structure, lack of statistical power due to low sample size, improper control of multiple testing and extensive publication bias [32].”
BackgroundHuman Demographic History Impacts Genetic Risk Prediction across Diverse Populations
Martin, A. R., Gignoux, C. R., Walters, R. K., Wojcik, G. L., Neale, B. M., Gravel, S., Daly, M. J., Bustamante, C. D., & Kenny, E. E. (2017) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2017.03.004 · Cited by 1,391
Replicating genotype–phenotype associations
NCI-NHGRI Working Group on Replication in Association Studies, Chanock, S. J., Manolio, T., Boehnke, M., Boerwinkle, E., Hunter, D. J., Thomas, G., Hirschhorn, J. N., Abecasis, G., Altshuler, D., et al. (2007) · Nature · doi:10.1038/447655a · Cited by 1,352
Modeling Linkage Disequilibrium Increases Accuracy of Polygenic Risk Scores
Vilhjálmsson, B. J., Yang, J., Finucane, H. K., Gusev, A., Lindström, S., Ripke, S., Genovese, G., Loh, P.-R., Bhatia, G., Do, R., et al. (2015) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2015.09.001 · Cited by 1,303
Multi-trait analysis of genome-wide association summary statistics using MTAG
23andMe Research Team, Turley, P., Social Science Genetic Association Consortium, Walters, R. K., Maghzian, O., Okbay, A., Lee, J. J., Fontana, M. A., Nguyen-Viet, T. A., Wedow, R., et al. (2018) · Nature Genetics · doi:10.1038/s41588-017-0009-4 · Cited by 1,112 · cited 1×
“Among others, a flurry of new methods is already using publicly available summary statistics from large studies [51], incorporating evidence from LD patterns to refine the effect size estimates (instead of simply focusing on the most significant variant for each associate loci) [52], and more recently, combining assoc…”
MethodSparse whole-genome sequencing identifies two loci for major depressive disorder
CONVERGE consortium, Cai, N., Bigdeli, T. B., Kretzschmar, W., Li, Y., Liang, J., Song, L., Hu, J., Li, Q., Jin, W., et al. (2015) · Nature · doi:10.1038/nature14659 · Cited by 864
Szucs, D., & Ioannidis, J. P. A. (2017) · PLOS Biology · doi:10.1371/journal.pbio.2000797 · Cited by 761
Study, T. L. C., Yang, J., Bakshi, A., Zhu, Z., Hemani, G., Vinkhuyzen, A. A. E., Lee, S. H., Robinson, M. R., Perry, J. R. B., Nolte, I. M., et al. (2015) · Nature Genetics · doi:10.1038/ng.3390 · Cited by 745 · cited 1×
“The cost-effectiveness of SNP array genotyping followed by imputation suggests that GWAS will remain for quite some time as the main instrument to detect loci associated with complex traits [1, 41].”
BackgroundPervasive Sharing of Genetic Effects in Autoimmune Disease
Cotsapas, C., Voight, B. F., Rossin, E., Lage, K., Neale, B. M., Wallace, C., Abecasis, G. R., Barrett, J. C., Behrens, T., Cho, J., et al. (2011) · PLoS Genetics · doi:10.1371/journal.pgen.1002254 · Cited by 606 · cited 1×
“For instance, the convergence in associated loci confirms that a large proportion of the genetic risk for immune diseases is shared across conditions [24, 25].”
BackgroundTop 10 Replicated Findings From Behavioral Genetics
Plomin, R., DeFries, J. C., Knopik, V. S., & Neiderhiser, J. M. (2016) · Perspectives on Psychological Science · doi:10.1177/1745691615617439 · Cited by 517 · cited 1×
“In short, ‘there is consensus in science that the final arbiter is replication’ [7].”
BackgroundLuciano, M., Hagenaars, S. P., Davies, G., Hill, W. D., Clarke, T.-K., Shirali, M., Harris, S. E., Marioni, R. E., Liewald, D. C., Fawns-Ritchie, C., et al. (2018) · Nature Genetics · doi:10.1038/s41588-017-0013-8 · Cited by 391
The False-positive to False-negative Ratio in Epidemiologic Studies
Ioannidis, J. P. A., Tarone, R., & McLaughlin, J. K. (2011) · Epidemiology · doi:10.1097/ede.0b013e31821b506e · Cited by 321 · cited 1×
“These studies in particular have been characterized by high rates of false positives [34].”
BackgroundPatil, P., Peng, R. D., & Leek, J. T. (2016) · Perspectives on Psychological Science · doi:10.1177/1745691616646366 · Cited by 243
Waters, K. M., Stram, D. O., Hassanein, M. T., Le Marchand, L., Wilkens, L. R., Maskarinec, G., Monroe, K. R., Kolonel, L. N., Altshuler, D., Henderson, B. E., et al. (2010) · PLoS Genetics · doi:10.1371/journal.pgen.1001078 · Cited by 191 · cited 1×
“Early analyses of the PAGE multi-ethnic case-control cohorts reported a perfect concordance in risk allele directions at risk SNPs for prostate cancer and type 2 diabetes [12, 13].”
BackgroundAn estimate of the science-wise false discovery rate and application to the top medical literature
Jager, L. R., & Leek, J. T. (2014) · Biostatistics · doi:10.1093/biostatistics/kxt007 · Cited by 179
Transcriptional risk scores link GWAS to eQTLs and predict complications in Crohn's disease
Marigorta, U. M., Denson, L. A., Hyams, J. S., Mondal, K., Prince, J., Walters, T. D., Griffiths, A., Noe, J. D., Crandall, W. V., Rosh, J. R., et al. (2017) · Nature Genetics · doi:10.1038/ng.3936 · Cited by 166 · cited 2×
“• Although the success of GWAS has not translated into an ability to predict phenotypes based on genetic markers, polygenic and transcriptional risk scores (PRS and TRS) hold potential for stratification according to risk.”
MethodSelf-citationSiontis, K. C. M., Patsopoulos, N. A., & Ioannidis, J. P. A. (2010) · European Journal of Human Genetics · doi:10.1038/ejhg.2010.26 · Cited by 117
Waters, K. M., Le Marchand, L., Kolonel, L. N., Monroe, K. R., Stram, D. O., Henderson, B. E., & Haiman, C. A. (2009) · Cancer Epidemiology, Biomarkers & Prevention · doi:10.1158/1055-9965.epi-08-1142 · Cited by 116 · cited 1×
“Early analyses of the PAGE multi-ethnic case-control cohorts reported a perfect concordance in risk allele directions at risk SNPs for prostate cancer and type 2 diabetes [12, 13].”
BackgroundHernandez Cordero, A. I., Gonzales, N. M., Parker, C. C., Sokolof, G., Vandenbergh, D. J., Cheng, R., Abney, M., Sko, A., Douglas, A., Palmer, A. A., et al. (2019) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2019.10.014 · Cited by 59
Cited by
Update on NAFLD genetics: From new variants to the clinic
Trépo, E., & Valenti, L. (2020) · Journal of Hepatology · doi:10.1016/j.jhep.2020.02.020 · Cited by 393
Phylogenetics is the new genetics (for most of biodiversity)
Smith, S. D., Pennell, M. W., Dunn, C. W., & Edwards, S. V. (2020) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2020.01.005 · Cited by 155
Hernandez Cordero, A. I., Gonzales, N. M., Parker, C. C., Sokolof, G., Vandenbergh, D. J., Cheng, R., Abney, M., Sko, A., Douglas, A., Palmer, A. A., et al. (2019) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2019.10.014 · Cited by 59
Behera, S., Belyeu, J. R., Chen, X., Paulin, L. F., Nguyen, N. Q. H., Newman, E., Mahmoud, M., Menon, V. K., Qi, Q., Joshi, P., et al. (2023) · doi:10.1101/2023.04.24.538128 · Cited by 21
Haplotype architecture of the Alzheimer's risk in the APOE region via co‐skewness
Kulminski, A. M., Philipp, I., Loika, Y., He, L., & Culminskaya, I. (2020) · Alzheimer's & Dementia: Diagnosis, Assessment & Disease Monitoring · doi:10.1002/dad2.12129 · Cited by 10
Metadata
- Authors
- Marigorta, U. M., Rodríguez, J. A., Gibson, G., & Navarro, A.
- Venue
- Trends in Genetics
- Publisher
- Elsevier BV
- Published
- 2018-07
- Volume
- 34
- Issue
- 7
- Pages
- 504-517
- ISSN
- 0168-9525 (ISSN-L)
- OpenAlex
- W2802784998
- Cited by
- 185
- References
- 34
- FWCI
- 3.02
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.