Replication of past candidate loci for common diseases and phenotypes in 100 genome-wide association studies
Open accessAbstract
Genome-wide association studies (GWASs) have created a paradigm shift in discovering genetic associations for common diseases and phenotypes, but it is unclear whether the thousands of candidate genetic association studies performed in the pre-GWAS era had found any reliable associations for common diseases and phenotypes. We aimed to systematically evaluate whether loci proposed to harbor candidate associations before the advent of GWASs are replicated in GWASs. The GWAS data published through August, 2008 and included in the NHGRI catalog were screened and variants in candidate loci were selected on the basis of statistical significance (P<0.05) to create a list of independent, non-redundant associations. Altogether, 159 articles on GWASs were evaluated, 100 of which addressed past proposed candidate loci. A total of 291 independent, nominally significant (P<0.05) candidate gene associations were assembled after keeping only the SNP with lowest P-value for each locus and each phenotype; 108 of those had P<10(-3) for association and 41 had P<10(-7). A total of 22 of these 41 candidate gene associations pertained to binary phenotypes with a median odds ratio=2.91 (IQR: 1.82-4.6) and median minor allele frequency=0.17 (IQR: 0.12-0.29) in Caucasians; for comparison, 60 new associations of binary outcomes with P<10(-7) discovered in the same GWASs had much smaller effects (median odds ratio 1.30, IQR: 1.18-1.58) and modestly larger minor allele frequencies (median 0.27, IQR: 0.15-0.43). Overall, few of the numerous genetic associations proposed in the candidate gene era have been replicated in GWASs, but those that have been conclusively replicated have large genetic effects that should not be discarded.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Previously almost all of the proposed candidate gene associations from small studies were false, with some exceptions, but collaborative consortia have substantially improved power, and the replicated results can be considered highly reliable.
“Although previously almost all of the proposed candidate gene associations from small studies were false 99 (with some exceptions 100 ), collaborative consortia have substantially improved power, and the replicated results can be considered highly reliable.”
From Power failure: why small sample size undermines the reliability of neuroscience (2013) · cites this paper as [100]
Split into 2 atoms — 0 confirmed, 2 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
Experimental — accuracy not yet measuredThe 'replication crisis' reached headlines and catalyzed the uptake of open science as a means to improve the trustworthiness of scientific findings.
“Meanwhile, the “replication crisis” reached headlines and catalyzed the uptake of open science as a means to improve the trustworthiness of scientific findings [6–9] (see Box 1 for a first-hand account).”
From Open Science 2.0: Towards a truly collaborative research ecosystem (2023) · cites this paper as [9]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Finding the missing heritability of complex diseases
Manolio, T. A., Collins, F. S., Cox, N. J., Goldstein, D. B., Hindorff, L. A., Hunter, D. J., McCarthy, M. I., Ramos, E. M., Cardon, L. R., Chakravarti, A., et al. (2009) · Nature · doi:10.1038/nature08494 · Cited by 8,336 · see citing works
Genome-wide association studies for complex traits: consensus, uncertainty and challenges
McCarthy, M. I., Abecasis, G. R., Cardon, L. R., Goldstein, D. B., Little, J., Ioannidis, J. P. A., & Hirschhorn, J. N. (2008) · Nature Reviews Genetics · doi:10.1038/nrg2344 · Cited by 2,891 · see citing works
Self-citationReplication of Genome-Wide Association Signals in UK Samples Reveals Risk Loci for Type 2 Diabetes
Zeggini, E., Weedon, M. N., Lindgren, C. M., Frayling, T. M., Elliott, K. S., Lango, H., Timpson, N. J., Perry, J. R. B., Rayner, N. W., Freathy, R. M., et al. (2007) · Science · doi:10.1126/science.1142364 · Cited by 2,194 · see citing works
Variants conferring risk of atrial fibrillation on chromosome 4q25
Gudbjartsson, D. F., Arnar, D. O., Helgadottir, A., Gretarsdottir, S., Holm, H., Sigurdsson, A., Jonasdottir, A., Baker, A., Thorleifsson, G., Kristjansson, K., et al. (2007) · Nature · doi:10.1038/nature06007 · Cited by 955 · see citing works
A HapMap harvest of insights into the genetics of common disease
Manolio, T. A., Brooks, L. D., & Collins, F. S. (2008) · Journal of Clinical Investigation · doi:10.1172/jci34772 · Cited by 889 · cited 1× · see citing works
“7 GWASs have markedly accelerated the pace of discovery of associations with very strong statistical support”
Background
Flagged first, then by citations
Research works printed but not linked: 31
- Cordell HJ, Clayton DG: Genetic association studies. Lancet 2005; 366: 1121-1131.
- Hirschhorn JN, Lohmueller K, Byrne E, Hirschhorn K: A comprehensive review of genetic association studies. Genet Med 2002; 4: 45-61.
- Lin BK, Clyne M, Walsh M et al: Tracking the epidemiology of human genes in the literature: the HuGE Published Literature database. Am J Epidemiol 2006; 164: 1-4.
- Ioannidis JP, Ntzani EE, Trikalinos TA, Contopoulos-Ioannidis DG: Replication validity of genetic association studies. Nat Genet 2001; 29: 306-309.
- 5 Ioannidis JP: Genetic associations: false or true? Trends Mol Med 2003; 9: 135-138.
- Cardon LR: Genetics. Delivering new disease genes. Science 2006; 314: 1403-1405.
- Barrett JC, Cardon LR: Evaluating coverage of genome-wide association studies. Nat Genet 2006; 38: 659-662.
- Yu W, Gwinn M, Clyne M, Yesupriya A, Khoury MJ: A navigator for human genome epidemiology. Nat Genet 2008; 40: 124-125.
- Bertram L, McQueen MB, Mullin K, Blacker D, Tanzi RE: Systematic meta-analyses of Alzheimer disease genetic association studies: the AlzGene database. Nat Genet 2007; 39: 17-23.
- Allen NC, Bagade S, McQueen MB et al: Systematic meta-analyses and field synopsis of genetic association studies in schizophrenia: the SzGene database. Nat Genet 2008; 40: 827-834.
- Ioannidis JP: Effect of formal statistical significance on the credibility of observational associations. Am J Epidemiol 2008; 168: 374-383.
- Kehoe P, Wavrant-De Vrieze F, Crook R et al: A full genome scan for late onset Alzheimer's disease. Hum Mol Genet 1999; 8: 237-245.
- Gaffney PM, Kearns GM, Shark KB et al: A genome-wide search for susceptibility genes in human systemic lupus erythematosus sib-pair families. Proc Natl Acad Sci USA 1998; 95: 14875-14879.
- Jawaheer D, Seldin MF, Amos CI et al: Screening the genome for rheumatoid arthritis susceptibility genes: a replication study and combined analysis of 512 multicase families. Arthritis Rheum 2003; 48: 906-916.
- Haiman CA, Patterson N, Freedman ML et al: Multiple regions within 8q24 indepen- dently affect risk for prostate cancer. Nat Genet 2007; 39: 638-644.
- Graham RR, Kyogoku C, Sigurdsson S et al: Three functional variants of IFN regulatory factor 5 (IRF5) define risk and protective haplotypes for human lupus. Proc Natl Acad Sci USA 2007; 104: 6758-6763.
- Ioannidis JP, Gwinn M, Little J et al: A road map for efficient and reliable human genome epidemiology. Nat Genet 2006; 38: 3-5.
- Pe¢er I, Yelensky R, Altshuler D, Daly MJ: Estimation of the multiple testing burden for genomewide association studies of nearly all common variants. Genet Epidemiol 2008; 32: 381-385.
- Hoggart CJ, Clark TG, De Iorio M, Whittaker JC, Balding DJ: Genome-wide significance for dense SNP and resequencing data. Genet Epidemiol 2008; 32: 179-185.
- Ioannidis JP: Why most discovered true associations are inflated. Epidemiology 2008; 19: 640-648.
- Zollner S, Pritchard JK: Overcoming the winner's curse: estimating penetrance para- meters from case-control data. Am J Hum Genet 2007; 80: 605-615.
- Zeggini E, Scott LJ, Saxena R et al: Meta-analysis of genome-wide association data and large-scale replication identifies additional susceptibility loci for type 2 diabetes. Nat Genet 2008; 40: 638-645.
- Dong LM, Potter JD, White E, Ulrich CM, Cardon LR, Peters U: Genetic susceptibility to cancer: the role of polymorphisms in candidate genes. JAMA 2008; 299: 2423-2436.
- Vineis P, Manuguerra M, Kavvoura FK et al: A field synopsis on low-penetrance variants in DNA repair genes and cancer susceptibility. J Natl Cancer Inst 2009; 101: 24-36.
- Ntzani EE, Rizos EC, Ioannidis JP: Genetic effects versus bias for candidate poly- morphisms in myocardial infarction: case study and overview of large-scale evidence. Am J Epidemiol 2007; 165: 973-984.
- Morgan TM, Krumholz HM, Lifton RP, Spertus JA: Nonvalidation of reported genetic risk factors for acute coronary syndrome in a large-scale replication study. JAMA 2007; 297: 1551-1561.
- Wang L, Weinshilboum RM: Pharmacogenomics: candidate gene identification, func- tional validation and mechanisms. Hum Mol Genet 2008; 17: R174-R179.
- Bodmer W, Bonilla C: Common and rare variants in multifactorial susceptibility to common diseases. Nat Genet 2008; 40: 695-701.
- Ioannidis JP, Thomas T, Daly MJ: Validating, augmenting and refining genome-wide association signals. Nat Rev Genet 2009; 10: 318-329.
- Zeggini E, Ioannidis JP: Meta-analysis in genome-wide association studies. Pharmaco- genomics 2009; 10: 191-201.
- Richards JB, Kavvoura FK, Rivadeneira F et al: Collaborative meta-analysis: associa- tions of 150 candidate genes with osteoporosis and osteoporotic fracture. Ann Intern Med 2009; 151: 528-537.
Cited by
Sorted by citations
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641 · see citing works
Self-citationThe False-positive to False-negative Ratio in Epidemiologic Studies
Ioannidis, J. P. A., Tarone, R., & McLaughlin, J. K. (2011) · Epidemiology · doi:10.1097/ede.0b013e31821b506e · Cited by 321 · see citing works
Self-citationReproducibility and replicability of rodent phenotyping in preclinical studies
Kafkafi, N., Agassi, J., Chesler, E. J., Crabbe, J. C., Crusio, W. E., Eilam, D., Gerlai, R., Golani, I., Gomez-Marin, A., Heller, R., et al. (2018) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2018.01.003 · Cited by 215 · see citing works
Pinto, J. V., Moulin, T. C., & Amaral, O. B. (2017) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2017.10.001 · Cited by 103 · see citing works
Open Science 2.0: Towards a truly collaborative research ecosystem
Thibault, R. T., Amaral, O. B., Argolo, F., Bandrowski, A. E., Davidson, A. R., & Drude, N. I. (2023) · PLOS Biology · doi:10.1371/journal.pbio.3002362 · Cited by 72 · see citing works
- Authors
- Siontis, K. C. M., Patsopoulos, N. A., & Ioannidis, J. P. A.
- Affiliations
- University of Ioannina (GR)
- Tufts University (US)
- Corresponding author
- Ioannidis, John P A
- Venue
- European Journal of Human Genetics
- Published
- 2010-03-17
- Volume
- 18
- Issue
- 7
- Pages
- 832-837
- ISSN
- 1018-4813 (ISSN-L)
- 1476-5438
- PMC
- PMC2987361
- OpenAlex
- W2052880407
- Cited by
- 117
- References
- 5
- Citations by year
- 2026: 3 · 2025: 2 · 2023: 6 · 2021: 6 · 2020: 8 · 2019: 4 · 2018: 10 · 2017: 13 · 2016: 5 · 2015: 5 · 2014: 16 · 2013: 11 · 2012: 11
- FWCI
- 7.02
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.springer.com/tdm (tdm)
- Locations
- European Journal of Human Genetics (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- HAL (submittedVersion, other-oa)
- Trinity's Access to Research Output (TARA) (Trinity College Dublin) (submittedVersion)
- Funders
- European Commission
- General Secretariat for Research and Technology
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Associations and Epidemiology
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Mapping and Diversity in Plants and Animals
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic and phenotypic traits in livestock
- Keywords
- candidate gene association, replication of genetic associations, common diseases, phenotypes, single nucleotide polymorphisms, genetic effect size, odds ratio, minor allele frequency
- MeSH terms
- Bayes Theorem, Disease, Humans, Phenotype, Reproducibility of Results, Genome, Human, Odds Ratio, Polymorphism, Single Nucleotide, Databases, Genetic, Genome-Wide Association Study, Genetic Loci
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review