What should the genome-wide significance threshold be? Empirical replication of borderline genetic associations
The DOI matches its Crossref record; 106 of the 107 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Robust replication is a sine qua non for the rigorous documentation of proposed associations in the genome-wide association (GWA) setting. Currently, associations of common variants reaching P ≤ 5 × 10(-8) are considered replicated. However, there is some ambiguity about the most suitable threshold for claiming genome-wide significance. METHODS: We defined as 'borderline' associations those with P > 5 × 10(-8) and P ≤ 1 × 10(-7). The eligible associations were retrieved using the 'Catalog of Published Genome-Wide Association Studies'. For each association we assessed whether it reached P ≤ 5 × 10(-8) with inclusion of additional data from subsequent GWA studies. RESULTS: Thirty-four eligible genotype-phenotype associations were evaluated with data and clarifications contributed from diverse investigators. Replication data from subsequent GWA studies could be obtained for 26 of them. Of those, 19 associations (73%) reached P ≤ 5 × 10(-8) for the same or a related trait implicating either the exact same allele or one in very high linkage disequilibrium and 17 reached P < 10(-8). If the seven associations that did not reach P ≤ 5 × 10(-8) when additional data were considered are assumed to have been false-positives, the false-discovery rate for borderline associations is estimated to be 27% [95% confidence interval (CI) 12-48%]. For five associations, the current P-value is > 10(-6) [corresponding false-discovery rate 19% (95% CI 7-39%)]. CONCLUSION: A substantial proportion, but not all, of the associations with borderline genome-wide significance represent replicable, possibly genuine associations. Our empirical evaluation suggests a possible relaxation in the current GWS threshold.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Others have also observed this, revealing in their sample that a substantial minority of associations with borderline genome-wide significance represent replicable and possibly genuine associations [41].”
Citations
Cites
PLINK: a tool set for whole-genome association and population-based linkage analyses.
Purcell, S., Neale, B., Todd-Brown, K., Thomas, L., Ferreira, M. A. R., Bender, D., Maller, J., Sklar, P., de Bakker, P. I. W., Daly, M. J., et al. (2007) · The American Journal of Human Genetics · doi:10.1086/519795 · Cited by 34,089
Statistical significance for genomewide studies
Storey, J. D., & Tibshirani, R. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1530509100 · Cited by 9,692
Genome-wide association study of 14,000 cases of seven common diseases and 3,000 shared controls
The Wellcome Trust Case Control Consortium, Management Committee, Burton, P. R., Clayton, D. G., Cardon, L. R., Craddock, N., Deloukas, P., Duncanson, A., Kwiatkowski, D. P., McCarthy, M. I., et al. (2007) · Nature · doi:10.1038/nature05911 · Cited by 9,442
Finding the missing heritability of complex diseases
Manolio, T. A., Collins, F. S., Cox, N. J., Goldstein, D. B., Hindorff, L. A., Hunter, D. J., McCarthy, M. I., Ramos, E. M., Cardon, L. R., Chakravarti, A., et al. (2009) · Nature · doi:10.1038/nature08494 · Cited by 8,336
A map of human genome variation from population-scale sequencing.
The 1000 Genomes Project Consortium (2010) · Nature · doi:10.1038/nature09534 · Cited by 7,877
A haplotype map of the human genome
The International HapMap Consortium (2005) · Nature · doi:10.1038/nature04226 · Cited by 5,858
Hindorff, L. A., Sethupathy, P., Junkins, H. A., Ramos, E. M., Mehta, J. P., Collins, F. S., & Manolio, T. A. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0903103106 · Cited by 4,013
Biological, clinical and population relevance of 95 loci for blood lipids
Teslovich, T. M., Musunuru, K., Smith, A. V., Edmondson, A. C., Stylianou, I. M., Koseki, M., Pirruccello, J. P., Ripatti, S., Chasman, D. I., Willer, C. J., et al. (2010) · Nature · doi:10.1038/nature09270 · Cited by 3,487
Multiple significance tests: the Bonferroni method
Bland, J. M., & Altman, D. G. (1995) · BMJ · doi:10.1136/bmj.310.6973.170 · Cited by 3,341
A genome-wide association study identifies novel risk loci for type 2 diabetes
Sladek, R., Rocheleau, G., Rung, J., Dina, C., Shen, L., Serre, D., Boutin, P., Vincent, D., Belisle, A., Hadjadj, S., et al. (2007) · Nature · doi:10.1038/nature05616 · Cited by 2,993
Cited by
A Review of Feature Selection Methods for Machine Learning-Based Disease Risk Prediction
Pudjihartono, N., Fadason, T., Kempa-Liehr, A. W., & O'Sullivan, J. M. (2022) · Frontiers in Bioinformatics · doi:10.3389/fbinf.2022.927312 · Cited by 880
“(Panagiotou and Ioannidis, 2012) noted that a considerable number of legitimate and replicable associations can have p values just above this threshold; therefore, a possible relaxation of this commonly accepted threshold has been suggested.”
BackgroundMeta-analysis methods for genome-wide association studies and beyond
Evangelou, E., & Ioannidis, J. P. A. (2013) · Nature Reviews Genetics · doi:10.1038/nrg3472 · Cited by 596
Self-citationThe Autism Spectrum Disorders Working Group of The Psychiatric Genomics Consortium (2017) · Molecular Autism · doi:10.1186/s13229-017-0137-9 · Cited by 587
Statistical power and significance testing in large-scale genetic studies
Sham, P. C., & Purcell, S. M. (2014) · Nature Reviews Genetics · doi:10.1038/nrg3706 · Cited by 573
How to Use a Subgroup Analysis: Users’ Guide to the Medical Literature
Sun, X., Ioannidis, J. P. A., Agoritsas, T., Alba, A. C., & Guyatt, G. (2014) · JAMA · doi:10.1001/jama.2013.285063 · Cited by 550
Self-citation
Metadata
- Authors
- Panagiotou, O. A., Ioannidis, J. P. A., & for the Genome-Wide Significance Project
- Affiliations
- University of Ioannina (GR)
- Corresponding author
- Ioannidis, John P A
- Venue
- International Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2011-12-05
- Volume
- 41
- Issue
- 1
- Pages
- 273-286
- ISSN
- 0300-5771 (ISSN-L)
- 1464-3685
- OpenAlex
- W2141749392
- Cited by
- 286
- References
- 107
- Citations by year
- 2026: 9 · 2025: 11 · 2024: 17 · 2023: 10 · 2022: 13 · 2021: 43 · 2020: 15 · 2019: 22 · 2018: 20 · 2017: 31 · 2016: 20 · 2015: 14 · 2014: 22 · 2013: 27 · 2012: 12
- FWCI
- 12.19
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- International Journal of Epidemiology (publishedVersion)
- PubMed (publishedVersion)
- HighWire Press Open Archive (submittedVersion)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Associations and Epidemiology
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Mapping and Diversity in Plants and Animals
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- replication, false discovery rate, p-value threshold, common genetic variants, linkage disequilibrium, false positives, genome-wide association study
- MeSH terms
- Humans, Reference Standards, Polymorphism, Single Nucleotide, Empirical Research, Genome-Wide Association Study, Genetic Association Studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: What should the genome-wide significance threshold be? Empirical replication of borderline genetic associations. https://app.cochat.ai/papers/10.1093/ije/dyr178
- The paper
- Panagiotou, O. A., Ioannidis, J. P. A., & for the Genome-Wide Significance Project. (2012). What should the genome-wide significance threshold be? Empirical replication of borderline genetic associations. International Journal of Epidemiology. https://doi.org/10.1093/ije/dyr178
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.