What should the genome-wide significance threshold be? Empirical replication of borderline genetic associations
The DOI matches its Crossref record; 106 of the 107 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Robust replication is a sine qua non for the rigorous documentation of proposed associations in the genome-wide association (GWA) setting. Currently, associations of common variants reaching P ≤ 5 × 10(-8) are considered replicated. However, there is some ambiguity about the most suitable threshold for claiming genome-wide significance. METHODS: We defined as 'borderline' associations those with P > 5 × 10(-8) and P ≤ 1 × 10(-7). The eligible associations were retrieved using the 'Catalog of Published Genome-Wide Association Studies'. For each association we assessed whether it reached P ≤ 5 × 10(-8) with inclusion of additional data from subsequent GWA studies. RESULTS: Thirty-four eligible genotype-phenotype associations were evaluated with data and clarifications contributed from diverse investigators. Replication data from subsequent GWA studies could be obtained for 26 of them. Of those, 19 associations (73%) reached P ≤ 5 × 10(-8) for the same or a related trait implicating either the exact same allele or one in very high linkage disequilibrium and 17 reached P < 10(-8). If the seven associations that did not reach P ≤ 5 × 10(-8) when additional data were considered are assumed to have been false-positives, the false-discovery rate for borderline associations is estimated to be 27% [95% confidence interval (CI) 12-48%]. For five associations, the current P-value is > 10(-6) [corresponding false-discovery rate 19% (95% CI 7-39%)]. CONCLUSION: A substantial proportion, but not all, of the associations with borderline genome-wide significance represent replicable, possibly genuine associations. Our empirical evaluation suggests a possible relaxation in the current GWS threshold.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Others have also observed this, revealing in their sample that a substantial minority of associations with borderline genome-wide significance represent replicable and possibly genuine associations [41].”
Citations
Cites
PLINK: a tool set for whole-genome association and population-based linkage analyses.
Purcell, S., Neale, B., Todd-Brown, K., Thomas, L., Ferreira, M. A. R., Bender, D., Maller, J., Sklar, P., de Bakker, P. I. W., Daly, M. J., et al. (2007) · The American Journal of Human Genetics · doi:10.1086/519795 · Cited by 34,089
Statistical significance for genomewide studies
Storey, J. D., & Tibshirani, R. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1530509100 · Cited by 9,692
Genome-wide association study of 14,000 cases of seven common diseases and 3,000 shared controls
The Wellcome Trust Case Control Consortium, Management Committee, Burton, P. R., Clayton, D. G., Cardon, L. R., Craddock, N., Deloukas, P., Duncanson, A., Kwiatkowski, D. P., McCarthy, M. I., et al. (2007) · Nature · doi:10.1038/nature05911 · Cited by 9,442
Finding the missing heritability of complex diseases
Manolio, T. A., Collins, F. S., Cox, N. J., Goldstein, D. B., Hindorff, L. A., Hunter, D. J., McCarthy, M. I., Ramos, E. M., Cardon, L. R., Chakravarti, A., et al. (2009) · Nature · doi:10.1038/nature08494 · Cited by 8,336
A map of human genome variation from population-scale sequencing.
The 1000 Genomes Project Consortium (2010) · Nature · doi:10.1038/nature09534 · Cited by 7,877
A haplotype map of the human genome
The International HapMap Consortium (2005) · Nature · doi:10.1038/nature04226 · Cited by 5,858
Hindorff, L. A., Sethupathy, P., Junkins, H. A., Ramos, E. M., Mehta, J. P., Collins, F. S., & Manolio, T. A. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0903103106 · Cited by 4,013
Biological, clinical and population relevance of 95 loci for blood lipids
Teslovich, T. M., Musunuru, K., Smith, A. V., Edmondson, A. C., Stylianou, I. M., Koseki, M., Pirruccello, J. P., Ripatti, S., Chasman, D. I., Willer, C. J., et al. (2010) · Nature · doi:10.1038/nature09270 · Cited by 3,487
Multiple significance tests: the Bonferroni method
Bland, J. M., & Altman, D. G. (1995) · BMJ · doi:10.1136/bmj.310.6973.170 · Cited by 3,341
A genome-wide association study identifies novel risk loci for type 2 diabetes
Sladek, R., Rocheleau, G., Rung, J., Dina, C., Shen, L., Serre, D., Boutin, P., Vincent, D., Belisle, A., Hadjadj, S., et al. (2007) · Nature · doi:10.1038/nature05616 · Cited by 2,993
Research works printed but not linked: 1
- 10.1037/0033-2909.111.1.188 · doi:10.1037/0033-2909.111.1.188 · Paper page
Cited by
Items 301–309 of 309
Does Depression Increase the Risk of Endometriosis? A Combined Population‑Based and Laboratory Study
Wang, Y., Zhu, Z., Jin, X., Ding, Z., Zhong, W., Zhang, Y., Feng, S., & Wu, T. (2026) · International Journal of Women s Health · doi:10.2147/ijwh.s605971
Zhou, Z., Bai, Z., Zheng, C., Wu, J., Li, L., Cheng, A., & Men, X. (2026) · Medicine · doi:10.1097/md.0000000000049202
“[31] For certain emerging phenotypes or exposure factors with low heritability, strictly enforcing the P = 5 × 10 −8 threshold may result in an insufficient number of included SNPs (such as fewer than 3), which significantly reducing the statistical power of MR analyses.”
Kuang, Q., Zhu, Q., Li, X., Yang, H., Jiang, W., Wang, Y. F., & Qin, X. (2026) · Science Progress · doi:10.1177/00368504261463907
Vitamin D and suicidal behavior: Cross-sectional and Mendelian randomization study
Guo, H., Dai, L., & Zhan, J. (2026) · World Journal of Psychiatry · doi:10.5498/wjp.124586
Kadayıfçı, F. Z. (2023) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign)
Cheng, J., Yu, J., Chen, L., Chen, H., Sun, N., & Hao, J. (2026) · The International Journal of Biological Markers · doi:10.1177/03936155261494616
Peer review history of Identifying causal variants by fine mapping across multiple studies (part 4)
LaPierre, N., Taraszka, K., Huang, H., He, R., Hormozdiari, F., & Eskin, E. (2021) · doi:10.1371/journal.pgen.1009733.r004
Supporting information 1 of Deciphering Genetic Susceptibility to Tuberculous Meningitis
Schurz, H., Glanzmann, B., Bowker, N., van Toorn, R., Solomons, R., Schoeman, J., van Helden, P. D., Kinnear, C. J., Hoal, E. G., & Möller, M. (2022) · doi:10.3389/fneur.2022.820168.s001
A statistical framework to detect gene-environment interactions influencing complex traits
Deng, W. Q. (2013) · MacSphere (McMaster University) · doi:10.71548/9361
Metadata
- Authors
- Panagiotou, O. A., Ioannidis, J. P. A., & for the Genome-Wide Significance Project
- Affiliations
- University of Ioannina (GR)
- Corresponding author
- Ioannidis, John P A
- Venue
- International Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2011-12-05
- Volume
- 41
- Issue
- 1
- Pages
- 273-286
- ISSN
- 0300-5771 (ISSN-L)
- 1464-3685
- OpenAlex
- W2141749392
- Cited by
- 286
- References
- 107
- Citations by year
- 2026: 9 · 2025: 11 · 2024: 17 · 2023: 10 · 2022: 13 · 2021: 43 · 2020: 15 · 2019: 22 · 2018: 20 · 2017: 31 · 2016: 20 · 2015: 14 · 2014: 22 · 2013: 27 · 2012: 12
- FWCI
- 12.19
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- International Journal of Epidemiology (publishedVersion)
- PubMed (publishedVersion)
- HighWire Press Open Archive (submittedVersion)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Associations and Epidemiology
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Mapping and Diversity in Plants and Animals
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- replication, false discovery rate, p-value threshold, common genetic variants, linkage disequilibrium, false positives, genome-wide association study
- MeSH terms
- Humans, Reference Standards, Polymorphism, Single Nucleotide, Empirical Research, Genome-Wide Association Study, Genetic Association Studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.