What should the genome-wide significance threshold be? Empirical replication of borderline genetic associations
The DOI matches its Crossref record; 106 of the 107 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Robust replication is a sine qua non for the rigorous documentation of proposed associations in the genome-wide association (GWA) setting. Currently, associations of common variants reaching P ≤ 5 × 10(-8) are considered replicated. However, there is some ambiguity about the most suitable threshold for claiming genome-wide significance. METHODS: We defined as 'borderline' associations those with P > 5 × 10(-8) and P ≤ 1 × 10(-7). The eligible associations were retrieved using the 'Catalog of Published Genome-Wide Association Studies'. For each association we assessed whether it reached P ≤ 5 × 10(-8) with inclusion of additional data from subsequent GWA studies. RESULTS: Thirty-four eligible genotype-phenotype associations were evaluated with data and clarifications contributed from diverse investigators. Replication data from subsequent GWA studies could be obtained for 26 of them. Of those, 19 associations (73%) reached P ≤ 5 × 10(-8) for the same or a related trait implicating either the exact same allele or one in very high linkage disequilibrium and 17 reached P < 10(-8). If the seven associations that did not reach P ≤ 5 × 10(-8) when additional data were considered are assumed to have been false-positives, the false-discovery rate for borderline associations is estimated to be 27% [95% confidence interval (CI) 12-48%]. For five associations, the current P-value is > 10(-6) [corresponding false-discovery rate 19% (95% CI 7-39%)]. CONCLUSION: A substantial proportion, but not all, of the associations with borderline genome-wide significance represent replicable, possibly genuine associations. Our empirical evaluation suggests a possible relaxation in the current GWS threshold.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Others have also observed this, revealing in their sample that a substantial minority of associations with borderline genome-wide significance represent replicable and possibly genuine associations [41].”
Citations
Cites
PLINK: a tool set for whole-genome association and population-based linkage analyses.
Purcell, S., Neale, B., Todd-Brown, K., Thomas, L., Ferreira, M. A. R., Bender, D., Maller, J., Sklar, P., de Bakker, P. I. W., Daly, M. J., et al. (2007) · The American Journal of Human Genetics · doi:10.1086/519795 · Cited by 34,089
Statistical significance for genomewide studies
Storey, J. D., & Tibshirani, R. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1530509100 · Cited by 9,692
Genome-wide association study of 14,000 cases of seven common diseases and 3,000 shared controls
The Wellcome Trust Case Control Consortium, Management Committee, Burton, P. R., Clayton, D. G., Cardon, L. R., Craddock, N., Deloukas, P., Duncanson, A., Kwiatkowski, D. P., McCarthy, M. I., et al. (2007) · Nature · doi:10.1038/nature05911 · Cited by 9,442
Finding the missing heritability of complex diseases
Manolio, T. A., Collins, F. S., Cox, N. J., Goldstein, D. B., Hindorff, L. A., Hunter, D. J., McCarthy, M. I., Ramos, E. M., Cardon, L. R., Chakravarti, A., et al. (2009) · Nature · doi:10.1038/nature08494 · Cited by 8,336
A map of human genome variation from population-scale sequencing.
The 1000 Genomes Project Consortium (2010) · Nature · doi:10.1038/nature09534 · Cited by 7,877
A haplotype map of the human genome
The International HapMap Consortium (2005) · Nature · doi:10.1038/nature04226 · Cited by 5,858
Hindorff, L. A., Sethupathy, P., Junkins, H. A., Ramos, E. M., Mehta, J. P., Collins, F. S., & Manolio, T. A. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0903103106 · Cited by 4,013
Biological, clinical and population relevance of 95 loci for blood lipids
Teslovich, T. M., Musunuru, K., Smith, A. V., Edmondson, A. C., Stylianou, I. M., Koseki, M., Pirruccello, J. P., Ripatti, S., Chasman, D. I., Willer, C. J., et al. (2010) · Nature · doi:10.1038/nature09270 · Cited by 3,487
Multiple significance tests: the Bonferroni method
Bland, J. M., & Altman, D. G. (1995) · BMJ · doi:10.1136/bmj.310.6973.170 · Cited by 3,341
A genome-wide association study identifies novel risk loci for type 2 diabetes
Sladek, R., Rocheleau, G., Rung, J., Dina, C., Shen, L., Serre, D., Boutin, P., Vincent, D., Belisle, A., Hadjadj, S., et al. (2007) · Nature · doi:10.1038/nature05616 · Cited by 2,993
Research works printed but not linked: 1
- 10.1037/0033-2909.111.1.188 · doi:10.1037/0033-2909.111.1.188 · Paper page
Cited by
A Review of Feature Selection Methods for Machine Learning-Based Disease Risk Prediction
Pudjihartono, N., Fadason, T., Kempa-Liehr, A. W., & O'Sullivan, J. M. (2022) · Frontiers in Bioinformatics · doi:10.3389/fbinf.2022.927312 · Cited by 880
“(Panagiotou and Ioannidis, 2012) noted that a considerable number of legitimate and replicable associations can have p values just above this threshold; therefore, a possible relaxation of this commonly accepted threshold has been suggested.”
BackgroundMeta-analysis methods for genome-wide association studies and beyond
Evangelou, E., & Ioannidis, J. P. A. (2013) · Nature Reviews Genetics · doi:10.1038/nrg3472 · Cited by 596
Self-citationThe Autism Spectrum Disorders Working Group of The Psychiatric Genomics Consortium (2017) · Molecular Autism · doi:10.1186/s13229-017-0137-9 · Cited by 587
Statistical power and significance testing in large-scale genetic studies
Sham, P. C., & Purcell, S. M. (2014) · Nature Reviews Genetics · doi:10.1038/nrg3706 · Cited by 573
How to Use a Subgroup Analysis: Users’ Guide to the Medical Literature
Sun, X., Ioannidis, J. P. A., Agoritsas, T., Alba, A. C., & Guyatt, G. (2014) · JAMA · doi:10.1001/jama.2013.285063 · Cited by 550
Self-citationA scientometric review of genome-wide association studies
Mills, M. C., & Rahal, C. (2019) · Communications Biology · doi:10.1038/s42003-018-0261-x · Cited by 441
Rubin, M. (2021) · Synthese · doi:10.1007/s11229-021-03276-4 · Cited by 371
Common genetic associations between age-related diseases
Dönertaş, H. M., Fabian, D. K., Fuentealba, M., Partridge, L., & Thornton, J. M. (2021) · Nature Aging · doi:10.1038/s43587-021-00051-5 · Cited by 346
Identification of Genetic Susceptibility Loci for Colorectal Tumors in a Genome-Wide Meta-analysis
Peters, U., Jiao, S., Schumacher, F. R., Hutter, C. M., Aragaki, A. K., Baron, J. A., Berndt, S. I., Bézieau, S., Brenner, H., Butterbach, K., et al. (2013) · Gastroenterology · doi:10.1053/j.gastro.2012.12.020 · Cited by 321
When Null Hypothesis Significance Testing Is Unsuitable for Research: A Reassessment
Szucs, D., & Ioannidis, J. P. A. (2017) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2017.00390 · Cited by 298
Self-citationGenome-wide association studies of obesity and metabolic syndrome
Fall, T., & Ingelsson, E. (2014) · Molecular and Cellular Endocrinology · doi:10.1016/j.mce.2012.08.018 · Cited by 294
Wu, C., Kraft, P., Zhai, K., Chang, J., Wang, Z., Li, Y., Hu, Z., He, Z., Jia, W., Abnet, C. C., et al. (2012) · Nature Genetics · doi:10.1038/ng.2411 · Cited by 270
Germain, M., Chasman, D. I., de Haan, H., Tang, W., Lindström, S., Weng, L.-C., de Andrade, M., de Visser, M. C. H., Wiggins, K. L., Suchon, P., et al. (2015) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2015.01.019 · Cited by 265
Zheng, J., Huang, X., Tan, W., Yu, D., Du, Z., Chang, J., Wei, L., Han, Y., Wang, C., Che, X., et al. (2016) · Nature Genetics · doi:10.1038/ng.3568 · Cited by 264
Exploring the genetic basis of chronic periodontitis: a genome-wide association study
Divaris, K., Monda, K. L., North, K. E., Olshan, A. F., Reynolds, L. M., Hsueh, W.-C., Lange, E. M., Moss, K., Barros, S. P., Weyant, R. J., et al. (2013) · Human Molecular Genetics · doi:10.1093/hmg/ddt065 · Cited by 245
The Genetics of Multiple Sclerosis: From 0 to 200 in 50 Years
Baranzini, S. E., & Oksenberg, J. R. (2017) · Trends in Genetics · doi:10.1016/j.tig.2017.09.004 · Cited by 239
“While in later years, aP value threshold of 5 [379_TD$DIFF] 10 8 for GWAS emerged as a consensus [50], a systematic analysis of published studies suggested a further relaxation of this P value would result in the discovery of additional genuine associations [51].”
BackgroundThe Promises and Pitfalls of Genoeconomics
Benjamin, D. J., Cesarini, D., Chabris, C. F., Glaeser, E. L., Laibson, D. I., Age, G. S.-R. S., Guðnason, V., Harris, T. B., Launer, L. J., Purcell, S., et al. (2012) · Annual Review of Economics · doi:10.1146/annurev-economics-080511-110939 · Cited by 215
“The genome-wide significance threshold of 5 10 8 therefore approximates the appropriate Bonferronicorrected significance threshold of 0.05/1,000,000 (Panagiotou & Ioannidis 2012).”
BackgroundInfluentialBenn, M., Nordestgaard, B. G., Frikke-Schmidt, R., & Tybjærg-Hansen, A. (2017) · BMJ · doi:10.1136/bmj.j1648 · Cited by 178
Revisiting the genome-wide significance threshold for common variant GWAS
Chen, Z., Boehnke, M., Wen, X., & Mukherjee, B. (2021) · G3 Genes|Genomes|Genetics · doi:10.1093/g3journal/jkaa056 · Cited by 177
EPICURE Consortium, EMINet Consortium, Steffens, M., Leu, C., Ruppert, A.-K., Zara, F., Striano, P., Robbiano, A., Capovilla, G., Tinuper, P., et al. (2012) · Human Molecular Genetics · doi:10.1093/hmg/dds373 · Cited by 153
A Genome-Wide Association Study of Behavioral Disinhibition
McGue, M., Zhang, Y., Miller, M. B., Basu, S., Vrieze, S., Hicks, B., Malone, S., Oetting, W. S., & Iacono, W. G. (2013) · Behavior Genetics · doi:10.1007/s10519-013-9606-x · Cited by 136
“In any case, although we failed to identify variants with p values below the standard GWAS threshold, Panagiotou et al. (2012) have recently shown that a high proportion of associations with borderline significance in an initial analysis (which they defined as a p value \1 9 10-7) go on to be…”
Patil, G., Vuong, T. D., Kale, S. M., Valliyodan, B., Deshmukh, R. K., Zhu, C., Wu, X., Bai, Y., Yungbluth, D. C., Lu, F., et al. (2018) · Plant Biotechnology Journal · doi:10.1111/pbi.12929 · Cited by 150
The genetic architecture of structural left–right asymmetry of the human brain
Sha, Z., Schijven, D., Carrión-Castillo, A., Joliot, M., Mazoyer, B. M., Fisher, S. E., Crivello, F., & Francks, C. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01069-w · Cited by 154
Wild GWAS—association mapping in natural populations
Santure, A. W., & Garant, D. (2018) · Molecular Ecology Resources · doi:10.1111/1755-0998.12901 · Cited by 142
Li, X., Zhou, Z., Ding, J., Wu, Y., Zhou, B., Wang, R., Ma, J., Wang, S., Zhang, X., Xia, Z., et al. (2016) · Frontiers in Plant Science · doi:10.3389/fpls.2016.00833 · Cited by 154
“However, some markers with high significant p-value may not be genuine whereas others with moderate or even low significant p-values can be considered genuine based on the biological trait (Panagiotou and Ioannidis, 2012).”
BackgroundFortune, M. D., Guo, H., Burren, O., Schofield, E., Walker, N. M., Ban, M., Sawcer, S. J., Bowes, J., Worthington, J., Barton, A., et al. (2015) · Nature Genetics · doi:10.1038/ng.3330 · Cited by 133
Understanding Statistical Hypothesis Testing: The Logic of Statistical Inference
Emmert‐Streib, F., & Dehmer, M. (2019) · Machine Learning and Knowledge Extraction · doi:10.3390/make1030054 · Cited by 157
“05, however, for Genome-Wide Association Studies (GWAS) values as low as 10−8 are used [28].”
The Power of Meta-Analysis in Genome-Wide Association Studies
Panagiotou, O. A., Willer, C. J., Hirschhorn, J. N., & Ioannidis, J. P. A. (2013) · Annual Review of Genomics and Human Genetics · doi:10.1146/annurev-genom-091212-153520 · Cited by 124
Self-citationGenome‐wide association uncovers shared genetic effects among personality traits and mood states
Luciano, M., Huffman, J. E., Arias‐Vásquez, A., Vinkhuyzen, A. A. E., Middeldorp, C. M., Giegling, I., Payton, A., Davies, G., Zgaga, L., Janzing, J., et al. (2012) · American Journal of Medical Genetics Part B: Neuropsychiatric Genetics · doi:10.1002/ajmg.b.32072 · Cited by 126
A Genome-Wide Association Study (GWAS) for Bronchopulmonary Dysplasia
Wang, H., Julien, K. R. S., Stevenson, D. K., Hoffmann, T. J., Witte, J. S., Lazzeroni, L. C., Krasnow, M. A., Quaintance, C. C., Oehlert, J. W., Jelliffe‐Pawlowski, L. L., et al. (2013) · PEDIATRICS · doi:10.1542/peds.2013-0533 · Cited by 124
Peters, M. J., Broer, L., Willemen, H. L. D. M., Eiriksdottir, G., Hocking, L. J., Holliday, K. L., Horan, M. A., Meulenbelt, I., Neogi, T., Popham, M., et al. (2013) · Annals of the Rheumatic Diseases · doi:10.1136/annrheumdis-2012-201742 · Cited by 121
Handedness: A neurogenetic shift of perspective
Ocklenburg, S., Beste, C., & Güntürkün, O. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.09.014 · Cited by 115
“While no SNP gave a p-values below 5 × 10 −8 (the value commonly used as threshold for genome-wide significance of an association; Panagiotou and Ioannidis, 2012), the most highly associated SNP identified was rs11855415 within an intron of the proprotein convertase subtilisin/kexin type 6 gene…”
A genome‐wide association study for reading and language abilities in two population cohorts
Luciano, M., Evans, D. M., Hansell, N. K., Medland, S. E., Montgomery, G. W., Martin, N. G., Wright, M. J., & Bates, T. C. (2013) · Genes Brain & Behavior · doi:10.1111/gbb.12053 · Cited by 120
Gene‐Environment Interactions in Cancer Epidemiology: A National Cancer Institute Think Tank Report
Hutter, C. M., Mechanic, L. E., Chatterjee, N., Kraft, P. L., & Gillanders, E. M. (2013) · Genetic Epidemiology · doi:10.1002/gepi.21756 · Cited by 120
Madireddy, L., Patsopoulos, N. A., Cotsapas, C. J., Bos, S. D., Beecham, A. H., McCauley, J. L., Kim, K., Jia, X., Santaniello, A., Caillier, S. J., et al. (2019) · Nature Communications · doi:10.1038/s41467-019-09773-y · Cited by 105
Kanai, M., Tanaka, T., & Okada, Y. (2016) · Journal of Human Genetics · doi:10.1038/jhg.2016.72 · Cited by 102
Burbelo, P. D., Ambatipudi, K., & Alevizos, I. (2014) · Autoimmunity Reviews · doi:10.1016/j.autrev.2014.02.002 · Cited by 94
“as an odds ratio (OR), which should be distinguished from relative risk [11].”
BackgroundAwata, T., Yamashita, H., Kurihara, S., Morita‐Ohkubo, T., Miyashita, Y., Katayama, S., Mori, K., Yoneya, S., Kohda, M., Okazaki, Y., et al. (2014) · PLoS ONE · doi:10.1371/journal.pone.0111715 · Cited by 95
“Recently, it has been demonstrated that a substantial proportion of the associations with borderline genome-wide significance are replicable [48].”
BackgroundA Review of Pathway-Based Analysis Tools That Visualize Genetic Variants
Cirillo, E., Parnell, L. D., & Evelo, C. T. (2017) · Frontiers in Genetics · doi:10.3389/fgene.2017.00174 · Cited by 96
“Approaches include LD calibration and identification of associated pathways (Panagiotou et al., 2012), and comparison of different algorithms, which revealed advantages and disadvantages of the statistics used for a specific GWAS dataset (Gui et al., 2011; Evangelou et al., 2012; Fehringer et al.,…”
BackgroundMethodInfluentialInterpretable machine learning for genomics
Watson, D. (2021) · Human Genetics · doi:10.1007/s00439-021-02387-9 · Cited by 96
“The ease of computing VI for linear models has been exploited to search for causal variants in single nucleotide polymorphism (SNP) arrays via penalized regression techniques like the lasso (Tibshirani, 1996) and elastic net (Zou & Hastie, 2005), both popular in GWAS (Waldmann et al., 2013).”
BackgroundInfluentialThomassen, J. Q., Tolstrup, J. S., Benn, M., & Frikke‐Schmidt, R. (2020) · Epidemiology and Psychiatric Sciences · doi:10.1017/s2045796020000347 · Cited by 91
Samayoa, L. F., Pintos, R. A. M., Olukolu, B. A., Holland, J. B., & Butrón, A. (2015) · BMC Plant Biology · doi:10.1186/s12870-014-0403-3 · Cited by 87
“To identify SNPs with the most robust associations with traits, a subsampling or subagging procedure was employed in GWAS analysis [148,149].”
MethodOlukolu, B. A., Wang, G., Vontimitta, V., Venkata, B. P., Marla, S., Ji, J., Gachomo, E. W., Chu, K., Negeri, A., Benson, J., et al. (2014) · PLoS Genetics · doi:10.1371/journal.pgen.1004562 · Cited by 87
“To identify SNPs with the most robust associations with traits, we implemented a subsampling (subagging) procedure during the GWA analysis [105], with forward regression (using a p-value threshold for inlcusion in the model of 1610(26) [106]) performed in each of 100 subsample datasets.”
MethodJannot, A., Ehret, G., & Perneger, T. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.01.001 · Cited by 91
P Values: From Suggestion to Superstition
Concato, J., & Hartigan, J. A. (2016) · Journal of Investigative Medicine · doi:10.1136/jim-2016-000206 · Cited by 83
The current state of play on the molecular genetics of depression
Cohen-Woods, S., Craig, I. W., & McGuffin, P. (2013) · Psychological Medicine · doi:10.1017/s0033291712001286 · Cited by 82
The molecular genetics of hand preference revisited
de Kovel, C. G. F., & Francks, C. (2019) · Scientific Reports · doi:10.1038/s41598-019-42515-0 · Cited by 82
Rannikmäe, K., Sivakumaran, V., Millar, H., Malik, R., Anderson, C. D., Chong, M., Dave, T., Falcone, G. J., Fernández‐Cadenas, I., Jiménez-Conde, J., et al. (2017) · Neurology · doi:10.1212/wnl.0000000000004560 · Cited by 85
“5 3 10(28) and p # 1 3 10(27)) represent genuine, replicable associations.(33) Second, we did not adjust the statistical threshold for the number of genomic regions and phenotypes investigated, considering this overly conservative because we were investigating a series of specific related hypotheses rather than a sing…”
BackgroundNetwork inference from glycoproteomics data reveals new reactions in the IgG glycosylation pathway
Benedetti, E., Pučić‐Baković, M., Keser, T., Wahl, A., Hassinen, A., Yang, J., Liu, L., Trbojević‐Akmačić, I., Razdorov, G., Štambuk, J., et al. (2017) · Nature Communications · doi:10.1038/s41467-017-01525-0 · Cited by 84
“54 .”
Kao, P. Y. P., Leung, K. H., Chan, L., Yip, S. P., & Yap, M. K. H. (2016) · Biochimica et Biophysica Acta (BBA) - General Subjects · doi:10.1016/j.bbagen.2016.11.030 · Cited by 79
“Despite opinions to relax this threshold to the order of 10 [2], the threshold is still very stringent.”
BackgroundIdentifying causal variants by fine mapping across multiple studies
LaPierre, N., Taraszka, K., Huang, H. J., He, R., Hormozdiari, F., & Eskin, E. (2021) · PLoS Genetics · doi:10.1371/journal.pgen.1009733 · Cited by 84
“2, for which the two-sided Wald test p-value is 5 × 10, which is considered significant by (conservatively) correcting for multiple testing [35].”
Genetic architecture of the white matter connectome of the human brain
Sha, Z., Schijven, D., Fisher, S. E., & Francks, C. (2023) · Science Advances · doi:10.1126/sciadv.add2870 · Cited by 78
Calcium Signaling Pathway Genes RUNX2 and CACNA1C Are Associated With Calcific Aortic Valve Disease
Guauque-Olarte, S., Messika-Zeitoun, D., Droit, A., Lamontagne, M., Tremblay-Marchand, J., Lavoie-Charland, E., Gaudreault, N., Arsenault, B. J., Dubé, M.-P., Tardif, J.-C., et al. (2015) · Circulation: Cardiovascular Genetics · doi:10.1161/circgenetics.115.001145 · Cited by 72
Wei, Q., Yu, D., Liu, M., Wang, M., Zhao, M., Liu, M., Jia, W., Ma, H., Fang, J., Xu, W., et al. (2014) · Nature Genetics · doi:10.1038/ng.3090 · Cited by 71
Machine learning approaches for the prediction of obesity using publicly available genetic profiles
Montañez, C. A. C., Fergus, P., Hussain, A. J., Al‐Jumeily, D., Abdulaimma, B., Hind, J., & Radi, N. (2017) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7966194 · Cited by 80
“Currently, associations of common variants should reach P-Values threshold levels of P 5 × 10-8 to be considered significant [10], [11].”
BackgroundGenome-wide association screens for Achilles tendon and ACL tears and tendinopathy
Kim, S. K., Roos, T. R., Roos, A. K., Kleimeyer, J. P., Ahmed, M. A., Goodlin, G. T., Fredericson, M., Ioannidis, J. P. A., Avins, A. L., & Dragoo, J. L. (2017) · PLoS ONE · doi:10.1371/journal.pone.0170422 · Cited by 71
Self-citationSahana, G., Cai, Z., Sanchez, M.-P., Bouwman, A. C., & Boichard, D. (2023) · Journal of Dairy Science · doi:10.3168/jds.2022-22694 · Cited by 71
“, 2016) has become a standard for common-variant GWAS in humans (Risch and Merikangas, 1996; Dudbridge and Gusnanto, 2008; Panagiotou and Ioannidis, 2012; Chen et al., 2021).”
BackgroundGenome-wide association study of survival in patients with pancreatic adenocarcinoma
Wu, C. H., Kraft, P. L., Stolzenberg‐Solomon, R. Z., Steplowski, E., Brotzman, M. J., Xu, M., Mudgal, P., Amundadottir, L. T., Arslan, A. A., Bueno-de-Mesquita, H. B., et al. (2012) · Gut · doi:10.1136/gutjnl-2012-303477 · Cited by 67
Kerns, S. L., Stock, R. G., Stone, N. N., Buckstein, M. H., Shao, Y., Campbell, C. L., Rath, L., Ruysscher, D. D., Lammering, G., Hixson, R. D., et al. (2012) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2012.08.003 · Cited by 66
“Other studies that did not achieve genome-wide significance have observed replication of suggestive SNPs, however (17).”
Chang, C. Q., Yesupriya, A., Rowell, J. L., Pimentel, C. B., Clyne, M., GWINN, M. L., Khoury, M. J., Wulf, A., & Schully, S. D. (2013) · European Journal of Human Genetics · doi:10.1038/ejhg.2013.161 · Cited by 71
Lambert, N. D., Haralambieva, I. H., Kennedy, R. B., Ovsyannikova, I. G., Pankratz, V. S., & Poland, G. A. (2014) · The Journal of Infectious Diseases · doi:10.1093/infdis/jiu553 · Cited by 63
“For this study, we set the threshold of significance at P≤ 1 × 10 [32].”
MethodAhmad, O. S., Leong, A., Miller, J. A., Morris, J. A., Forgetta, V., Mujammami, M. H., & Richards, J. B. (2016) · Journal of Bone and Mineral Research · doi:10.1002/jbmr.3063 · Cited by 64
“This choice of p value threshold corresponds to the most lenient cutoff by the National Human Genome Research Institute’s cutoff for archiving putative associations in its catalogue.((23,24)) Variants with detectable association with BMI were removed from the analysis, and the remaining nonpleiotropic variants were ta…”
MethodGenetic variation in recombination rate in the pig
Johnsson, M., Whalen, A., Ros‐Freixedes, R., Gorjanc, G., Chen, C.-Y., Herring, W. O., de Koning, D., & Hickey, J. M. (2021) · Genetics Selection Evolution · doi:10.1186/s12711-021-00643-0 · Cited by 61
Yu, J., Wu, H., Wen, Y., Liu, Y., Zhou, T., Ni, B., Lin, Y., Dong, J., Zhou, Z., Hu, Z., et al. (2014) · Human Molecular Genetics · doi:10.1093/hmg/ddu557 · Cited by 67
Price, K. M., Wigg, K. G., Feng, Y., Blokland, K., Wilkinson, M., He, G., Kerr, E. N., Carter, T., Guger, S., Lovett, M. W., et al. (2020) · Genes Brain & Behavior · doi:10.1111/gbb.12648 · Cited by 61
“Although these SNPs are not significant, it has been found that markers passing the P < 5 × 10 threshold have a high chance of associations being confirmed in replication studies.(110,111) Furthermore, studies indicate that highly ranked SNPs can reach significance upon follow-up.”
BackgroundTanikawa, C., Kamatani, Y., Terao, C., Usami, M., Takahashi, A., Momozawa, Y., Suzuki, K., Ogishima, S., Shimizu, A., Satoh, M., et al. (2019) · Journal of the American Society of Nephrology · doi:10.1681/asn.2018090942 · Cited by 61
Influence of Genetic Variation on Plasma Protein Levels in Older Adults Using a Multi-Analyte Panel
Kim, S., Swaminathan, S., Inlow, M., Risacher, S. L., Nho, K., Shen, L., Foroud, T. M., Petersen, R. C., Aisen, P. S., Soares, H., et al. (2013) · PLoS ONE · doi:10.1371/journal.pone.0070269 · Cited by 53
“78 other associations including novel and confirmed associations had uncorrected p,5610(28) (generally accepted genome-wide significance level in many GWAS studies [36]).”
BackgroundAnderson, D. R., Holt, B. J., Pennell, C. E., Holt, P. G., Hart, P. H., & Blackwell, J. M. (2014) · Genes and Immunity · doi:10.1038/gene.2014.52 · Cited by 57
Genetic variation and systemic lupus erythematosus: A field synopsis and systematic meta-analysis
Jeong, D. Y., Lee, S. W., Park, Y. H., Choi, J., Kwon, Y. W., Moon, G., Eisenhut, M., Kronbichler, A., & Shin, J. I. (2018) · Autoimmunity Reviews · doi:10.1016/j.autrev.2017.12.011 · Cited by 57
Adaptation to climate through flowering phenology: a case study in Medicago truncatula
Burgarella, C., Chantret, N., Gay, L., Prosperi, J., Bonhomme, M., Tiffin, P., Young, N. D., & Ronfort, J. (2016) · Molecular Ecology · doi:10.1111/mec.13683 · Cited by 56
Schurz, H., Naranbhai, V., Yates, T., Gilchrist, J. J., Parks, T., Dodd, P. J., Möller, M., Hoal, E. G., Morris, A. P., & Hill, A. V. S. (2023) · eLife · doi:10.7554/elife.84394 · Cited by 59
Lawlor, D. A., Wade, K., Borges, M. C., Palmer, T. M., Hartwig, F. P., Hemani, G., & Bowden, J. (2019) · doi:10.31219/osf.io/6yzs7 · Cited by 51
Kennedy, R. B., Ovsyannikova, I. G., Haralambieva, I. H., Lambert, N. D., Pankratz, V. S., & Poland, G. A. (2014) · Immunogenetics · doi:10.1007/s00251-014-0776-3 · Cited by 54
“…times: (1) 346 children ages 12–18, recruited in 2001–2002 (Ovsyannikova et al. 2004, 2005); (2) 440 children ages 11– 18, recruited in 2006–2007 (Haralambieva et al. 2010; Ovsyannikova et al. 2010a); and (3) 388 children ages 11– 22, recruited in 2008–2009 (Ovsyannikova et al. 2011, 2012c).”
MethodAssessing statistical significance in multivariable genome wide association analysis
Buzdugan, L., Kalisch, M., Navarro, A., Schunk, D., Fehr, E., & Bühlmann, P. (2016) · Bioinformatics · doi:10.1093/bioinformatics/btw128 · Cited by 51
“Because genome-wide scans analyze hundreds of thousands or even millions of markers, the multiple testing issue is resolved by applying a stringent significance threshold - most commonly 5 ∗ 10−8 (Panagiotou and Ioannidis, 2012) - to the p-values.”
BackgroundTsai, C., Hsieh, C.-S., Chang, S., Chuang, E. Y.-Y., Ueng, K.-C., Tsai, C., Lin, T., Wu, C., Lee, J.-K., Lin, L., et al. (2016) · Nature Communications · doi:10.1038/ncomms10190 · Cited by 49
Jin, T., Rehani, P., Ying, M., Huang, J., Liu, S., Roussos, P., & Wang, D. (2021) · Genome Medicine · doi:10.1186/s13073-021-00908-9 · Cited by 40
Rocañín-Arjó, A., Cohen, W., Carcaillon‐Bentata, L., Frère, C., Saut, N., Letenneur, L., Alhenc‐Gelas, M., Dupuy, A., Bertrand, M., Alessi, M., et al. (2013) · Blood · doi:10.1182/blood-2013-10-529628 · Cited by 48
Whole-genome re-sequencing association study on yearling wool traits in Chinese fine-wool sheep
Zhao, H., Zhu, S., Guo, T., Han, M., Chen, B., Qiao, G., Wu, Y., Yuan, C., Liu, J., Lu, Z., et al. (2021) · Journal of Animal Science · doi:10.1093/jas/skab210 · Cited by 47
A Sex-Stratified Genome-Wide Association Study of Tuberculosis Using a Multi-Ethnic Genotyping Array
Schurz, H., Kinnear, C. J., Gignoux, C. R., Wojcik, G. L., van Helden, P. D., Tromp, G., Henn, B. M., Hoal, E. G., & Möller, M. (2019) · Frontiers in Genetics · doi:10.3389/fgene.2018.00678 · Cited by 47
Distinguishing true from false positives in genomic studies: p values
Broer, L., Lill, C. M., Schuur, M., Amin, N., Roehr, J. T., Bertram, L., Ioannidis, J. P. A., & van Duijn, C. M. (2013) · European Journal of Epidemiology · doi:10.1007/s10654-012-9755-x · Cited by 46
Self-citationStatistical data presentation: a primer for rheumatology researchers
Misra, D. P., Zimba, O., & Gasparyan, A. Y. (2020) · Rheumatology International · doi:10.1007/s00296-020-04740-z · Cited by 48
The Role of Genetics in Preterm Birth
Mead, E., Wang, C. A., Phung, J., Fu, J. Y., Williams, S. M., Merialdi, M., Jacobsson, B., Lye, S. J., Menon, R., & Pennell, C. E. (2023) · Reproductive Sciences · doi:10.1007/s43032-023-01287-9 · Cited by 46
“The study identified genetic variants at 22 loci that were associated with gestational duration and 6 loci that were associated with sPTB, at a genome-wide significance (defined as P 5×10 −08 [128]).”
BackgroundTao, F., Beecham, G. W., Rebelo, A. P., Svaren, J. P., Blanton, S. H., Moran, J. J. M., Lopez‐Anido, C., Morrow, J. M., Abreu, L., Rizzo, D. N., et al. (2019) · Annals of Neurology · doi:10.1002/ana.25426 · Cited by 43
CKM and LILRB5 Are Associated With Serum Levels of Creatine Kinase
Dubé, M.-P., Zetler, R., Barhdadi, A., Brown, A. M. K., Mongrain, I., Normand, V., Laplante, N., Asselin, G., Zada, Y. F., Provost, S., et al. (2014) · Circulation: Cardiovascular Genetics · doi:10.1161/circgenetics.113.000395 · Cited by 44
Song, Y., Choi, J.-E., Kwon, Y.-J., Chang, H.-J., Kim, J. O., Park, D.-H., Park, J.-M., Kim, S.-J., Lee, J. W., & Hong, K.-W. (2021) · Journal of Translational Medicine · doi:10.1186/s12967-021-02751-3 · Cited by 41
Stefanaki, I., Panagiotou, O. A., Kodela, E., Gogas, H. J., Kypreou, K. P., Chatzinasiou, F., Nikolaou, V. A., Plaka, M., Kalfa, I., Antoniou, C., et al. (2013) · PLoS ONE · doi:10.1371/journal.pone.0055712 · Cited by 42
“All but one (rs1805005) nominally significant associations in our selected set of SNPs came from a subgroup of variants which had p values of 10(27) and are likely to represent genuine associations [45].”
BackgroundSelf-citationA Systematic Review of Genome-Wide Association Studies of Antipsychotic Response
Allen, J. D., & Bishop, J. R. (2019) · Pharmacogenomics · doi:10.2217/pgs-2018-0163 · Cited by 42
Large-Scale Phenomic and Genomic Analysis of Brain Asymmetrical Skew
Kong, X., Postema, M. C., Schijven, D., Carrión-Castillo, A., Pepe, A., Crivello, F., Joliot, M., Mazoyer, B. M., Fisher, S. E., & Francks, C. (2021) · Cerebral Cortex · doi:10.1093/cercor/bhab075 · Cited by 40
“We applied the commonly-used genome-wide significance threshold P value of 5e−08 to assign significance in the context of genome-wide multiple testing, which accounts for the number of SNPs tested in a modern GWAS study, and the correlation structure between SNPs in European ancestry populations (Hoggart et al. 2008;…”
MethodInsights into the genetics of gastroesophageal reflux disease (GERD) and GERD‐related disorders
Böhmer, A. C., & Schumacher, J. (2017) · Neurogastroenterology & Motility · doi:10.1111/nmo.13017 · Cited by 40
Multiple QTL underlie milk phenotypes at the CSF2RB locus
Lopdell, T., Tiplady, K., Couldrey, C., Johnson, T., Keehan, M., Davis, S. R., Harris, B. L., Spelman, R. J., Snell, R. G., & Littlejohn, M. D. (2019) · Genetics Selection Evolution · doi:10.1186/s12711-019-0446-x · Cited by 39
Genome-wide association study of sepsis in extremely premature infants
Srinivasan, L., Page, G. P., Kirpalani, H. M., Murray, J. C., Das, A., Higgins, R. D., Carlo, W. A., Bell, E. F., Goldberg, R. N., Schibler, K. R., et al. (2017) · Archives of Disease in Childhood Fetal & Neonatal · doi:10.1136/archdischild-2016-311545 · Cited by 42
Guerrero, J., Andrello, M., Burgarella, C., & Manel, S. (2018) · New Phytologist · doi:10.1111/nph.15171 · Cited by 44
Genome-wide association study and functional validation implicates JADE1 in tauopathy
Farrell, K. W., Kim, S., Han, N., Iida, M. A., Gonzalez, E. M., Otero‐García, M., Walker, J. M., Richardson, T. E., Renton, A. E., Andrews, S. J., et al. (2021) · Acta Neuropathologica · doi:10.1007/s00401-021-02379-z · Cited by 39
P-values in genomics: Apparent precision masks high uncertainty
Lazzeroni, L. C., Lü, Y., & Belitskaya‐Lévy, I. (2014) · Molecular Psychiatry · doi:10.1038/mp.2013.184 · Cited by 37
Goñi, L., Milagro, F. I., Cuervo, M., & Martínez, J. A. (2014) · Nutrition Reviews · doi:10.1111/nure.12143 · Cited by 39
Identification of unique venous thromboembolism-susceptibility variants in African-Americans
Armasu, S. M., McCauley, B. M., Kullo, I., Sicotte, H., Pathak, J., Chute, C. G., Gottesman, O., Böttinger, E. P., Denny, J. C., Roden, D. M., et al. (2017) · Thrombosis and Haemostasis · doi:10.1160/th16-08-0652 · Cited by 39
“0xE-08 to declare genome-wide significance (31).”
Oei, L., Estrada, K., Duncan, E. L., Christiansen, C., Liu, C., Langdahl, B. L., Obermayer-Pietsch, B. M., Riancho, J. A., Prince, R. L., van Schoor, N. M., et al. (2013) · Bone · doi:10.1016/j.bone.2013.10.015 · Cited by 37
“It is expected that discoveries at underpowered settings would have low positive predictive value for true findings and this applies even for signals that pass a stringent genome-wide significance threshold [69].”
BackgroundSelf-citationOpsahl, J. O., Moen, G.-H., Qvigstad, E., Böttcher, Y., Birkeland, K. I., & Sommer, C. (2020) · Journal of Developmental Origins of Health and Disease · doi:10.1017/s2040174420000811 · Cited by 37
Genome-wide association study identifies a locus associated with rotator cuff injury
Roos, T. R., Roos, A. K., Avins, A. L., Ahmed, M. A., Kleimeyer, J. P., Fredericson, M., Ioannidis, J. P. A., Dragoo, J. L., & Kim, S. K. (2017) · PLoS ONE · doi:10.1371/journal.pone.0189317 · Cited by 36
Self-citationVelie, B. D., Shrestha, M., Franҫois, L., Schurink, A., Tesfayonas Yohannes, G., Stinckens, A., Blott, S. C., Ducro, B. J., Mikko, S., Thomas, R., et al. (2016) · PLoS ONE · doi:10.1371/journal.pone.0152966 · Cited by 38
Metadata
- Authors
- Panagiotou, O. A., Ioannidis, J. P. A., & for the Genome-Wide Significance Project
- Affiliations
- University of Ioannina (GR)
- Corresponding author
- Ioannidis, John P A
- Venue
- International Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2011-12-05
- Volume
- 41
- Issue
- 1
- Pages
- 273-286
- ISSN
- 0300-5771 (ISSN-L)
- 1464-3685
- OpenAlex
- W2141749392
- Cited by
- 286
- References
- 107
- Citations by year
- 2026: 9 · 2025: 11 · 2024: 17 · 2023: 10 · 2022: 13 · 2021: 43 · 2020: 15 · 2019: 22 · 2018: 20 · 2017: 31 · 2016: 20 · 2015: 14 · 2014: 22 · 2013: 27 · 2012: 12
- FWCI
- 12.19
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- International Journal of Epidemiology (publishedVersion)
- PubMed (publishedVersion)
- HighWire Press Open Archive (submittedVersion)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Associations and Epidemiology
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Mapping and Diversity in Plants and Animals
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- replication, false discovery rate, p-value threshold, common genetic variants, linkage disequilibrium, false positives, genome-wide association study
- MeSH terms
- Humans, Reference Standards, Polymorphism, Single Nucleotide, Empirical Research, Genome-Wide Association Study, Genetic Association Studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.