What should the genome-wide significance threshold be? Empirical replication of borderline genetic associations
The DOI matches its Crossref record; 106 of the 107 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Robust replication is a sine qua non for the rigorous documentation of proposed associations in the genome-wide association (GWA) setting. Currently, associations of common variants reaching P ≤ 5 × 10(-8) are considered replicated. However, there is some ambiguity about the most suitable threshold for claiming genome-wide significance. METHODS: We defined as 'borderline' associations those with P > 5 × 10(-8) and P ≤ 1 × 10(-7). The eligible associations were retrieved using the 'Catalog of Published Genome-Wide Association Studies'. For each association we assessed whether it reached P ≤ 5 × 10(-8) with inclusion of additional data from subsequent GWA studies. RESULTS: Thirty-four eligible genotype-phenotype associations were evaluated with data and clarifications contributed from diverse investigators. Replication data from subsequent GWA studies could be obtained for 26 of them. Of those, 19 associations (73%) reached P ≤ 5 × 10(-8) for the same or a related trait implicating either the exact same allele or one in very high linkage disequilibrium and 17 reached P < 10(-8). If the seven associations that did not reach P ≤ 5 × 10(-8) when additional data were considered are assumed to have been false-positives, the false-discovery rate for borderline associations is estimated to be 27% [95% confidence interval (CI) 12-48%]. For five associations, the current P-value is > 10(-6) [corresponding false-discovery rate 19% (95% CI 7-39%)]. CONCLUSION: A substantial proportion, but not all, of the associations with borderline genome-wide significance represent replicable, possibly genuine associations. Our empirical evaluation suggests a possible relaxation in the current GWS threshold.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Others have also observed this, revealing in their sample that a substantial minority of associations with borderline genome-wide significance represent replicable and possibly genuine associations [41].”
Citations
Cites
PLINK: a tool set for whole-genome association and population-based linkage analyses.
Purcell, S., Neale, B., Todd-Brown, K., Thomas, L., Ferreira, M. A. R., Bender, D., Maller, J., Sklar, P., de Bakker, P. I. W., Daly, M. J., et al. (2007) · The American Journal of Human Genetics · doi:10.1086/519795 · Cited by 34,089
Statistical significance for genomewide studies
Storey, J. D., & Tibshirani, R. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1530509100 · Cited by 9,692
Genome-wide association study of 14,000 cases of seven common diseases and 3,000 shared controls
The Wellcome Trust Case Control Consortium, Management Committee, Burton, P. R., Clayton, D. G., Cardon, L. R., Craddock, N., Deloukas, P., Duncanson, A., Kwiatkowski, D. P., McCarthy, M. I., et al. (2007) · Nature · doi:10.1038/nature05911 · Cited by 9,442
Finding the missing heritability of complex diseases
Manolio, T. A., Collins, F. S., Cox, N. J., Goldstein, D. B., Hindorff, L. A., Hunter, D. J., McCarthy, M. I., Ramos, E. M., Cardon, L. R., Chakravarti, A., et al. (2009) · Nature · doi:10.1038/nature08494 · Cited by 8,336
A map of human genome variation from population-scale sequencing.
The 1000 Genomes Project Consortium (2010) · Nature · doi:10.1038/nature09534 · Cited by 7,877
A haplotype map of the human genome
The International HapMap Consortium (2005) · Nature · doi:10.1038/nature04226 · Cited by 5,858
Hindorff, L. A., Sethupathy, P., Junkins, H. A., Ramos, E. M., Mehta, J. P., Collins, F. S., & Manolio, T. A. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0903103106 · Cited by 4,013
Biological, clinical and population relevance of 95 loci for blood lipids
Teslovich, T. M., Musunuru, K., Smith, A. V., Edmondson, A. C., Stylianou, I. M., Koseki, M., Pirruccello, J. P., Ripatti, S., Chasman, D. I., Willer, C. J., et al. (2010) · Nature · doi:10.1038/nature09270 · Cited by 3,487
Multiple significance tests: the Bonferroni method
Bland, J. M., & Altman, D. G. (1995) · BMJ · doi:10.1136/bmj.310.6973.170 · Cited by 3,341
A genome-wide association study identifies novel risk loci for type 2 diabetes
Sladek, R., Rocheleau, G., Rung, J., Dina, C., Shen, L., Serre, D., Boutin, P., Vincent, D., Belisle, A., Hadjadj, S., et al. (2007) · Nature · doi:10.1038/nature05616 · Cited by 2,993
Genome-wide association studies for complex traits: consensus, uncertainty and challenges
McCarthy, M. I., Abecasis, G. R., Cardon, L. R., Goldstein, D. B., Little, J., Ioannidis, J. P. A., & Hirschhorn, J. N. (2008) · Nature Reviews Genetics · doi:10.1038/nrg2344 · Cited by 2,891
Self-citationGenome-wide association analysis identifies loci for type 2 diabetes and triglyceride levels
Saxena, R., Voight, B. F., Lyssenko, V., Burtt, N. P., de Bakker, P. I. W., Chen, H., Roix, J. J., Kathiresan, S., Hirschhorn, J. N., Daly, M. J., et al. (2007) · Science · doi:10.1126/science.1142358 · Cited by 2,843
A genome-wide association study of type 2 diabetes in Finns detects multiple susceptibility variants
Scott, L. J., Mohlke, K. L., Bonnycastle, L. L., Willer, C. J., Li, Y., Duren, W. L., Erdos, M. R., Stringham, H. M., Chines, P. S., Jackson, A. U., et al. (2007) · Science · doi:10.1126/science.1142382 · Cited by 2,753
Replication of Genome-Wide Association Signals in UK Samples Reveals Risk Loci for Type 2 Diabetes
Zeggini, E., Weedon, M. N., Lindgren, C. M., Frayling, T. M., Elliott, K. S., Lango, H., Timpson, N. J., Perry, J. R. B., Rayner, N. W., Freathy, R. M., et al. (2007) · Science · doi:10.1126/science.1142364 · Cited by 2,194
Genomewide Association Analysis of Coronary Artery Disease
Samani, N. J., Erdmann, J., Hall, A. S., Hengstenberg, C., Mangino, M., Mayer, B., Dixon, R. J., Meitinger, T., Braund, P., Wichmann, H.-E., et al. (2007) · New England Journal of Medicine · doi:10.1056/nejmoa072366 · Cited by 2,044
Hundreds of variants clustered in genomic loci and biological pathways affect human height
Lango Allen, H., Estrada, K., Lettre, G., Berndt, S. I., Weedon, M. N., Rivadeneira, F., Willer, C. J., Jackson, A. U., Vedantam, S., Raychaudhuri, S., et al. (2010) · Nature · doi:10.1038/nature09410 · Cited by 1,945
Wellcome Trust Case Control Consortium, Zeggini, E., Scott, L. J., Saxena, R., Voight, B. F., Marchini, J. L., Hu, T., de Bakker, P. I., Abecasis, G. R., Almgren, P., et al. (2008) · Nature Genetics · doi:10.1038/ng.120 · Cited by 1,864
Systematic meta-analyses of Alzheimer disease genetic association studies: the AlzGene database
Bertram, L., McQueen, M. B., Mullin, K., Blacker, D., & Tanzi, R. E. (2007) · Nature Genetics · doi:10.1038/ng1934 · Cited by 1,857
Replication validity of genetic association studies
Ioannidis, J. P. A., Ntzani, E. E., Trikalinos, T. A., & Contopoulos-Ioannidis, D. G. (2001) · Nature Genetics · doi:10.1038/ng749 · Cited by 1,832
Self-citationGenome-wide association study reveals genetic risk underlying Parkinson's disease
Simón-Sánchez, J., Schulte, C., Bras, J. M., Sharma, M., Gibbs, J. R., Berg, D., Paisan-Ruiz, C., Lichtner, P., Scholz, S. W., Hernandez, D. G., et al. (2009) · Nature Genetics · doi:10.1038/ng.487 · Cited by 1,751
A comprehensive review of genetic association studies
Hirschhorn, J. N., Lohmueller, K., Byrne, E., & Hirschhorn, K. (2002) · Genetics in Medicine · doi:10.1097/00125817-200203000-00002 · Cited by 1,674
Newly identified loci that influence lipid concentrations and risk of coronary artery disease
Willer, C. J., Sanna, S., Jackson, A. U., Scuteri, A., Bonnycastle, L. L., Clarke, R., Heath, S. C., Timpson, N. J., Najjar, S. S., Stringham, H. M., et al. (2008) · Nature Genetics · doi:10.1038/ng.76 · Cited by 1,585
Kathiresan, S., Melander, O., Guiducci, C., Surti, A., Burtt, N. P., Rieder, M. J., Cooper, G. M., Roos, C., Voight, B. F., Havulinna, A. S., et al. (2008) · Nature Genetics · doi:10.1038/ng.75 · Cited by 1,386
Replicating genotype–phenotype associations
NCI-NHGRI Working Group on Replication in Association Studies, Chanock, S. J., Manolio, T., Boehnke, M., Boerwinkle, E., Hunter, D. J., Thomas, G., Hirschhorn, J. N., Abecasis, G., Altshuler, D., et al. (2007) · Nature · doi:10.1038/447655a · Cited by 1,352
SNAP: a web-based tool for identification and annotation of proxy SNPs using HapMap
Johnson, A. D., Handsaker, R. E., Pulit, S. L., Nizzari, M. M., O'Donnell, C. J., & de Bakker, P. I. W. (2008) · Bioinformatics · doi:10.1093/bioinformatics/btn564 · Cited by 1,330
Genome-wide association study meta-analysis identifies seven new rheumatoid arthritis risk loci
BIRAC Consortium, Stahl, E. A., YEAR Consortium, Raychaudhuri, S., Remmers, E. F., Xie, G., Eyre, S., Thomson, B. P., Li, Y., Kurreeman, F. A. S., et al. (2010) · Nature Genetics · doi:10.1038/ng.582 · Cited by 1,253
Wellcome Trust Case Control Consortium, Ferreira, M. A. R., O'Donovan, M. C., Meng, Y. A., Jones, I. R., Ruderfer, D. M., Jones, L., Fan, J., Kirov, G., Perlis, R. H., et al. (2008) · Nature Genetics · doi:10.1038/ng.209 · Cited by 1,237
Common variants on chromosome 6p22.1 are associated with schizophrenia
Shi, J., Levinson, D. F., Duan, J., Sanders, A. R., Zheng, Y., Pe’er, I., Dudbridge, F., Holmans, P. A., Whittemore, A. S., Mowry, B. J., et al. (2009) · Nature · doi:10.1038/nature08192 · Cited by 1,170
The NCBI dbGaP database of genotypes and phenotypes
Mailman, M. D., Feolo, M., Jin, Y., Kimura, M., Tryka, K., Bagoutdinov, R., Hao, L., Kiang, A., Paschall, J., Phan, L., et al. (2007) · Nature Genetics · doi:10.1038/ng1007-1181 · Cited by 1,105
Genome-wide association analysis identifies 20 loci that influence adult height
Initiative, D. G., Weedon, M. N., The Wellcome Trust Case Control Consortium, Cambridge GEM Consortium, Lango, H., Lindgren, C. M., Wallace, C., Evans, D. M., Mangino, M., Freathy, R. M., et al. (2008) · Nature Genetics · doi:10.1038/ng.121 · Cited by 826
International MS Genetics Consortium, De Jager, P. L., Jia, X., Wang, J., de Bakker, P. I. W., Ottoboni, L., Aggarwal, N. T., Piccio, L., Raychaudhuri, S., Tran, D., et al. (2009) · Nature Genetics · doi:10.1038/ng.401 · Cited by 800
Stacey, S. N., Manolescu, A., Sulem, P., Rafnar, T., Gudmundsson, J., Gudjonsson, S. A., Masson, G., Jakobsdottir, M., Thorlacius, S., Helgason, A., et al. (2007) · Nature Genetics · doi:10.1038/ng2064 · Cited by 786
Pe'er, I., Yelensky, R., Altshuler, D., & Daly, M. J. (2008) · Genetic Epidemiology · doi:10.1002/gepi.20303 · Cited by 783
Genome-wide association scan identifies a colorectal cancer susceptibility locus on chromosome 8q24
Zanke, B. W., Greenwood, C. M., Rangrej, J., Kustra, R., Tenesa, A., Farrington, S. M., Prendergast, J., Olschwang, S., Chiang, T., Crowdy, E., et al. (2007) · Nature Genetics · doi:10.1038/ng2089 · Cited by 724
Amundadottir, L., Kraft, P., Stolzenberg-Solomon, R. Z., Fuchs, C. S., Petersen, G. M., Arslan, A. A., Bueno-de-Mesquita, H. B., Gross, M., Helzlsouer, K., Jacobs, E. J., et al. (2009) · Nature Genetics · doi:10.1038/ng.429 · Cited by 706
the eMERGE Team, McCarty, C. A., Chisholm, R. L., Chute, C. G., Kullo, I. J., Jarvik, G. P., Larson, E. B., Li, R., Masys, D. R., Ritchie, M. D., et al. (2011) · BMC Medical Genomics · doi:10.1186/1755-8794-4-13 · Cited by 699
Gene–environment-wide association studies: emerging approaches
Thomas, D. (2010) · Nature Reviews Genetics · doi:10.1038/nrg2764 · Cited by 692
Park, J.-H., Wacholder, S., Gail, M. H., Peters, U., Jacobs, K. B., Chanock, S. J., & Chatterjee, N. (2010) · Nature Genetics · doi:10.1038/ng.610 · Cited by 678
Newly identified genetic risk variants for celiac disease related to the immune response
Hunt, K. A., Zhernakova, A., Turner, G., Heap, G. A. R., Franke, L., Bruinenberg, M., Romanos, J., Dinesen, L. C., Ryan, A. W., Panesar, D., et al. (2008) · Nature Genetics · doi:10.1038/ng.102 · Cited by 677
Clinical assessment incorporating a personal genome
Ashley, E. A., Butte, A. J., Wheeler, M. T., Chen, R., Klein, T. E., Dewey, F. E., Dudley, J. T., Ormond, K. E., Pavlovic, A., Morgan, A. A., et al. (2010) · The Lancet · doi:10.1016/s0140-6736(10)60452-7 · Cited by 674
Many sequence variants affecting diversity of adult human height
Gudbjartsson, D. F., Walters, G. B., Thorleifsson, G., Stefansson, H., Halldorsson, B. V., Zusmanovich, P., Sulem, P., Thorlacius, S., Gylfason, A., Steinberg, S., et al. (2008) · Nature Genetics · doi:10.1038/ng.122 · Cited by 666
Prioritizing GWAS Results: A Review of Statistical Methods and Recommendations for Their Application
Cantor, R. M., Lange, K., & Sinsheimer, J. S. (2010) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2009.11.017 · Cited by 622
MULTIPLE COMPARISON PROCEDURES UPDATED
Ludbrook, J. (1998) · Clinical and Experimental Pharmacology and Physiology · doi:10.1111/j.1440-1681.1998.tb02179.x · Cited by 618
Genetic associations in large versus small studies: an empirical assessment
Ioannidis, J. P., Trikalinos, T. A., Ntzani, E. E., & Contopoulos-Ioannidis, D. G. (2003) · The Lancet · doi:10.1016/s0140-6736(03)12516-0 · Cited by 579
Self-citationCommon variants at CD40 and other loci confer risk of rheumatoid arthritis
Raychaudhuri, S., Remmers, E. F., Lee, A. T., Hackett, R., Guiducci, C., Burtt, N. P., Gianniny, L., Korman, B. D., Padyukov, L., Kurreeman, F. A. S., et al. (2008) · Nature Genetics · doi:10.1038/ng.233 · Cited by 535
Soranzo, N., Spector, T. D., Mangino, M., Kühnel, B., Rendon, A., Teumer, A., Willenborg, C., Wright, B., Chen, L., Li, M., et al. (2009) · Nature Genetics · doi:10.1038/ng.467 · Cited by 523
High-Resolution Whole-Genome Association Study of Parkinson Disease
Maraganore, D. M., de Andrade, M., Lesnick, T. G., Strain, K. J., Farrer, M. J., Rocca, W. A., Pant, P. V. K., Frazer, K. A., Cox, D. R., & Ballinger, D. G. (2005) · The American Journal of Human Genetics · doi:10.1086/496902 · Cited by 508
Genome-wide association study of hematological and biochemical traits in a Japanese population
Kamatani, Y., Matsuda, K., Okada, Y., Kubo, M., Hosono, N., Daigo, Y., Nakamura, Y., & Kamatani, N. (2010) · Nature Genetics · doi:10.1038/ng.531 · Cited by 503
Han, J., Kraft, P., Nan, H., Guo, Q., Chen, C., Qureshi, A., Hankinson, S. E., Hu, F. B., Duffy, D. L., Zhao, Z. Z., et al. (2008) · PLoS Genetics · doi:10.1371/journal.pgen.1000074 · Cited by 499
Mangold, E., Ludwig, K. U., Birnbaum, S., Baluardo, C., Ferrian, M., Herms, S., Reutter, H., de Assis, N. A., Chawa, T. A., Mattheisen, M., et al. (2010) · Nature Genetics · doi:10.1038/ng.506 · Cited by 431
Evaluating coverage of genome-wide association studies
Barrett, J. C., & Cardon, L. R. (2006) · Nature Genetics · doi:10.1038/ng1801 · Cited by 415
A genome-wide association study of nasopharyngeal carcinoma identifies three new susceptibility loci
Bei, J.-X., Li, Y., Jia, W.-H., Feng, B.-J., Zhou, G., Chen, L.-Z., Feng, Q.-S., Low, H.-Q., Zhang, H., He, F., et al. (2010) · Nature Genetics · doi:10.1038/ng.601 · Cited by 410
Genome-wide association study of migraine implicates a common susceptibility variant on 8q22.1
the International Headache Genetics Consortium (2010) · Nature Genetics · doi:10.1038/ng.652 · Cited by 402
Overcoming the Winner’s Curse: Estimating Penetrance Parameters from Case-Control Data
Zöllner, S., & Pritchard, J. K. (2007) · The American Journal of Human Genetics · doi:10.1086/512821 · Cited by 382
Lesch, K.-P., Timmesfeld, N., Renner, T. J., Halperin, R., Röser, C., Nguyen, T. T., Craig, D. W., Romanos, J., Heine, M., Meyer, J., et al. (2008) · Journal of Neural Transmission · doi:10.1007/s00702-008-0119-3 · Cited by 374
Accounting for multiple comparisons in a genome-wide association study (GWAS)
Johnson, R. C., Nelson, G. W., Troyer, J. L., Lautenberger, J. A., Kessing, B. D., Winkler, C. A., & O'Brien, S. J. (2010) · BMC Genomics · doi:10.1186/1471-2164-11-724 · Cited by 342
Statistical significance tests.
Cox, D. (1982) · British Journal of Clinical Pharmacology · doi:10.1111/j.1365-2125.1982.tb01987.x · Cited by 334
Heterogeneity in Meta-Analyses of Genome-Wide Association Investigations
Ioannidis, J. P. A., Patsopoulos, N. A., & Evangelou, E. (2007) · PLoS ONE · doi:10.1371/journal.pone.0000841 · Cited by 331
Self-citationBoezen, H. M. (2009) · Proceedings of the American Thoracic Society · doi:10.1513/pats.200907-058dp · Cited by 329
The False-positive to False-negative Ratio in Epidemiologic Studies
Ioannidis, J. P. A., Tarone, R., & McLaughlin, J. K. (2011) · Epidemiology · doi:10.1097/ede.0b013e31821b506e · Cited by 321
Self-citationThe GAIN Collaborative Research Group (2007) · Nature Genetics · doi:10.1038/ng2127 · Cited by 318
Replication in Genome-Wide Association Studies
Kraft, P., Zeggini, E., & Ioannidis, J. P. A. (2009) · Statistical Science · doi:10.1214/09-sts290 · Cited by 290
Self-citationMeta-Analysis in Genome-Wide Association Studies
Zeggini, E., & Ioannidis, J. P. (2009) · Pharmacogenomics · doi:10.2217/14622416.10.2.191 · Cited by 283
Self-citationHeard-Costa, N. L., Zillikens, M. C., Monda, K. L., Johansson, Å., Harris, T. B., Fu, M., Haritunians, T., Feitosa, M. F., Aspelund, T., Eiriksdottir, G., et al. (2009) · PLoS Genetics · doi:10.1371/journal.pgen.1000539 · Cited by 282
Grant, S. F. A., Wang, K., Zhang, H., Glaberson, W., Annaiah, K., Kim, C. E., Bradfield, J. P., Glessner, J. T., Thomas, K. A., Garris, M., et al. (2009) · The Journal of Pediatrics · doi:10.1016/j.jpeds.2009.06.020 · Cited by 278
Soranzo, N., Rivadeneira, F., Chinappen-Horsley, U., Malkina, I., Richards, J. B., Hammond, N., Stolk, L., Nica, A., Inouye, M., Hofman, A., et al. (2009) · PLoS Genetics · doi:10.1371/journal.pgen.1000445 · Cited by 276
Taylor, K. D., Norris, J. M., & Rotter, J. I. (2007) · Diabetes · doi:10.2337/db07-1324 · Cited by 269
Failure to Replicate a Genetic Association May Provide Important Clues About Genetic Architecture
Greene, C. S., Penrod, N. M., Williams, S. M., & Moore, J. H. (2009) · PLoS ONE · doi:10.1371/journal.pone.0005639 · Cited by 266
Common Variants in the Trichohyalin Gene Are Associated with Straight Hair in Europeans
Medland, S. E., Nyholt, D. R., Painter, J. N., McEvoy, B. P., McRae, A. F., Zhu, G., Gordon, S. D., Ferreira, M. A. R., Wright, M. J., Henders, A. K., et al. (2009) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2009.10.009 · Cited by 261
Non-Replication and Inconsistency in the Genome-Wide Association Setting
Ioannidis, J. P. A. (2007) · Human Heredity · doi:10.1159/000103512 · Cited by 245
Self-citationCurses—Winner's and Otherwise—in Genetic Epidemiology
Kraft, P. (2008) · Epidemiology · doi:10.1097/ede.0b013e318181b865 · Cited by 225
Genetic variation in DPP6 is associated with susceptibility to amyotrophic lateral sclerosis
van Es, M. A., van Vught, P. W., Blauw, H. M., Franke, L., Saris, C. G., Van Den Bosch, L., de Jong, S. W., de Jong, V., Baas, F., van't Slot, R., et al. (2008) · Nature Genetics · doi:10.1038/ng.2007.52 · Cited by 214
Genome‐wide significance for dense SNP and resequencing data
Hoggart, C. J., Clark, T. G., De Iorio, M., Whittaker, J. C., & Balding, D. J. (2008) · Genetic Epidemiology · doi:10.1002/gepi.20292 · Cited by 209
Tse, K.-P., Su, W.-H., Chang, K.-P., Tsang, N.-M., Yu, C.-J., Tang, P., See, L.-C., Hsueh, C., Yang, M.-L., Hao, S.-P., et al. (2009) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2009.07.007 · Cited by 191
Galvan, A., Ioannidis, J. P. A., & Dragani, T. A. (2010) · Trends in Genetics · doi:10.1016/j.tig.2009.12.008 · Cited by 155
Self-citationKhoury, M. J., Bertram, L., Boffetta, P., Butterworth, A. S., Chanock, S. J., Dolan, S. M., Fortier, I., Garcia-Closas, M., Gwinn, M., Higgins, J. P. T., et al. (2009) · American Journal of Epidemiology · doi:10.1093/aje/kwp119 · Cited by 146
Self-citationA genome-wide association study of breast and prostate cancer in the NHLBI's Framingham Heart Study
Murabito, J. M., Rosenberg, C. L., Finger, D., Kreger, B. E., Levy, D. A., Splansky, G. L., Antman, K. H., & Hwang, S. (2007) · BMC Medical Genetics · doi:10.1186/1471-2350-8-s1-s6 · Cited by 132
Required sample size and nonreplicability thresholds for heterogeneous genetic associations
Moonesinghe, R., Khoury, M. J., Liu, T., & Ioannidis, J. P. A. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0705554105 · Cited by 108
Self-citationGenome-Wide Significance Levels and Weighted Hypothesis Testing
Roeder, K., & Wasserman, L. (2009) · Statistical Science · doi:10.1214/09-sts289 · Cited by 107
Simultaneous Inference: When Should Hypothesis Testing Problems Be Combined?
Efron, B. (2008) · Cited by 105
Ionita‐Laza, I., McQueen, M. B., Laird, N. M., & Lange, C. (2007) · The American Journal of Human Genetics · doi:10.1086/519748 · Cited by 103
Paré, G., Chasman, D. I., Parker, A. N., Nathan, D. M., Miletich, J. P., Zee, R. Y., & Ridker, P. M. (2008) · PLoS Genetics · doi:10.1371/journal.pgen.1000312 · Cited by 100
Non-replication of association studies: “pseudo-failures” to replicate?
Gorroochurn, P., Hodge, S. E., Heiman, G. A., Durner, M., & Greenberg, D. A. (2007) · Genetics in Medicine · doi:10.1097/gim.0b013e3180676d79 · Cited by 95
Zhong, H., & Prentice, R. L. (2010) · Genetic Epidemiology · doi:10.1002/gepi.20437 · Cited by 94
The Emergence of Networks in Human Genome Epidemiology: Challenges and Opportunities
Seminara, D., Khoury, M. J., O??Brien, T. R., Manolio, T., Gwinn, M. L., Little, J., Higgins, J. P. T., Bernstein, J. L., Boffetta, P., Bondy, M., et al. (2007) · Epidemiology · doi:10.1097/01.ede.0000249540.17855.b7 · Cited by 92
Self-citationYang, Q., Kathiresan, S., Lin, J.-P., Tofler, G. H., & O'Donnell, C. J. (2007) · BMC Medical Genetics · doi:10.1186/1471-2350-8-s1-s12 · Cited by 91
Genome-wide significance levels and weighted hypothesis testingPreprint
Roeder, K., & Wasserman, L. (2009) · Cited by 91
Birlea, S. A., Gowan, K., Fain, P. R., & Spritz, R. A. (2009) · Journal of Investigative Dermatology · doi:10.1038/jid.2009.347 · Cited by 90
A genome-wide association study identifies ITGA9 conferring risk of nasopharyngeal carcinoma
Ng, C. C., Yew, P. Y., Puah, S. M., Krishnan, G., Yap, L. F., Teo, S. H., Lim, P. V. H., Govindaraju, S., Ratnavelu, K., Sam, C. K., et al. (2009) · Journal of Human Genetics · doi:10.1038/jhg.2009.49 · Cited by 90
Simultaneous inference: When should hypothesis testing problems be combined?
Efron, B. (2008) · The Annals of Applied Statistics · doi:10.1214/07-aoas141 · Cited by 84
Chapter 1 Common Genetic Variation and Human Disease
Orr, N., & Chanock, S. J. (2008) · Advances in genetics · doi:10.1016/s0065-2660(08)00601-9 · Cited by 77
Voss, S., & George, S. (1995) · BMJ · doi:10.1136/bmj.310.6986.1073 · Cited by 63
Day-Williams, A. G., & Zeggini, E. (2011) · European Journal of Clinical Investigation · doi:10.1111/j.1365-2362.2010.02437.x · Cited by 60
Discovery Properties of Genome-wide Association Signals From Cumulatively Combined Data Sets
Pereira, T. V., Patsopoulos, N. A., Salanti, G., & Ioannidis, J. P. A. (2009) · American Journal of Epidemiology · doi:10.1093/aje/kwp262 · Cited by 60
Self-citationNext-generation association studies for complex traits
Zeggini, E. (2011) · Nature Genetics · doi:10.1038/ng0411-287 · Cited by 59
Panagiotou, O. A., Evangelou, E., & Ioannidis, J. P. A. (2010) · American Journal of Epidemiology · doi:10.1093/aje/kwq234 · Cited by 58
Self-citationJohansson, Å., Marroni, F., Hayward, C., Franklin, C. S., Kirichenko, A. V., Jonasson, I., Hicks, A. A., Vitart, V., Isaacs, A., Axenovich, T., et al. (2010) · Obesity · doi:10.1038/oby.2009.359 · Cited by 55
Hedges, L. V., Cooper, H. M., & Bushman, B. J. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.111.1.188 · Cited by 46
Common Genetic Variants for Breast Cancer: 32 Largely Refuted Candidates and Larger Prospects
Ioannidis, J. P. A. (2006) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/djj392 · Cited by 36
Self-citationSignificance Levels in Genome-Wide Interaction Analysis (GWIA)
Becker, T., Herold, C., Meesters, C., Mattheisen, M., & Baur, M. P. (2010) · Annals of Human Genetics · doi:10.1111/j.1469-1809.2010.00610.x · Cited by 28
Multiple testing in the genomics era: Findings from Genetic Analysis Workshop 15, Group 15
Martin, L. J., Woo, J. G., Avery, C. L., Chen, H., North, K. E., & on behalf of Group 15 (2007) · Genetic Epidemiology · doi:10.1002/gepi.20289 · Cited by 17
So, H., Yip, B. H. K., & Sham, P. C. (2010) · PLoS ONE · doi:10.1371/journal.pone.0013898 · Cited by 16
A two-step multiple-marker strategy for genome-wide association studies
Aschard, H., Guedj, M., & Démenais, F. (2007) · BMC Proceedings · doi:10.1186/1753-6561-1-s1-s134 · Cited by 8
Heritability, Weak Effects, and Rare Variants in Genomewide Association Studies
Cambien, F. (2011) · Clinical Chemistry · doi:10.1373/clinchem.2010.155655 · Cited by 7
Methods for Combining Multiple Genome-Wide Linkage Studies
Kippola, T. A., & Santorico, S. A. (2009) · Methods in molecular biology · doi:10.1007/978-1-60761-580-4_21 · Cited by 5
Genome-wide association studies using an adaptive two-stage analysis for a case-control design
Song, K. S., Lu, Q. L., Lin, X., Waterworth, D. M., & Elston, R. C. (2007) · BMC Proceedings · doi:10.1186/1753-6561-1-s1-s147 · Cited by 4
Research works printed but not linked: 1
- 10.1037/0033-2909.111.1.188 · doi:10.1037/0033-2909.111.1.188 · Paper page
Cited by
A Review of Feature Selection Methods for Machine Learning-Based Disease Risk Prediction
Pudjihartono, N., Fadason, T., Kempa-Liehr, A. W., & O'Sullivan, J. M. (2022) · Frontiers in Bioinformatics · doi:10.3389/fbinf.2022.927312 · Cited by 880
“(Panagiotou and Ioannidis, 2012) noted that a considerable number of legitimate and replicable associations can have p values just above this threshold; therefore, a possible relaxation of this commonly accepted threshold has been suggested.”
BackgroundMeta-analysis methods for genome-wide association studies and beyond
Evangelou, E., & Ioannidis, J. P. A. (2013) · Nature Reviews Genetics · doi:10.1038/nrg3472 · Cited by 596
Self-citationThe Autism Spectrum Disorders Working Group of The Psychiatric Genomics Consortium (2017) · Molecular Autism · doi:10.1186/s13229-017-0137-9 · Cited by 587
Statistical power and significance testing in large-scale genetic studies
Sham, P. C., & Purcell, S. M. (2014) · Nature Reviews Genetics · doi:10.1038/nrg3706 · Cited by 573
How to Use a Subgroup Analysis: Users’ Guide to the Medical Literature
Sun, X., Ioannidis, J. P. A., Agoritsas, T., Alba, A. C., & Guyatt, G. (2014) · JAMA · doi:10.1001/jama.2013.285063 · Cited by 550
Self-citation
Metadata
- Authors
- Panagiotou, O. A., Ioannidis, J. P. A., & for the Genome-Wide Significance Project
- Affiliations
- University of Ioannina (GR)
- Corresponding author
- Ioannidis, John P A
- Venue
- International Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2011-12-05
- Volume
- 41
- Issue
- 1
- Pages
- 273-286
- ISSN
- 0300-5771 (ISSN-L)
- 1464-3685
- OpenAlex
- W2141749392
- Cited by
- 286
- References
- 107
- Citations by year
- 2026: 9 · 2025: 11 · 2024: 17 · 2023: 10 · 2022: 13 · 2021: 43 · 2020: 15 · 2019: 22 · 2018: 20 · 2017: 31 · 2016: 20 · 2015: 14 · 2014: 22 · 2013: 27 · 2012: 12
- FWCI
- 12.19
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- International Journal of Epidemiology (publishedVersion)
- PubMed (publishedVersion)
- HighWire Press Open Archive (submittedVersion)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Associations and Epidemiology
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Mapping and Diversity in Plants and Animals
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- replication, false discovery rate, p-value threshold, common genetic variants, linkage disequilibrium, false positives, genome-wide association study
- MeSH terms
- Humans, Reference Standards, Polymorphism, Single Nucleotide, Empirical Research, Genome-Wide Association Study, Genetic Association Studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.