Upward bias in odds ratio estimates from genome‐wide association studies
Abstract
Genome‐wide association studies are carried out to identify unknown genes for a complex trait. Polymorphisms showing the most statistically significant associations are reported and followed up in subsequent confirmatory studies. In addition to the test of association, the statistical analysis provides point estimates of the relationship between the genotype and phenotype at each polymorphism, typically an odds ratio in case‐control association studies. The statistical significance of the test and the estimator of the odds ratio are completely correlated. Selecting the most extreme statistics is equivalent to selecting the most extreme odds ratios. The value of the estimator, given the value of the statistical significance depends on the standard error of the estimator and the power of the study. This report shows that when power is low, estimates of the odds ratio from a genome‐wide association study, or any large‐scale association study, will be upwardly biased. Genome‐wide association studies are often underpowered given the low α levels required to declare statistical significance and the small individual genetic effects known to characterize complex traits. Factors such as low allele frequency, inadequate sample size and weak genetic effects contribute to large standard errors in the odds ratio estimates, low power and upwardly biased odds ratios. Studies that have high power to detect an association with the true odds ratio will have little or no bias, regardless of the statistical significance threshold. The results have implications for the interpretation of genome‐wide association analysis and the planning of subsequent confirmatory stages. Genet Epidemiol. 2007. © 2007 Wiley‐Liss, Inc.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
If the authors used the same or similar individuals to estimate the SNP-exposure and SNP-outcome associations, MR estimates could be biased by a form of the winner's curse.
“If the authors used the same or similar individuals to estimate the SNP-exposure and the SNP-outcome associations, MR estimates could be biased by a form of the winner’s curse,94 95 which occurs when the statistically strongest associations—usually using a P value threshold—are selected from the discovery sample.”
From Strengthening the Reporting of Observational Studies in Epidemiology using Mendelian Randomisation (STROBE-MR): explanation and elaboration. (2021) · cites this paper as [95]
Cites
(2005) · Springer eBooks · doi:10.1007/0-387-27255-0_9 · Cited by 20,333 · see citing works
McCullagh, P., & Nelder, J. A. (1989) · doi:10.1007/978-1-4899-3242-6 · Cited by 16,836 · see citing works
Continuous Univariate Distributions.
Omori, Y., Johnson, N. L., Kotz, S., & Balakrishnan, N. (1995) · Journal of the American Statistical Association · doi:10.2307/2291547 · Cited by 9,085 · see citing works
Statistical methods in cancer research. Volume I - The analysis of case-control studies.
Breslow, N. E., & Day, N. E. (1980) · PubMed · Cited by 4,895 · see citing works
Genome-wide association studies for common diseases and complex traits
Hirschhorn, J. N., & Daly, M. J. (2005) · Nature Reviews Genetics · doi:10.1038/nrg1521 · Cited by 2,853 · see citing works
Wald, A. (1943) · Transactions of the American Mathematical Society · doi:10.1090/s0002-9947-1943-0012401-3 · Cited by 2,522 · see citing works
Efficiency of marker-assisted selection in the improvement of quantitative traits.
Lande, R., & Thompson, R. (1990) · Genetics · doi:10.1093/genetics/124.3.743 · Cited by 1,415 · see citing works
Skol, A. D., Scott, L. J., Abecasis, G. R., & Boehnke, M. (2006) · Nature Genetics · doi:10.1038/ng1706 · Cited by 1,286 · see citing works
Georges, M., Nielsen, D. M., Mackinnon, M. J., Mishra, A., Okimoto, R., Pasquino, A. T., Sargeant, L. S., Sørensen, A. P., Steele, M. R., & Zhao, X. (1995) · Genetics · doi:10.1093/genetics/139.2.907 · Cited by 623 · see citing works
Molecular Dissection of Complex Traits
Lee, M. J. (1998) · Crop Science · doi:10.2135/cropsci1998.0011183x003800040039x · Cited by 576 · see citing works
Melchinger, A. E., Utz, H. F., & Schön, C. (1998) · Genetics · doi:10.1093/genetics/149.1.383 · Cited by 532 · see citing works
QTL analysis in plants; where are we now?
Kearsey, M. J., & Farquhar, A. G. L. (1998) · Heredity · doi:10.1046/j.1365-2540.1998.00500.x · Cited by 492 · see citing works
Large Upward Bias in Estimation of Locus-Specific Effects from Genomewide Scans
Göring, H. H. H., Terwilliger, J. D., & Blangero, J. (2001) · The American Journal of Human Genetics · doi:10.1086/324471 · Cited by 483 · see citing works
Utz, H. F., Melchinger, A. E., & Schön, C. (2000) · Genetics · doi:10.1093/genetics/154.4.1839 · Cited by 364 · see citing works
Wald's Test as Applied to Hypotheses in Logit Analysis
Hauck, W. W., & Donner, A. (1977) · Journal of the American Statistical Association · doi:10.2307/2286473 · Cited by 179 · see citing works
Optimal two‐stage genotyping in population‐based association studies
Satagopan, J. M., & Elston, R. C. (2003) · Genetic Epidemiology · doi:10.1002/gepi.10260 · Cited by 148 · see citing works
Genetic Approaches to Mental Disorders
Faraone, S. V. (1995) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-199503000-00018 · Cited by 141 · see citing works
Two‐Stage Designs for Gene–Disease Association Studies with Sample Size Constraints
Satagopan, J. M., Venkatraman, E. S., & Begg, C. B. (2004) · Biometrics · doi:10.1111/j.0006-341x.2004.00207.x · Cited by 121 · see citing works
Two‐Stage Designs for Gene–Disease Association Studies
Satagopan, J. M., Verbel, D., Venkatraman, E. S., Offit, K., & Begg, C. B. (2002) · Biometrics · doi:10.1111/j.0006-341x.2002.00163.x · Cited by 111 · see citing works
Judging Inference Adequacy in Logistic Regression
Jennings, D. E. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478292 · Cited by 95 · see citing works
Two‐Stage sampling designs for gene association studies
Thomas, D. C., Xie, R., & Gebregziabher, M. (2004) · Genetic Epidemiology · doi:10.1002/gepi.20047 · Cited by 85 · see citing works
Evaluating Statistical Significance in Two-Stage Genomewide Association Studies
Lin, D. Y. (2006) · The American Journal of Human Genetics · doi:10.1086/500812 · Cited by 66 · see citing works
The Use of Random Controls in Genetic Association Studies
Garner, C. P. (2006) · Human Heredity · doi:10.1159/000091833 · Cited by 9 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Skrivankova, V. W., Richmond, R. C., Woolf, B. A. R., Davies, N. M., Swanson, S. A., VanderWeele, T. J., Timpson, N. J., Higgins, J. P. T., Dimou, N., Langenberg, C., et al. (2021) · BMJ · doi:10.1136/bmj.n2233 · Cited by 1,648 · see citing works
Why Most Discovered True Associations Are Inflated
Ioannidis, J. P. A. (2008) · Epidemiology · doi:10.1097/ede.0b013e31818131e7 · Cited by 1,495 · see citing works
Mendelian Randomization: Concepts and Scope
Richmond, R. C., & Davey Smith, G. (2022) · Cold Spring Harbor Perspectives in Medicine · doi:10.1101/cshperspect.a040501 · Cited by 841 · see citing works
Does Oxytocin Increase Trust in Humans? A Critical Review of Research
Nave, G., Camerer, C., & McCullough, M. (2015) · Perspectives on Psychological Science · doi:10.1177/1745691615600138 · Cited by 309 · see citing works
So, H.-C., Gui, A. H. S., Cherny, S. S., & Sham, P. C. (2011) · Genetic Epidemiology · doi:10.1002/gepi.20579 · Cited by 289 · see citing works
Quantifying and correcting for the winner's curse in genetic association studies
Xiao, R., & Boehnke, M. (2009) · Genetic Epidemiology · doi:10.1002/gepi.20398 · Cited by 192 · see citing works
Pereira, T. V., & Ioannidis, J. P. A. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.12.012 · Cited by 160 · see citing works
Nakaoka, H., & Inoue, I. (2009) · Journal of Human Genetics · doi:10.1038/jhg.2009.95 · Cited by 111 · see citing works
Zhong, H., & Prentice, R. L. (2010) · Genetic Epidemiology · doi:10.1002/gepi.20437 · Cited by 94 · see citing works
- Authors
- Garner, C.
- Affiliations
- University of California, Irvine (US)
- Corresponding author
- Garner, Chad
- Venue
- Genetic Epidemiology
- Publisher
- Wiley
- Published
- 2007-01-31
- Volume
- 31
- Issue
- 4
- Pages
- 288-295
- ISSN
- 0741-0395 (ISSN-L)
- 1098-2272
- OpenAlex
- W2057289154
- Cited by
- 103
- References
- 23
- Citations by year
- 2025: 1 · 2024: 1 · 2023: 2 · 2022: 1 · 2021: 4 · 2020: 1 · 2019: 3 · 2018: 5 · 2017: 10 · 2016: 5 · 2015: 5 · 2014: 3 · 2013: 6 · 2012: 8
- FWCI
- 6.07
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Genetic Epidemiology (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Cancer Institute (R01CA-74415, R01CA058860, R01 CA 58860-10, R01CA074415)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Associations and Epidemiology
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Mapping and Diversity in Plants and Animals
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Keywords
- upward bias, odds ratio estimation, genome-wide association study, statistical significance thresholds, study power, standard errors, complex traits, case-control association, genetic effect size, allele frequency
- MeSH terms
- Computer Simulation, Gene Frequency, Genotype, Humans, Models, Genetic, Phenotype, Polymorphism, Genetic, Models, Statistical, Genome, Human, Odds Ratio, Genetic Predisposition to Disease
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review