Large Upward Bias in Estimation of Locus-Specific Effects from Genomewide Scans
Open accessAbstract
The primary goal of a genomewide scan is to estimate the genomic locations of genes influencing a trait of interest. It is sometimes said that a secondary goal is to estimate the phenotypic effects of each identified locus. Here, it is shown that these two objectives cannot be met reliably by use of a single data set of a currently realistic size. Simulation and analytical results, based on variance-components linkage analysis as an example, demonstrate that estimates of locus-specific effect size at genomewide LOD score peaks tend to be grossly inflated and can even be virtually independent of the true effect size, even for studies on large samples when the true effect size is small. However, the bias diminishes asymptotically. The explanation for the bias is that the LOD score is a function of the locus-specific effect-size estimate, such that there is a high correlation between the observed statistical significance and the effect-size estimate. When the LOD score is maximized over the many pointwise tests being conducted throughout the genome, the locus-specific effect-size estimate is therefore effectively maximized as well. We argue that attempts at bias correction give unsatisfactory results, and that pointwise estimation in an independent data set may be the only way of obtaining reliable estimates of locus-specific effect-and then only if one does not condition on statistical significance being obtained. We further show that the same factors causing this bias are responsible for frequent failures to replicate initial claims of linkage or association for complex traits, even when the initial localization is, in fact, correct. The findings of this study have wide-ranging implications, as they apply to all statistical methods of gene localization. It is hoped that, by keeping this bias in mind, we will more realistically interpret and extrapolate from the results of genomewide scans.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The smaller odds ratios estimated from the replication data could be explained by the winner's curse and shrinkage to the mean.
“Moreover, the winner's curse and shrinkage to the mean (22,25,26) could explain the smaller odds ratios that we estimated from the replication data (Table 2).”
From A genome-wide scan for common alleles affecting risk for autism (2010) · cites this paper as [22]
The effect size at rs4141463 in the AGRE replication sample was much smaller than in the original AGP sample.
“When a smaller replication sample was analyzed, the risk allele at rs4141463 was again over-transmitted; yet, consistent with the winner's curse, its effect size in the replication sample was much smaller; and, for the combined samples, the association signal barely fell below the P < 5 × 10−8 threshold.”
From A genome-wide scan for common alleles affecting risk for autism (2010) · cites this paper as [22]
Cites
Introduction to Quantitative Genetics.
Edwards, A. W. F., & Falconer, D. S. (1982) · Biometrics · doi:10.2307/2529912 · Cited by 21,447 · see citing works
The Future of Genetic Studies of Complex Human Diseases
Risch, N., & Merikangas, K. (1996) · Science · doi:10.1126/science.273.5281.1516 · Cited by 5,355 · see citing works
Genetic dissection of complex traits: guidelines for interpreting and reporting linkage results
Lander, E. S., & Kruglyak, L. (1995) · Nature Genetics · doi:10.1038/ng1195-241 · Cited by 5,196 · see citing works
An introduction to population genetics theory
Crow, J. F., & Kimura, M. (1970) · Medical Entomology and Zoology · Cited by 4,223 · see citing works
An Introduction to Population Genetics Theory
J., A., Crow, J. F., & Kimura, M. (1971) · Population · doi:10.2307/1529706 · Cited by 3,523 · see citing works
Multipoint Quantitative-Trait Linkage Analysis in General Pedigrees
Almasy, L. A., & Blangero, J. (1998) · The American Journal of Human Genetics · doi:10.1086/301844 · Cited by 3,007 · see citing works
Self-citationKendall's Advanced Theory of Statistics.
Aa, Stuart, A., & Ord, K. (1995) · Journal of the American Statistical Association · doi:10.2307/2291187 · Cited by 2,657 · see citing works
Self, S. G., & Liang, K. (1987) · Journal of the American Statistical Association · doi:10.1080/01621459.1987.10478472 · Cited by 2,578 · see citing works
Sequential tests for the detection of linkage.
Morton, N. E. (1955) · PubMed · Cited by 1,590 · see citing works
Subset Selection in Regression
Miller, A. J. (2003) · Technometrics · doi:10.1198/tech.2003.s144 · Cited by 1,501 · see citing works
Efficiency of marker-assisted selection in the improvement of quantitative traits.
Lande, R., & Thompson, R. (1990) · Genetics · doi:10.1093/genetics/124.3.743 · Cited by 1,415 · see citing works
Introduction to Quantitative Genetics
P.B., S. (1963) · Poultry Science · doi:10.3382/ps.0420547 · Cited by 1,052 · see citing works
Robust Statistical Modeling Using the t Distribution
Lange, K. L., Little, R. J. A., & Taylor, J. M. G. (1989) · Journal of the American Statistical Association · doi:10.1080/01621459.1989.10478852 · Cited by 1,040 · see citing works
An Air-Drying Method for Meiotic Preparations from Mammalian Testes
Evans, E. P., Breckon, G., & Ford, C. E. (1964) · Cytogenetic and Genome Research · doi:10.1159/000129818 · Cited by 1,019 · see citing works
Robust Statistical Modeling Using the t Distribution
Lange, K. L., Little, R. J. A., & Taylor, J. M. G. (1989) · Journal of the American Statistical Association · doi:10.2307/2290063 · Cited by 812 · see citing works
Georges, M., Nielsen, D. M., Mackinnon, M. J., Mishra, A., Okimoto, R., Pasquino, A. T., Sargeant, L. S., Sørensen, A. P., Steele, M. R., & Zhao, X. (1995) · Genetics · doi:10.1093/genetics/139.2.907 · Cited by 623 · see citing works
Molecular Dissection of Complex Traits
Lee, M. J. (1998) · Crop Science · doi:10.2135/cropsci1998.0011183x003800040039x · Cited by 576 · see citing works
THE EFFECT OF METHODS OF ASCERTAINMENT UPON THE ESTIMATION OF FREQUENCIES
Fisher, R. A. (1934) · Annals of Eugenics · doi:10.1111/j.1469-1809.1934.tb02105.x · Cited by 548 · see citing works
Subset Selection in Regression.
RAAB, G. M., & Miller, T. (1991) · Biometrics · doi:10.2307/2532418 · Cited by 547 · see citing works
Melchinger, A. E., Utz, H. F., & Schön, C. (1998) · Genetics · doi:10.1093/genetics/149.1.383 · Cited by 532 · see citing works
Robust variance-components approach for assessing genetic linkage in pedigrees.
Amos, C. I. (1994) · PubMed · Cited by 520 · see citing works
Extensions to multivariate normal models for pedigree analysis
Hopper, J. L., & Mathews, J. D. (1982) · Annals of Human Genetics · doi:10.1111/j.1469-1809.1982.tb01588.x · Cited by 511 · see citing works
QTL analysis in plants; where are we now?
Kearsey, M. J., & Farquhar, A. G. L. (1998) · Heredity · doi:10.1046/j.1365-2540.1998.00500.x · Cited by 492 · see citing works
The Design of Replicated Studies
Lindsay, R. M., & Ehrenberg, A. S. C. (1993) · The American Statistician · doi:10.1080/00031305.1993.10475983 · Cited by 491 · see citing works
How many diseases does it take to map a gene with SNPs?
Weiss, K. M., & Terwilliger, J. D. (2000) · Nature Genetics · doi:10.1038/79866 · Cited by 478 · see citing works
Self-citationExtensions to pedigree analysis III. Variance components by the scoring method
LANGE, K., Westlake, J. R., & Spence, M. A. (1976) · Annals of Human Genetics · doi:10.1111/j.1469-1809.1976.tb00156.x · Cited by 426 · see citing works
Utz, H. F., Melchinger, A. E., & Schön, C. (2000) · Genetics · doi:10.1093/genetics/154.4.1839 · Cited by 364 · see citing works
Molecular Dissection of Complex Traits
Paterson, A. H. (2010) · CRC Press eBooks · doi:10.1201/9781420049381 · Cited by 345 · see citing works
Multipoint analysis of human quantitative genetic variation.
Goldgar, D. E. (1990) · PubMed · Cited by 307 · see citing works
Allison, D. B., Neale, M. C., Zannolli, R., Schork, N. J., Amos, C. I., & Blangero, J. (1999) · The American Journal of Human Genetics · doi:10.1086/302487 · Cited by 297 · see citing works
Self-citationTerwilliger, J. D., & Göring, H. H. H. (2009) · Human Biology · doi:10.3378/027.081.0615 · Cited by 256 · see citing works
Self-citation12 Variance component methods for detecting complex trait loci
Blangero, J., Williams, J. T., & Almasy, L. A. (2001) · Advances in genetics · doi:10.1016/s0065-2660(01)42021-9 · Cited by 238 · see citing works
Self-citationGenetic approaches to mental disorders
Gershon, E. S., & Cloninger, C. R. (1994) · American Psychiatric Press eBooks · Cited by 228 · see citing works
THE PROBLEM OF MULTIPLE INFERENCE IN STUDIES DESIGNED TO GENERATE HYPOTHESES
Thomas, D. C., Siemiatycki, J., Dewar, R. A. D., Robins, J. M., Goldberg, M. S., & Armstrong, B. (1985) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a114189 · Cited by 190 · see citing works
Göring, H. H. H., & Terwilliger, J. D. (2000) · The American Journal of Human Genetics · doi:10.1086/302845 · Cited by 185 · see citing works
Self-citationGenetic Approaches to Mental Disorders
Faraone, S. V. (1995) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-199503000-00018 · Cited by 141 · see citing works
Terwilliger, J. D., Shannon, W. D., Lathrop, G. M., Nolan, J. P., Goldin, L. R., Chase, G. A., & Weeks, D. E. (1997) · The American Journal of Human Genetics · doi:10.1086/514855 · Cited by 139 · see citing works
Self-citationPower of variance component linkage analysis to detect quantitative trait loci
Williams, J. T., & Blangero, J. (1999) · Annals of Human Genetics · doi:10.1046/j.1469-1809.1999.6360545.x · Cited by 128 · see citing works
Self-citationPower of variance component linkage analysis to detect quantitative trait loci.
Williams, J. T., & Blangero, J. (1999) · PubMed · doi:10.1017/s0003480099007848 · Cited by 120 · see citing works
Self-citationLinkage analysis in the presence of errors III: marker loci and their map as nuisance parameters.
Göring, H., & Terwilliger, J. (2000) · American Journal of Human Genetics · doi:10.1086/302846 · Cited by 107 · see citing works
Self-citationGöring, H. H. H., & Terwilliger, J. D. (2000) · The American Journal of Human Genetics · doi:10.1086/302797 · Cited by 96 · see citing works
Self-citationFaraway, J. J. (1992) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1992.10474582 · Cited by 80 · see citing works
Göring, H. H. H., & Terwilliger, J. D. (2000) · The American Journal of Human Genetics · doi:10.1086/302798 · Cited by 80 · see citing works
Self-citationQuantitative trait locus mapping using human pedigrees.
Blangero, J., Williams, J. T., & Almasy, L. A. (2000) · PubMed · Cited by 74 · see citing works
Self-citationAscertainment and goodness of fit of variance component models for pedigree data.
Boehnke, M., & Lange, K. (1984) · PubMed · Cited by 64 · see citing works
Simultaneous Inference in Epidemiological Studies
Jones, D. R. H., & Rushton, L. (1982) · International Journal of Epidemiology · doi:10.1093/ije/11.3.276 · Cited by 58 · see citing works
Beaty, T. H., Liang, K., & Rao, D. C. (1987) · Genetic Epidemiology · doi:10.1002/gepi.1370040305 · Cited by 50 · see citing works
Correcting for ascertainment bias in the COGA data set
Comuzzie, A. G., & Williams, J. T. (1999) · Genetic Epidemiology · doi:10.1002/gepi.1370170719 · Cited by 37 · see citing works
Rao, D. C., Wette, R., & Ewens, W. J. (1988) · PubMed · Cited by 34 · see citing works
Genetic analysis with hierarchical models
Witte, J. S. (1997) · Genetic Epidemiology · doi:10.1002/(sici)1098-2272(1997)14:6 · Cited by 33 · see citing works
The effects of conditioning on probands to correct for multiple ascertainment.
Boehnke, M., & Greenberg, D. A. (1984) · PubMed · Cited by 27 · see citing works
The interpretation of lods in linkage analysis
Edwards, J. H. (2008) · Cytogenetics and Cell Genetics · doi:10.1159/000130612 · Cited by 14 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Mendelian Randomization Analysis With Multiple Genetic Variants Using Summarized Data
Burgess, S., Butterworth, A., & Thompson, S. G. (2013) · Genetic Epidemiology · doi:10.1002/gepi.21758 · Cited by 6,050 · see citing works
Harold, D., Abraham, R., Hollingworth, P., Sims, R., Gerrish, A., Hamshere, M. L., Pahwa, J. S., Moskvina, V., Dowzell, K., Williams, A., et al. (2009) · Nature Genetics · doi:10.1038/ng.440 · Cited by 3,326 · see citing works
Lohmueller, K. E., Pearce, C. L., Pike, M., Lander, E. S., & Hirschhorn, J. N. (2003) · Nature Genetics · doi:10.1038/ng1071 · Cited by 1,900 · see citing works
Why Most Discovered True Associations Are Inflated
Ioannidis, J. P. A. (2008) · Epidemiology · doi:10.1097/ede.0b013e31818131e7 · Cited by 1,495 · see citing works
The genetics of depression: A review
Levinson, D. F. (2006) · Biological Psychiatry · doi:10.1016/j.biopsych.2005.08.024 · Cited by 855 · see citing works
A genome-wide scan for common alleles affecting risk for autism
Anney, R., Klei, L., Pinto, D., Regan, R., Conroy, J., Magalhaes, T. R., Correia, C., Abrahams, B. S., Sykes, N., Pagnamenta, A. T., et al. (2010) · Human Molecular Genetics · doi:10.1093/hmg/ddq307 · Cited by 593 · see citing works
Chen, W., Stambolian, D., Edwards, A. O., Branham, K. E., Othman, M., Jakobsdottir, J., Tosakulwong, N., Pericak-Vance, M. A., Campochiaro, P. A., Klein, M. L., et al. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0912702107 · Cited by 506 · see citing works
Zareparsi, S., Branham, K. E. H., Li, M., Shah, S., Klein, R. J., Ott, J., Hoh, J., Abecasis, G. R., & Swaroop, A. (2005) · The American Journal of Human Genetics · doi:10.1086/431426 · Cited by 371 · see citing works
Dapas, M., Lin, F. T. J., Nadkarni, G. N., Sisk, R., Legro, R. S., Urbanek, M., Hayes, M. G., & Dunaif, A. (2020) · PLOS Medicine · doi:10.1371/journal.pmed.1003132 · Cited by 297 · see citing works
Genetic predictors of response to antidepressants in the GENDEP project
Uher, R., Huezo-Diaz, P., Perroud, N., Smith, R., Rietschel, M., Mors, O., Hauser, J., Maier, W., Kozel, D., Henigsberg, N., et al. (2009) · The Pharmacogenomics Journal · doi:10.1038/tpj.2009.12 · Cited by 226 · see citing works
Multivariable Modeling Strategies
Harrell, F. E. (2015) · Springer Series in Statistics · doi:10.1007/978-3-319-19425-7_4 · Cited by 221 · see citing works
Quantifying and correcting for the winner's curse in genetic association studies
Xiao, R., & Boehnke, M. (2009) · Genetic Epidemiology · doi:10.1002/gepi.20398 · Cited by 192 · see citing works
Ding, J., Gudjonsson, J. E., Liang, L., Stuart, P. E., Li, Y., Chen, W., Weichenthal, M., Ellinghaus, E., Franke, A., Cookson, W., et al. (2010) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2010.10.024 · Cited by 180 · see citing works
Taylor, A. E., Davies, N. M., Ware, J. J., VanderWeele, T., Smith, G. D., & Munafò, M. R. (2014) · Economics & Human Biology · doi:10.1016/j.ehb.2013.12.002 · Cited by 166 · see citing works
Pereira, T. V., & Ioannidis, J. P. A. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.12.012 · Cited by 160 · see citing works
Flannick, J., Beer, N. L., Bick, A. G., Agarwala, V., Molnes, J., Gupta, N., Burtt, N. P., Florez, J. C., Meigs, J. B., Taylor, H., et al. (2013) · Nature Genetics · doi:10.1038/ng.2794 · Cited by 136 · see citing works
McClay, J. L., Adkins, D. E., Åberg, K., Bukszár, J., Khachane, A. N., Keefe, R. S. E., Perkins, D. O., McEvoy, J. P., Stroup, T. S., Vann, R. E., et al. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2010.193 · Cited by 124 · see citing works
Statistical Testing of Shared Genetic Control for Potentially Related Traits
Wallace, C. (2013) · Genetic Epidemiology · doi:10.1002/gepi.21765 · Cited by 115 · see citing works
Upward bias in odds ratio estimates from genome‐wide association studies
Garner, C. (2007) · Genetic Epidemiology · doi:10.1002/gepi.20209 · Cited by 103 · see citing works
Reduction of selection bias in genomewide studies by resampling
Sun, L., & Bull, S. B. (2005) · Genetic Epidemiology · doi:10.1002/gepi.20068 · Cited by 73 · see citing works
Genotype-Specific Recurrence Risks as Indicators of the Genetic Architecture of Complex Diseases
Slatkin, M. (2008) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2008.06.011 · Cited by 9 · see citing works
- Authors
- Göring, H. H. H., Terwilliger, J. D., & Blangero, J.
- Affiliations
- Texas Biomedical Research Institute (US)
- New York State Psychiatric Institute (US)
- Corresponding author
- Göring, Harald H.H.
- Venue
- The American Journal of Human Genetics
- Publisher
- Elsevier BV
- Published
- 2001-12
- Volume
- 69
- Issue
- 6
- Pages
- 1357-1369
- ISSN
- 0002-9297 (ISSN-L)
- PMC
- PMC1235546
- OpenAlex
- W1990250261
- Cited by
- 483
- References
- 52
- Citations by year
- 2026: 7 · 2025: 11 · 2024: 4 · 2023: 10 · 2022: 6 · 2021: 11 · 2020: 9 · 2019: 5 · 2018: 7 · 2017: 16 · 2016: 12 · 2015: 9 · 2014: 7 · 2013: 19 · 2012: 19
- FWCI
- 17.70
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- Locations
- The American Journal of Human Genetics (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Heart, Lung, and Blood Institute (HL-28972, P01HL045522, HL45522, P01HL028972)
- National Institute of Mental Health (MH63749, R37MH059490, R01MH063749, MH59490, R01MH059490)
- National Institute of General Medical Sciences (GM-31575, R01GM031575)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Associations and Epidemiology
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Mapping and Diversity in Plants and Animals
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic and phenotypic traits in livestock
- Keywords
- upward bias, lod score, gene localization, replication failure, complex traits, bias correction, statistical significance
- MeSH terms
- Chromosome Mapping, Computer Simulation, Humans, Lod Score, Pedigree, Research Design, Bias, Likelihood Functions, Sample Size
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review