Reduction of selection bias in genomewide studies by resampling
Abstract
The accuracy of gene localization, the reliability of locus‐specific effect estimates, and the ability to replicate initial claims of linkage and/or association have emerged as major methodological concerns in genomewide studies of complex diseases and quantitative traits. To address the issue of multiple comparisons inherent in genomewide studies, the use of stringent criteria for assessing statistical significance has been generally acknowledged as a strategy to control type I error. However, the application of genomewide significance criteria does not take account of the selection bias introduced into parameter estimates, e.g., estimates of locus‐specific effect size of disease/trait loci. Some have argued that reliable locus‐specific parameter estimates can only be obtained in an independent sample. In this report, we examine statistical resampling techniques, including cross‐validation and the bootstrap, applied to the initial sample to improve the estimation of locus‐specific effects. We compare them with the naïve method in which all data are used for both hypothesis testing and parameter estimation, as well as with the split‐sample approach in which part of the data are reserved for estimation. Upward bias of the naïve estimator and inadequacy of the split‐sample approach are derived analytically under a simple quantitative trait model. Simulation studies of the resampling methods are performed for both the simple model and a more realistic genomewide linkage analysis. Our results suggest that cross‐validation and bootstrap methods can substantially reduce the estimation bias, especially when the effect size is small or there is no genetic effect. Genet. Epidemiol . © 2005 Wiley‐Liss, Inc.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The smaller odds ratios estimated from the replication data could be explained by the winner's curse and shrinkage to the mean.
“Moreover, the winner's curse and shrinkage to the mean (22,25,26) could explain the smaller odds ratios that we estimated from the replication data (Table 2).”
From A genome-wide scan for common alleles affecting risk for autism (2010) · cites this paper as [26]
Cites
Genetic dissection of complex traits: guidelines for interpreting and reporting linkage results
Lander, E. S., & Kruglyak, L. (1995) · Nature Genetics · doi:10.1038/ng1195-241 · Cited by 5,196 · see citing works
Multipoint Quantitative-Trait Linkage Analysis in General Pedigrees
Almasy, L. A., & Blangero, J. (1998) · The American Journal of Human Genetics · doi:10.1086/301844 · Cited by 3,007 · see citing works
Parametric and nonparametric linkage analysis: a unified multipoint approach.
Kruglyak, L., Daly, M. J., Daly, M. J., & Lander, E. S. (1996) · PubMed Central · Cited by 2,883 · see citing works
Estimating the error rate of a prediction rule: improvement on cross-validation
Efron, B. (1983) · Journal of the American Statistical Association · doi:10.1080/01621459.1983.10477973 · Cited by 2,300 · see citing works
Improvements on Cross-Validation: The .632+ Bootstrap Method
Efron, B., & Tibshirani, R. J. (1997) · Journal of the American Statistical Association · doi:10.1080/01621459.1997.10474007 · Cited by 1,638 · see citing works
Selection bias in gene extraction on the basis of microarray gene-expression data
Ambroise, C., & McLachlan, G. J. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.102102699 · Cited by 1,487 · see citing works
Allele-sharing models: LOD scores and accurate linkage tests.
Kong, A., & Cox, N. (1997) · American Journal of Human Genetics · doi:10.1086/301592 · Cited by 1,036 · see citing works
Improvements on Cross-Validation: The .632+ Bootstrap Method
Efron, B., & Tibshirani, R. J. (1997) · Journal of the American Statistical Association · doi:10.2307/2965703 · Cited by 723 · see citing works
Robust variance-components approach for assessing genetic linkage in pedigrees.
Amos, C. I. (1994) · PubMed · Cited by 520 · see citing works
Large Upward Bias in Estimation of Locus-Specific Effects from Genomewide Scans
Göring, H. H. H., Terwilliger, J. D., & Blangero, J. (2001) · The American Journal of Human Genetics · doi:10.1086/324471 · Cited by 483 · see citing works
(1999) · Nature Genetics · doi:10.1038/8702 · Cited by 264 · see citing works
Genetic Approaches to Mental Disorders
Rainer, J. D. (1995) · American Journal of Psychotherapy · doi:10.1176/appi.psychotherapy.1995.49.2.302 · Cited by 155 · see citing works
Strategies for comparing treatments on a binary response with multi-centre data
Agresti, A., & Hartzel, J. S. (2000) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(20000430)19:8 · Cited by 102 · see citing works
Allison, D. B., Fernandez, J. R., Heo, M., Zhu, S., Etzel, C. J., Beasley, T. M., & Amos, C. I. (2002) · The American Journal of Human Genetics · doi:10.1086/339273 · Cited by 67 · see citing works
Upward Bias in Estimation of Genetic Effects
Siegmund, D. (2002) · The American Journal of Human Genetics · doi:10.1086/343819 · Cited by 27 · see citing works
Resnick, H. E., Rodríguez, B. L., Havlik, R. J., Ferrucci, L., Foley, D. J., Curb, J. D., & Harris, T. B. (2000) · Genetic Epidemiology · doi:10.1002/1098-2272(200007)19:1 · Cited by 25 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Lekadir, K., Frangi, A. F., Porras, A. R., Glocker, B., Cintas, C., Langlotz, C. P., Weicken, E., Asselbergs, F. W., Prior, F., Collins, G. S., et al. (2025) · BMJ · doi:10.1136/bmj-2024-081554 · Cited by 957 · see citing works
A genome-wide scan for common alleles affecting risk for autism
Anney, R., Klei, L., Pinto, D., Regan, R., Conroy, J., Magalhaes, T. R., Correia, C., Abrahams, B. S., Sykes, N., Pagnamenta, A. T., et al. (2010) · Human Molecular Genetics · doi:10.1093/hmg/ddq307 · Cited by 593 · see citing works
Quantifying and correcting for the winner's curse in genetic association studies
Xiao, R., & Boehnke, M. (2009) · Genetic Epidemiology · doi:10.1002/gepi.20398 · Cited by 192 · see citing works
Zhong, H., & Prentice, R. L. (2010) · Genetic Epidemiology · doi:10.1002/gepi.20437 · Cited by 94 · see citing works
- Authors
- Sun, L., & Bull, S. B.
- Affiliations
- University of Toronto (CA)
- Mount Sinai Hospital (CA)
- Corresponding author
- Sun, Lei
- Venue
- Genetic Epidemiology
- Publisher
- Wiley
- Published
- 2005-03-10
- Volume
- 28
- Issue
- 4
- Pages
- 352-367
- ISSN
- 0741-0395 (ISSN-L)
- 1098-2272
- OpenAlex
- W2075120043
- Cited by
- 73
- References
- 16
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 4 · 2023: 2 · 2022: 1 · 2021: 3 · 2019: 3 · 2018: 2 · 2017: 5 · 2016: 4 · 2015: 6 · 2014: 1 · 2013: 2 · 2012: 2
- FWCI
- 2.69
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Genetic Epidemiology (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Canadian Institutes of Health Research (64871_1, 55118_1)
- Natural Sciences and Engineering Research Council of Canada
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Associations and Epidemiology
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Mapping and Diversity in Plants and Animals
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic and phenotypic traits in livestock
- Keywords
- selection bias, genome-wide association study, resampling, cross-validation, bootstrapping, multiple comparisons, type I error control, estimation bias, quantitative traits, complex diseases
- MeSH terms
- Algorithms, Chromosome Mapping, Computer Simulation, Genetic Markers, Humans, Genetic Linkage, Models, Genetic, Genome, Human, Selection Bias, Sample Size, Siblings
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review