The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Reweighting UK Biobank corrects for pervasive selection bias due to volunteering
Open accessAbstract
Background: Biobanks typically rely on volunteer-based sampling. This results in large samples (power) at the cost of representativeness (bias). The problem of volunteer bias is debated. Here, we (i) show that volunteering biases associations in UK Biobank (UKB) and (ii) estimate inverse probability (IP) weights that correct for volunteer bias in UKB. Methods: Drawing on UK Census data, we constructed a subsample representative of UKB’s target population, which consists of all individuals invited to participate. Based on demographic variables shared between the UK Census and UKB, we estimated IP weights (IPWs) for each UKB participant. We compared 21 weighted and unweighted bivariate associations between these demographic variables to assess volunteer bias. Results: Volunteer bias in all associations, as naively estimated in UKB, was substantial—in some cases so severe that unweighted estimates had the opposite sign of the association in the target population. For example, older individuals in UKB reported being in better health, in contrast to evidence from the UK Census. Using IPWs in weighted regressions reduced 87% of volunteer bias on average. Volunteer-based sampling reduced the effective sample size of UKB substantially, to 32% of its original size. Conclusions: Estimates from large-scale biobanks may be misleading due to volunteer bias. We recommend IP weighting to correct for such bias. To aid in the construction of the next generation of biobanks, we provide suggestions on how to best ensure representativeness in a volunteer-based design. For UKB, IPWs have been made available.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Sudlow, C., Gallacher, J., Allen, N., Beral, V., Burton, P., Danesh, J., Downey, P., Elliott, P., Green, J., Landray, M., et al. (2015) · PLOS Medicine · doi:10.1371/journal.pmed.1001779 · Cited by 12,728
Marginal Structural Models and Causal Inference in Epidemiology
Robins, J. M., Hernán, M. Á., & Brumback, B. (2000) · Epidemiology · doi:10.1097/00001648-200009000-00011 · Cited by 5,581
Fry, A., Littlejohns, T. J., Sudlow, C., Doherty, N., Adamska, L., Sprosen, T., Collins, R., & Allen, N. E. (2017) · American Journal of Epidemiology · doi:10.1093/aje/kwx246 · Cited by 3,979
A structural approach to selection bias
Hernán, M. A., Hernández-Díaz, S., & Robins, J. M. (2004) · Epidemiology · doi:10.1097/01.ede.0000135174.63482.43 · Cited by 2,844
Constructing Inverse Probability Weights for Marginal Structural Models
Cole, S. R., & Hernan, M. A. (2008) · American Journal of Epidemiology · doi:10.1093/aje/kwn164 · Cited by 2,796 · cited 1×
“29 Fourth, the large sample size of the UK Census aids more precise IPW estimation (687 491 respondents in our final sample compared with 6666 in the HSE used by Stamatakis et al .”
Result23andMe Research Team, Lee, J. J., COGENT (Cognitive Genomics Consortium), Social Science Genetic Association Consortium, Wedow, R., Okbay, A., Kong, E., Maghzian, O., Zacher, M., Nguyen-Viet, T. A., et al. (2018) · Nature Genetics · doi:10.1038/s41588-018-0147-3 · Cited by 2,470
The “All of Us” Research Program
The All of Us Research Program Investigators (2019) · New England Journal of Medicine · doi:10.1056/nejmsr1809937 · Cited by 2,440
SARS-CoV-2 is associated with changes in brain structure in UK Biobank
Douaud, G., Lee, S., Alfaro-Almagro, F., Arthofer, C., Wang, C., McCarthy, P., Lange, F., Andersson, J. L. R., Griffanti, L., Duff, E., et al. (2022) · Nature · doi:10.1038/s41586-022-04569-5 · Cited by 1,646
Solon, G., Haider, S. J., & Wooldridge, J. M. (2015) · Journal of Human Resources · doi:10.3368/jhr.50.2.301 · Cited by 1,367 · cited 1×
“17,18 21 Type 2 selection bias occurs if the effect of the exposure on the outcome is heterogeneous within the target population and selection is based on a variable that modifies the effect of the exposure on the outcome.”
BackgroundWood, A. M., Kaptoge, S., Butterworth, A. S., Willeit, P., Warnakula, S., Bolton, T., Paige, E., Paul, D. S., Sweeting, M., Burgess, S., et al. (2018) · The Lancet · doi:10.1016/s0140-6736(18)30134-x · Cited by 1,188
What makes UK Biobank special?
Collins, R. (2012) · The Lancet · doi:10.1016/s0140-6736(12)60404-8 · Cited by 1,128
Why Representativeness Should Be Avoided
Rothman, K. J., Gallacher, J. E., & Hatch, E. E. (2013) · International Journal of Epidemiology · doi:10.1093/ije/dys223 · Cited by 861
Genome-wide association studies of brain imaging phenotypes in UK Biobank
Elliott, L. T., Sharp, K., Alfaro-Almagro, F., Shi, S., Miller, K. L., Douaud, G., Marchini, J., & Smith, S. M. (2018) · Nature · doi:10.1038/s41586-018-0571-7 · Cited by 834
Batty, G. D., Gale, C. R., Kivimäki, M., Deary, I. J., & Bell, S. (2020) · BMJ · doi:10.1136/bmj.m131 · Cited by 635 · cited 3×
“16 However, in a volunteer-based sample, various types of selection biases may arise, which cause the association of interest to differ from the true association present in the underlying target population.”
BackgroundMethodUK Biobank: Current status and what it means for epidemiology
Allen, N., Sudlow, C., Downey, P., Peakman, T., Danesh, J., Elliott, P., Gallacher, J., Green, J., Matthews, P., Pell, J., et al. (2012) · Health Policy and Technology · doi:10.1016/j.hlpt.2012.07.003 · Cited by 521
Genetic analyses identify widespread sex-differential participation bias
Pirastu, N., Cordioli, M., Nandakumar, P., Mignogna, G., Abdellaoui, A., Hollis, B., Kanai, M., Rajagopal, V. M., Parolo, P. D. B., Baya, N., et al. (2021) · Nature Genetics · doi:10.1038/s41588-021-00846-7 · Cited by 251 · cited 1×
“28 An IP weighting strategy should be used instead.”
MethodStamatakis, E., Owen, K. B., Shepherd, L., Drayton, B., Hamer, M., & Bauman, A. E. (2021) · Epidemiology · doi:10.1097/ede.0000000000001316 · Cited by 192
UK Biobank, big data, and the consequences of non-representativeness
Keyes, K. M., & Westreich, D. (2019) · The Lancet · doi:10.1016/s0140-6736(18)33067-8 · Cited by 187 · cited 1×
“17,22 Under type 2 selection bias, internal validity may hold but external validity is at risk.”
BackgroundThe UK Biobank and selection bias
Swanson, J. M. (2012) · The Lancet · doi:10.1016/s0140-6736(12)61179-9 · Cited by 130
Cited by
Guidelines for performing Mendelian randomization investigations: update for summer 2023
Burgess, S., Davey Smith, G., Davies, N. M., Dudbridge, F., Gill, D., Glymour, M. M., Hartwig, F. P., Kutalik, Z., Holmes, M. V., Minelli, C., et al. (2023) · Wellcome Open Research · doi:10.12688/wellcomeopenres.15555.3 · Cited by 721
Participation bias in the UK Biobank distorts genetic associations and downstream analyses
Schoeler, T., Speed, D., Porcu, E., Pirastu, N., Pingault, J.-B., & Kutalik, Z. (2023) · Nature Human Behaviour · doi:10.1038/s41562-023-01579-9 · Cited by 404
Metadata
- Authors
- van Alten, S., Domingue, B. W., Faul, J., Galama, T., & Marees, A. T.
- Venue
- International Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2024-04-11
- Volume
- 53
- Issue
- 3
- ISSN
- 0300-5771 (ISSN-L)
- 1464-3685
- OpenAlex
- W4396729544
- Cited by
- 184
- References
- 19
- FWCI
- 53.24
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.