Collider Scope: When selection bias can substantially influence observed associations
Open accessPreprint — published as 10.1093/ije/dyx206 · Paper page
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
Large-scale cross-sectional and cohort studies have transformed our understanding of the genetic and environmental determinants of health outcomes. However, the representativeness of these samples may be limited – either through selection into studies, or by attrition from studies over time. Here we explore the potential impact of this selection bias on results obtained from these studies, from the perspective that this amounts to conditioning on a collider (i.e., a form of collider bias). While it is acknowledged that selection bias will have a strong effect on representativeness and prevalence estimates, it is often assumed that it should not have a strong impact on estimates of associations. We argue that because selection can induce collider bias (which occurs when two variables independently influence a third variable, and that third variable is conditioned upon), selection can lead to substantially biased estimates of associations. In particular, selection related to phenotypes can bias associations with genetic variants associated with those phenotypes. In simulations, we show that even modest influences on selection into, or attrition from, a study can generate biased and potentially misleading estimates of both phenotypic and genotypic associations. Our results highlight the value of knowing which population your study sample is representative of. If the factors influencing selection and attrition are known, they can be adjusted for. For example, having DNA available on most participants in a birth cohort study offers the possibility of investigating the extent to which polygenic scores predict subsequent participation, which in turn would enable sensitivity analyses of the extent to which bias might distort estimates. Key Messages: Selection bias (including selective attrition) may limit the representativeness of large-scale cross-sectional and cohort studies. This selection bias may induce collider bias (which occurs when two variables independently influence a third variable, and that variable is conditioned upon). This may lead to substantially biased estimates of associations, including of genetic associations, even when selection / attrition is relatively modest.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An atlas of genetic correlations across human diseases and traits
ReproGen Consortium, Bulik-Sullivan, B., Psychiatric Genomics Consortium, Genetic Consortium for Anorexia Nervosa of the Wellcome Trust Case Control Consortium 3, Finucane, H. K., Anttila, V., Gusev, A., Day, F. R., Loh, P.-R., Duncan, L., et al. (2015) · Nature Genetics · doi:10.1038/ng.3406 · Cited by 4,255
A structural approach to selection bias
Hernán, M. A., Hernández-Díaz, S., & Robins, J. M. (2004) · Epidemiology · doi:10.1097/01.ede.0000135174.63482.43 · Cited by 2,844
Cohort Profile: The Avon Longitudinal Study of Parents and Children: ALSPAC mothers cohort
Fraser, A., Macdonald-Wallis, C., Tilling, K., Boyd, A., Golding, J., Davey Smith, G., Henderson, J., Macleod, J., Molloy, L., Ness, A., et al. (2013) · International Journal of Epidemiology · doi:10.1093/ije/dys066 · Cited by 2,494
Self-citationEndogenous Selection Bias: The Problem of Conditioning on a Collider Variable
Elwert, F., & Winship, C. (2014) · Annual Review of Sociology · doi:10.1146/annurev-soc-071913-043455 · Cited by 1,168
Why Representativeness Should Be Avoided
Rothman, K. J., Gallacher, J. E., & Hatch, E. E. (2013) · International Journal of Epidemiology · doi:10.1093/ije/dys223 · Cited by 861
Smith, G. D., Lawlor, D. A., Harbord, R., Timpson, N., Day, I., & Ebrahim, S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040352 · Cited by 569
Self-citationGanna, A., & Ingelsson, E. (2015) · The Lancet · doi:10.1016/s0140-6736(15)60175-1 · Cited by 411
Lane, J. M., Vlasac, I., Anderson, S. G., Kyle, S. D., Dixon, W. G., Bechtold, D. A., Gill, S., Little, M. A., Luik, A., Loudon, A., et al. (2016) · Nature Communications · doi:10.1038/ncomms10889 · Cited by 312
Using causal diagrams to guide analysis in missing data problems
Daniel, R. M., Kenward, M. G., Cousens, S. N., & De Stavola, B. L. (2012) · Statistical Methods in Medical Research · doi:10.1177/0962280210394469 · Cited by 155
Cited by
Recent Developments in Mendelian Randomization Studies
Zheng, J., Baird, D., Borges, M.-C., Bowden, J., Hemani, G., Haycock, P., Evans, D. M., & Smith, G. D. (2017) · Current Epidemiology Reports · doi:10.1007/s40471-017-0128-6 · Cited by 1,147
Self-citationSanderson, E., Davey Smith, G., Windmeijer, F., & Bowden, J. (2019) · International Journal of Epidemiology · doi:10.1093/ije/dyy262 · Cited by 1,085
Self-citationThinking Clearly About Correlations and Causation: Graphical Causal Models for Observational Data
Rohrer, J. M. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245917745629 · Cited by 1,002
iPSYCH-Broad Autism Group, Weiner, D. J., Psychiatric Genomics Consortium Autism Group, Wigdor, E. M., Ripke, S., Walters, R. K., Kosmicki, J. A., Grove, J., Samocha, K. E., Goldstein, J. I., et al. (2017) · Nature Genetics · doi:10.1038/ng.3863 · Cited by 516
Self-citationNiedzwiedz, C. L., O’Donnell, C. A., Jani, B. D., Demou, E., Ho, F. K., Celis-Morales, C., Nicholl, B. I., Mair, F. S., Welsh, P., Sattar, N., et al. (2020) · BMC Medicine · doi:10.1186/s12916-020-01640-8 · Cited by 403
Paternoster, L., Tilling, K., & Davey Smith, G. (2017) · PLOS Genetics · doi:10.1371/journal.pgen.1006944 · Cited by 271
Self-citationSchooling, C. M., Lopez, P. M., Yang, Z., Zhao, J. V., Au Yeung, S. L., & Huang, J. V. (2021) · Frontiers in Genetics · doi:10.3389/fgene.2020.610852 · Cited by 102
Sanchez‐Roige, S., Fontanillas, P., Elson, S. L., The 23andMe Research Team, Gray, J. C., de Wit, H., Davis, L. K., MacKillop, J., & Palmer, A. A. (2019) · Addiction Biology · doi:10.1111/adb.12574 · Cited by 101
Physical activity and longevity: how to move closer to causal inference
Wade, K. H., Richmond, R. C., & Davey Smith, G. (2018) · British Journal of Sports Medicine · doi:10.1136/bjsports-2017-098995 · Cited by 57
Survivor bias in Mendelian randomization analysis
Vansteelandt, S., Dukes, O., & Martinussen, T. (2018) · Biostatistics · doi:10.1093/biostatistics/kxx050 · Cited by 46
Metadata
- Authors
- Munafò, M. R., Tilling, K., Taylor, A. E., Evans, D. M., & Davey Smith, G.
- Venue
- bioRxiv (Cold Spring Harbor Laboratory)
- Publisher
- openRxiv
- Published
- 2016-10-07
- OpenAlex
- W2762967444
- Cited by
- 31
- References
- 9
- Type
- posted content
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.