The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
How to investigate and adjust for selection bias in cohort studies
Open accessAbstract
Longitudinal cohort studies can provide important evidence about preventable causes of disease, but the success relies heavily on the commitment of their participants, both at recruitment and during follow up. Initial participation rates have decreased in recent decades as have willingness to participate in subsequent follow ups. It is important to examine how such selection affects the validity of the results. In this article, we describe the conceptual framework for selection bias due to nonparticipation and loss to follow up in cohort studies, using both a traditional epidemiological approach and directed acyclic graphs. Methods to quantify selection bias are introduced together with analytical strategies to adjust for the bias including controlling for covariates associated with selection, inverse probability weighting and bias analysis. We use several studies conducted in the Danish National Birth Cohort as examples of how to quantify selection bias and also understand the underlying selection mechanisms. Although women who chose to participate in this cohort were typically of higher social status, healthier and with less disease than all those eligible for study, differential selection was modest and the influence of selection bias on several selected exposure–outcome associations was limited. These findings are reassuring and support enrolling a subset of motivated participants who would engage in long‐term follow up rather than prioritize representativeness. Some of the presented methods are applicable even with limited data on nonparticipants and those lost to follow up, and can also be applied to other study designs such as case–control studies and surveys.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Marginal Structural Models and Causal Inference in Epidemiology
Robins, J. M., Hernán, M. Á., & Brumback, B. (2000) · Epidemiology · doi:10.1097/00001648-200009000-00011 · Cited by 5,581
Causal Diagrams for Epidemiologic Research
Greenland, S., Pearl, J., & Robins, J. M. (1999) · Epidemiology · doi:10.1097/00001648-199901000-00008 · Cited by 3,728
Air Pollution and Hospital Admissions for Heart Disease in Eight U.S. Counties
Schwartz, J. (1999) · Epidemiology · doi:10.1097/00001648-199901000-00005 · Cited by 3,038
Causality: models, reasoning, and inference
(2000) · Choice Reviews Online · doi:10.5860/choice.38-1494a · Cited by 2,873
A structural approach to selection bias
Hernán, M. A., Hernández-Díaz, S., & Robins, J. M. (2004) · Epidemiology · doi:10.1097/01.ede.0000135174.63482.43 · Cited by 2,844 · cited 4×
“have more extensively discussed these various types of scenarios (11)”
BackgroundMethodInfluential(1988) · Annals of Internal Medicine · doi:10.7326/0003-4819-108-2-316_4 · Cited by 1,926
Limitations of the Application of Fourfold Table Analysis to Hospital Data
Berkson, J. (1946) · Biometrics Bulletin · doi:10.2307/3002000 · Cited by 1,810 · cited 1×
“E?[S] D) as also illustrated in Figure 5 (the DAG on the right) (22).”
BackgroundMaternal Pesticide Exposure from Multiple Sources and Selected Congenital Anomalies
Shaw, G. M., Wasserman, C. R., OʼMalley, C. D., Nelson, V., & Jackson, R. J. (1999) · Epidemiology · doi:10.1097/00001648-199901000-00011 · Cited by 1,784
The Danish National Birth Cohort - its background, structure and aim
Olsen, J., Melbye, M., Olsen, S. F., Sørensen, T. I. A., Aaby, P., Nybo Andersen, A.-M., Taxbøl, D., Hansen, K. D., Juhl, M., Schow, T. B., et al. (2001) · Scandinavian Journal of Public Health · doi:10.1177/14034948010290040201 · Cited by 1,068
Robins, J. M., & Finkelstein, D. M. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00779.x · Cited by 877 · cited 1×
“Inverse probability weighting (IPW) technique is often used to control for selection bias (23,24).”
MethodSelf‐selection and bias in a large prospective pregnancy cohort in Norway
Nilsen, R. M., Vollset, S. E., Gjessing, H. K., Skjærven, R., Melve, K. K., Schreuder, P., Alsaker, E. R., Haug, K., Daltveit, A. K., & Magnus, P. (2009) · Paediatric and Perinatal Epidemiology · doi:10.1111/j.1365-3016.2009.01062.x · Cited by 835
Illustrating bias due to conditioning on a collider
Cole, S. R., Platt, R. W., Schisterman, E. F., Chu, H., Westreich, D., Richardson, D., & Poole, C. (2010) · International Journal of Epidemiology · doi:10.1093/ije/dyp334 · Cited by 796
Selective drop-out in longitudinal studies and non-biased prediction of behaviour disorders
Wolke, D., Waylen, A., Samara, M., Steer, C., Goodman, R., Ford, T., & Lamberts, K. (2009) · British Journal of Psychiatry · doi:10.1192/bjp.bp.108.053751 · Cited by 628
Does Low Participation in Cohort Studies Induce Bias?
Nohr, E. A., Frydenberg, M., Henriksen, T. B., & Olsen, J. (2006) · Epidemiology · doi:10.1097/01.ede.0000220549.14177.60 · Cited by 570
Self-citationWomen's Health Australia: Recruitment for a National Longitudinal Cohort Study
Brown, W. J., Bryson, L., Byles, J. E., Dobson, A. J., Lee, C., Mishra, G., & Schofield, M. (1999) · Women & Health · doi:10.1300/j013v28n01_03 · Cited by 564
(2009) · doi:10.1007/978-0-387-87959-8 · Cited by 554
Manjer, J., Carlsson, S., Elmståhl, S., Gullberg, B., Janzon, L., Lindström, M., Mattisson, I., & Berglund, G. (2001) · European Journal of Cancer Prevention · doi:10.1097/00008469-200112000-00003 · Cited by 542
The C8 Health Project: Design, Methods, and Participants
Frisbee, S. J., Brooks, A. P., Maher, A., Flensborg, P., Arnold, S., Fletcher, T., Steenland, K., Shankar, A., Knox, S. S., Pollard, C., et al. (2009) · Environmental Health Perspectives · doi:10.1289/ehp.0800379 · Cited by 359
Loss to Follow-up in Cohort Studies: Bias in Estimates of Socioeconomic Inequalities
Howe, L. D., Tilling, K., Galobardes, B., & Lawlor, D. A. (2013) · Epidemiology · doi:10.1097/ede.0b013e31827623b1 · Cited by 315
Recruitment Procedures of EPIC-Germany
Boeing, H., Korfmann, A., & Bergmann, M. M. (1999) · Annals of Nutrition and Metabolism · doi:10.1159/000012787 · Cited by 302
RESPONSE AND FOLLOW-UP BIAS IN COHORT STUDIES
GREENLAND, S. (1977) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a112451 · Cited by 255
Selection by socioeconomic factors into the Danish National Birth Cohort
Jacobsen, T. N., Nohr, E. A., & Frydenberg, M. (2010) · European Journal of Epidemiology · doi:10.1007/s10654-010-9448-2 · Cited by 211
Self-citationGullen, W. H. (1978) · JAMA · doi:10.1001/jama.1978.03280520027003 · Cited by 174
Approaches for drawing causal inferences from epidemiological birth cohorts: A review
Richmond, R. C., Al-Amin, A., Smith, G. D., & Relton, C. L. (2014) · Early Human Development · doi:10.1016/j.earlhumdev.2014.08.023 · Cited by 139
THE EFFECT OF RESPONSE BIAS ON THE ODDS RATIO
Austin, M. A., Criqui, M. H., Barrett-Connor, E. L., & Holdbrook, M. J. (1981) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a113160 · Cited by 131
RESPONSE BIAS AND RISK RATIOS IN EPIDEMIOLOGIC STUDIES
Criqui, M. H. (1979) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a112695 · Cited by 130
Estimating Bias From Loss to Follow-up in the Danish National Birth Cohort
Greene, N., Greenland, S., Olsen, J., & Nohr, E. A. (2011) · Epidemiology · doi:10.1097/ede.0b013e31822939fd · Cited by 118
Self-citationCharacteristics of respondents and non-respondents to a mailed questionnaire.
Barton, J., Bain, C., Hennekens, C. H., ROSNER, B. A., Belanger, C., Roth, A., & Speizer, F. E. (1980) · American Journal of Public Health · doi:10.2105/ajph.70.8.823 · Cited by 114
Nohr, E. A., & Olsen, J. (2013) · International Journal of Epidemiology · doi:10.1093/ije/dyt102 · Cited by 78
Self-citationWinding, T. N., Andersen, J. H., Labriola, M., & Nohr, E. A. (2013) · Journal of Epidemiology & Community Health · doi:10.1136/jech-2013-202707 · Cited by 76
Self-citationPizzi, C., Stavola, B. L. D., Pearce, N. E., Lazzarato, F., Ghiotti, P., Merletti, F., & Richiardi, L. (2011) · Journal of Epidemiology & Community Health · doi:10.1136/jech-2011-200065 · Cited by 55
Examining Nonparticipation in the Maternal Follow-up Within the Danish National Birth Cohort
Bliddal, M., Liew, Z., Pottegård, A., Kirkegaard, H., Olsen, J., & Nohr, E. A. (2018) · American Journal of Epidemiology · doi:10.1093/aje/kwy002 · Cited by 37
Self-citationAndersen, L. B., Vestbo, J., Juel, K., Bjerg, A. M., Keiding, N., Jensen, G. B., Hein, H.-O., & Sørensen, T. I. A. (1998) · European Journal of Epidemiology · doi:10.1023/a:1007485116788 · Cited by 32
Magnus, M. C., DeRoo, L. A., Håberg, S. E., Magnus, P. M., Nafstad, P. H. J., Nystad, W., & London, S. J. (2014) · Alcoholism Clinical and Experimental Research · doi:10.1111/acer.12348 · Cited by 24
Cited by
Cross‐sectional studies – what are they good for?
Kesmodel, U. S. (2018) · Acta Obstetricia et Gynecologica Scandinavica · doi:10.1111/aogs.13331 · Cited by 523
Risk of Bias Evaluation of Cross‐Sectional Studies: Adaptation of the Newcastle‐Ottawa Scale
Carra, M. C., Romandini, P., & Romandini, M. (2026) · Journal of Periodontal Research · doi:10.1111/jre.13405 · Cited by 260
Enzenbach, C., Wicklein, B., Wirkner, K., & Loeffler, M. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-019-0779-8 · Cited by 186
Gerritsen, S. E., van Bodegom, L. S., Overbeek, M. M., Maras, A., Verhulst, F. C., Wolke, D., Rizopoulos, D., de Girolamo, G., Franić, T., Madan, J., et al. (2022) · The Lancet Psychiatry · doi:10.1016/s2215-0366(22)00310-8 · Cited by 36
Metadata
- Authors
- Nohr, E. A., & Liew, Z.
- Venue
- Acta Obstetricia et Gynecologica Scandinavica
- Publisher
- Wiley
- Published
- 2018-03-05
- Volume
- 97
- Issue
- 4
- Pages
- 407-416
- ISSN
- 0001-6349 (ISSN-L)
- 1600-0412
- OpenAlex
- W2793569843
- Cited by
- 363
- References
- 34
- FWCI
- 24.59
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.