Alternatives to randomisation in the evaluation of public-health interventions: statistical analysis and causal inference
Open accessThe DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Background: In non-randomised evaluations of public-health interventions, statistical methods to control confounding will usually be required. We review approaches to the control of confounding and discuss issues in drawing causal inference from these studies. Methods: Non-systematic review of literature and mathematical data-simulation. Results: Standard stratification and regression techniques will often be appropriate, but propensity scores may be useful where many confounders need to be controlled, and data are limited. All these techniques require that key putative confounders are measured accurately. Instrumental variables offer, in theory, a solution to the problem of unknown or unmeasured confounders, but identifying an instrument which meets the required conditions will often be challenging. Obtaining measurements of the outcome variable in both intervention and control groups before the intervention is introduced allows balance to be assessed, and these data may be used to help control confounding. However, imbalance in outcome measures at baseline poses challenges for the analysis and interpretation of the evaluation, highlighting the value of adopting a design strategy that maximises the likelihood of achieving balance. Finally, when it is not possible to have any concurrent control group, making multiple measures of outcome pre- and postintervention can enable the estimation of intervention effects with appropriate statistical models. Conclusion: For non-randomised designs, careful statistical analysis can help reduce bias by confounding in estimating intervention effects. However, investigators must report their methods thoroughly and be conscious and critical of the assumptions they must make whenever they adopt these designs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040296 · Cited by 23,020
A simulation study of the number of events per variable in logistic regression analysis
Peduzzi, P., Concato, J., Kemper, E., Holford, T. R., & Feinstein, A. R. (1996) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(96)00236-3 · Cited by 9,655 · cited 1×
“One advantage is that their use can reduce the number of parameters (ie, variables and categories within these) to be estimated in a regression model. When the number of parameters is large relative to the data available, estimates can become biased and CIs unreliable. In the current example, using propensity scores r…”
MethodCausal Diagrams for Epidemiologic Research
Greenland, S., Pearl, J., & Robins, J. M. (1999) · Epidemiology · doi:10.1097/00001648-199901000-00008 · Cited by 3,728
Des Jarlais, D. C., Lyles, C., Crepaz, N., & the TREND Group (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.361 · Cited by 2,817
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., & Vandenbroucke, J. P. (2007) · Preventive Medicine · doi:10.1016/j.ypmed.2007.08.012 · Cited by 2,698
Hernan, M. A. (2002) · American Journal of Epidemiology · doi:10.1093/aje/155.2.176 · Cited by 1,445
Evidence-Based Public Health: Moving Beyond Randomized Trials
Victora, C. G., Habicht, J.-P., & Bryce, J. (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.400 · Cited by 1,056 · cited 1×
“Low statistical power in such studies, including those where large numbers of individuals but only a small number of clusters are enrolled, is a major barrier to statistical inference. We do not seek to review this issue here other than to identify that allocation of a small number of units may also be a reason why im…”
BackgroundInstruments for Causal Inference: An Epidemiologist's Dream?
Hernán, M. A., & Robins, J. M. (2006) · Epidemiology · doi:10.1097/01.ede.0000222409.00878.37 · Cited by 961 · cited 1×
“Instrumental variables are also increasingly popular, purportedly removing the need to identify and measure all potential confounders.”
BackgroundCepeda, M. S. (2003) · American Journal of Epidemiology · doi:10.1093/aje/kwg115 · Cited by 859
The Impact of Residual and Unmeasured Confounding in Epidemiologic Studies: A Simulation Study
Fewell, Z., Davey Smith, G., & Sterne, J. A. C. (2007) · American Journal of Epidemiology · doi:10.1093/aje/kwm165 · Cited by 734
Cited by
The use of controls in interrupted time series studies of public health interventions
Lopez Bernal, J., Cummins, S., & Gasparrini, A. (2018) · International Journal of Epidemiology · doi:10.1093/ije/dyy135 · Cited by 559
Defeating AIDS—advancing global health
Piot, P., Abdool Karim, S. S., Hecht, R., Legido-Quigley, H., Buse, K., Stover, J., Resch, S., Ryckman, T., Møgedal, S., Dybul, M., et al. (2015) · The Lancet · doi:10.1016/s0140-6736(15)60658-4 · Cited by 293
Han, S., Olonisakin, T. F., Pribis, J. P., Zupetic, J., Yoon, J. H., Holleran, K. M., Jeong, K., Shaikh, N., Rubio, D. M., & Lee, J. S. (2017) · PLOS ONE · doi:10.1371/journal.pone.0183591 · Cited by 131
Richardson, M., & McEwan, K. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.01500 · Cited by 122
ElSherief, M., Saha, K., Gupta, P., Mishra, S., Seybolt, J., Xie, J., O’Toole, M., Burd-Sharps, S., & De Choudhury, M. (2021) · Humanities and Social Sciences Communications · doi:10.1057/s41599-021-00993-6 · Cited by 43
“Per the ITS framework, one way to infer causality is to estimate what the outcome variable could look like, if there were no intervention (Cousens et al., 2011); in our case, this would translate to inferring the future well-being outcomes based on the past outcomes, assuming that the drill (an intervention) has not o…”
BackgroundMethod
Metadata
- Authors
- Cousens, S., Hargreaves, J., Bonell, C., Armstrong, B., Thomas, J., Kirkwood, B. R., & Hayes, R.
- Venue
- Journal of Epidemiology and Community Health
- Publisher
- BMJ
- Published
- 2009-08-06
- Volume
- 65
- Issue
- 7
- Pages
- 576-581
- ISSN
- 0141-7681 (ISSN-L)
- 0143-005X
- 1470-2738
- OpenAlex
- W2102915777
- Cited by
- 86
- References
- 14
- FWCI
- 3.83
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Alternatives to randomisation in the evaluation of public-health interventions: statistical analysis and causal inference. https://app.cochat.ai/papers/10.1136/jech.2008.082610
- The paper
- Cousens, S., Hargreaves, J., Bonell, C., Armstrong, B., Thomas, J., Kirkwood, B. R., & Hayes, R. (2011). Alternatives to randomisation in the evaluation of public-health interventions: statistical analysis and causal inference. Journal of Epidemiology and Community Health. https://doi.org/10.1136/jech.2008.082610
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.