CoChat
Sign Up
Cited by 439Meta-analysis and systematic reviewsStatistical Methods in Clinical TrialsAdvanced Causal Inference Techniques

The DOI matches its Crossref record; 166 of the 171 references it cites were found in a registry or an index.

Randomisation to protect against selection bias in healthcare trials

Open access
Odgaard-Jensen, Jan, Vist, Gunn E, Timmer, Antje, Kunz, Regina, Akl, Elie A, Schünemann, Holger, Briel, Matthias, Nordmann, Alain J, Pregno, Silvia, Oxman, Andrew D·2011·Cochrane Database of Systematic Reviews
DOI 10.1002/14651858.mr000012.pub3PMC PMC7150228
Open this paper in CoChat — free accountOpen PDF

Abstract

BACKGROUND: Randomised trials use the play of chance to assign participants to comparison groups. The unpredictability of the process, if not subverted, should prevent systematic differences between comparison groups (selection bias). Differences due to chance will still occur and these are minimised by randomising a sufficiently large number of people. OBJECTIVES: To assess the effects of randomisation and concealment of allocation on the results of healthcare studies. SEARCH STRATEGY: We searched the Cochrane Methodology Register, MEDLINE, SciSearch and reference lists up to September 2009. In addition, we screened articles citing included studies (ISI Science Citation Index) and papers related to included studies (PubMed). SELECTION CRITERIA: Eligible study designs were cohorts of studies, systematic reviews or meta-analyses of healthcare interventions that compared random allocation versus non-random allocation or adequate versus inadequate/unclear concealment of allocation in randomised trials. Outcomes of interest were the magnitude and direction of estimates of effect and imbalances in prognostic factors. DATA COLLECTION AND ANALYSIS: We retrieved and assessed studies that appeared to meet the inclusion criteria independently. At least two review authors independently appraised methodological quality and extracted information. We prepared tabular summaries of the results for each comparison and assessed the results across studies qualitatively to identify common trends or discrepancies. MAIN RESULTS: A total of 18 studies (systematic reviews or meta-analyses) met our inclusion criteria. Ten compared random allocation versus non-random allocation and nine compared adequate versus inadequate or unclear concealment of allocation within controlled trials. All studies were at high risk of bias.For the comparison of randomised versus non-randomised studies, four comparisons yielded inconclusive results (differed between outcomes or different modes of analysis); three comparisons showed similar results for random and non-random allocation; two comparisons had larger estimates of effect in non-randomised studies than in randomised trials; and two comparisons had larger estimates of effect in randomised than in non-randomised studies.Five studies found larger estimates of effect in trials with inadequate concealment of allocation than in trials with adequate concealment. The four other studies did not find statistically significant differences. AUTHORS' CONCLUSIONS: The results of randomised and non-randomised studies sometimes differed. In some instances non-randomised studies yielded larger estimates of effect and in other instances randomised trials yielded larger estimates of effect. The results of controlled trials with adequate and inadequate/unclear concealment of allocation sometimes differed. When differences occurred, most often trials with inadequate or unclear allocation concealment yielded larger estimates of effects relative to controlled trials with adequate allocation concealment. However, it is not generally possible to predict the magnitude, or even the direction, of possible selection biases and consequent distortions of treatment effects from studies with non-random allocation or controlled trials with inadequate or unclear allocation concealment.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1002/14651858.mr000012.pub3

Cites

166 of 166 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 171 references

Research works printed but not linked: 14

  1. Morrison, 2000, Methodological rigor and results of clinical trials of homeopathic remedies, Perfusion, 13, 132
  2. Wortman, 1983, Synthesis of results in trials of coronary artery bypass graft surgery, 8, 536
  3. Kjaergard, 2008, Reported methodologic quality and discrepancies between large and small randomized trials in meta-analyses (vol 135, pg982, 2001), Annals of Internal Medicine, 149, 219, 10.7326/0003-4819-149-3-200808050-00023 · DOI
  4. Savovic, 2008, The association of three bias domains with the treatment effect estimates in randomised control trials: combined analysis of meta-epidemiological studies. Oral presentation at the 16th Cochrane Colloquium: Evidence in the era of globalisation; 2008 Oct 3-7; Freiburg, Germany [abstract], Zeitschrift fur Evidenz, Fortbildung und Qualitat im Gesundheitswesen, 102, 29
  5. Britton A McKee M Black N McPherson K Sanderson C Bain C Three systematic reviews - not so different answers BMJ Electronic letters
  6. The Editorial Team Cochrane Methodology Review Group About The Cochrane Collaboration (Cochrane Review Groups (CRGs)) Art. No.: METHOD
  7. Dans, 2002, Applying the results to individual patients, 369
  8. Gubler, 1971, Alternating hemiplegia, a sign of pontine lesion, and documentation of the proof of the facial decussation, 9
  9. Guyatt, 2002, Therapy, 55
  10. Kleijnen, 1997, So what's so special about randomisation?, 93
  11. Kunz R Oxman AD Two systematic reviews - two different answers? BMJ Electronic Letters
  12. Moore, 1995, Deadly Medicine
  13. Reeves, 1998, Comparison of effect size estimates derived from randomised and non-randomised studies, 73
  14. US Congress, 1994, Identifying Health Technologies that Work: Searching for Evidence, 41

Cited by

Sorted by citations

Related

See all

Metadata

Authors
Odgaard-Jensen, J., Vist, G. E., Timmer, A., Kunz, R., Akl, E. A., Schünemann, H., Briel, M., Nordmann, A. J., Pregno, S., & Oxman, A. D.
Affiliations
  • Norwegian Knowledge Centre for the Health Services; Global Health Unit; PO Box 7004, St. Olavs Plass Oslo Norway N-0130
  • Nasjonalt Kunnskapssenter for Helsetjenesten (NO)
  • Carl von Ossietzky Universität Oldenburg (DE)
  • University of Basel (CH)
  • American University of Beirut (LB)
  • McMaster University (CA)
  • University Hospital of Basel (CH)
  • University of Modena and Reggio Emilia (IT)
ORCID
Venue
Cochrane Database of Systematic Reviews
Publisher
Wiley
Published
2011-04-13
Volume
2015
Issue
4
Pages
MR000012-MR000012
ISSN
  • 1361-6137 (ISSN-L)
  • 1465-1858
DOI
10.1002/14651858.mr000012.pub3
PMC
PMC7150228
OpenAlex
W1919332000
Cited by
439
References
171
Citations by year
2026: 4 · 2025: 8 · 2024: 20 · 2023: 18 · 2022: 18 · 2021: 32 · 2020: 23 · 2019: 22 · 2018: 22 · 2017: 19 · 2016: 23 · 2015: 28 · 2014: 30 · 2013: 38 · 2012: 45
FWCI
10.15
Type
journal article
Language
en
Open access
Locations
  • Cochrane Database of Systematic Reviews (publishedVersion)
  • PubMed Central (publishedVersion)
  • PubMed (publishedVersion)
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
  • Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
Keywords
randomization, allocation concealment, selection bias, randomised trials, non-randomized studies, health interventions, methodological quality of trials
MeSH terms
Clinical Trials as Topic, Random Allocation, Selection Bias, Randomized Controlled Trials as Topic, Treatment Outcome, Controlled Clinical Trials as Topic

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review