Cited by 135Statistical Methods in Clinical TrialsOptimal Experimental Design MethodsAdvanced Causal Inference Techniques

A roadmap to using randomization in clinical trials

Open access
Berger, Vance W., Bour, Louis Joseph, Carter, Kerstine, Chipman, Jonathan J., Everett, Colin C., Heussen, Nicole, Hewitt, Catherine, Hilgers, Ralf-Dieter +7 more·2021·BMC Medical Research Methodology

Published version of a preprint

Abstract

BACKGROUND: Randomization is the foundation of any clinical trial involving treatment comparison. It helps mitigate selection bias, promotes similarity of treatment groups with respect to important known and unknown confounders, and contributes to the validity of statistical tests. Various restricted randomization procedures with different probabilistic structures and different statistical properties are available. The goal of this paper is to present a systematic roadmap for the choice and application of a restricted randomization procedure in a clinical trial. METHODS: We survey available restricted randomization procedures for sequential allocation of subjects in a randomized, comparative, parallel group clinical trial with equal (1:1) allocation. We explore statistical properties of these procedures, including balance/randomness tradeoff, type I error rate and power. We perform head-to-head comparisons of different procedures through simulation under various experimental scenarios, including cases when common model assumptions are violated. We also provide some real-life clinical trial examples to illustrate the thinking process for selecting a randomization procedure for implementation in practice. RESULTS: Restricted randomization procedures targeting 1:1 allocation vary in the degree of balance/randomness they induce, and more importantly, they vary in terms of validity and efficiency of statistical inference when common model assumptions are violated (e.g. when outcomes are affected by a linear time trend; measurement error distribution is misspecified; or selection bias is introduced in the experiment). Some procedures are more robust than others. Covariate-adjusted analysis may be essential to ensure validity of the results. Special considerations are required when selecting a randomization procedure for a clinical trial with very small sample size. CONCLUSIONS: The choice of randomization design, data analytic technique (parametric or nonparametric), and analysis strategy (randomization-based or population model-based) are all very important considerations. Randomization-based tests are robust and valid alternatives to likelihood-based tests and should be considered more frequently by clinical investigators.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/s12874-021-01303-z

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Simple randomization does not guarantee the control of important variables to be considered for both treatment groups, as occurs in stratified randomization.

    “In addition, simple randomization does not guarantee the control of important variables to be considered for both treatment groups, as occurs in stratified randomization 3 , 35 .”

    From Global mapping of randomized controlled trials in dentistry (2024) · cites this paper as [35]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

The citation lists haven’t been fetched yet

References 121 · Cited by 135

Research works printed but not linked: 2

  1. [31]ICH Harmonised Tripartite Guideline. Statistical principles for clinical trials E9. 1998. 10532877
  2. [83]Chow SC, Shao J, Wang H, Lokhnygina. Sample size calculations in clinical research. 3rd ed. Boca Raton: CRC Press; 2018.

Authors
Berger, V. W., Bour, L. J., Carter, K., Chipman, J. J., Everett, C. C., Heussen, N., Hewitt, C., Hilgers, R.-D., Luo, Y. A., Renteria, J., Ryeznik, Y., Sverdlov, O., Uschner, D., for the Randomization Innovative Design Scientific Working Group, & Beckman, R. A.
Affiliations
  • National Institutes of Health (US)
  • Boehringer Ingelheim (Germany) (DE)
  • Boehringer Ingelheim (United States) (US)
  • University of Utah (US)
  • University of Leeds (GB)
  • Sigmund Freud Privatuniversität Wien (AT)
  • University of York (GB)
  • RWTH Aachen University (DE)
  • United States Food and Drug Administration (US)
  • Universitat Oberta de Catalunya (ES)
  • AstraZeneca (Sweden) (SE)
  • Novartis (United States) (US)
  • George Washington University (US)
Corresponding author
Sverdlov, Oleksandr
Venue
BMC Medical Research Methodology
Published
2021-08-16
Volume
21
Issue
1
Pages
168-168
ISSN
1471-2288 (ISSN-L)
OpenAlex
W3118645466
Cited by
135
References
121
Citations by year
2026: 34 · 2025: 32 · 2024: 37 · 2023: 21 · 2022: 9 · 2021: 2
FWCI
12.86
Type
journal article
Language
en
Open access
Locations
  • BMC Medical Research Methodology (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • The Oberta in Open Access (Universitat Oberta de Catalunya) (submittedVersion, cc-by)
  • Research Explorer (The University of Manchester) (submittedVersion, cc-by)
Topics
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
  • Social Sciences › Decision Sciences › Management Science and Operations Research › Optimal Experimental Design Methods
  • Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
Keywords
restricted randomization, randomization procedures, type I error rate, statistical power, model misspecification robustness, covariate adjustment, small sample size, selection bias, sequential allocation
MeSH terms
Computer Simulation, Humans, Random Allocation, Selection Bias, Likelihood Functions, Sample Size

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review