Issues in Outcomes Research: An Overview of Randomization Techniques for Clinical Trials
Open accessAbstract
Objective: To review and describe randomization techniques used in clinical trials, including simple, block, stratified, and covariate adaptive techniques. Background: Clinical trials are required to establish treatment efficacy of many athletic training procedures. In the past, we have relied on evidence of questionable scientific merit to aid the determination of treatment choices. Interest in evidence-based practice is growing rapidly within the athletic training profession, placing greater emphasis on the importance of well-conducted clinical trials. One critical component of clinical trials that strengthens results is random assignment of participants to control and treatment groups. Although randomization appears to be a simple concept, issues of balancing sample sizes and controlling the influence of covariates a priori are important. Various techniques have been developed to account for these issues, including block, stratified randomization, and covariate adaptive techniques. Advantages: Athletic training researchers and scholarly clinicians can use the information presented in this article to better conduct and interpret the results of clinical trials. Implementing these techniques will increase the power and validity of findings of athletic medicine clinical trials, which will ultimately improve the quality of care provided.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The selected 6-block randomization method may not be optimal for randomization, and the 4-block randomization method could have been a more optimal technique for this study.
“First of all, one of the limitations may be the selected randomization method which was chosen to simply control balance across groups over time for a sample size of 60 participants. As published data suggest, the 6-block randomization method may not be optimal for randomization, as blocks are best used in smaller increments due to easier balance control. Therefore, the 4-block randomization”
From Early Occupational Therapy Intervention post-stroke (EOTIPS): A randomized controlled trial (2024) · cites this paper as [69]
The Block Randomization section says blocks are best used in smaller increments because balance is easier to control, and lists both 4 and 6 as possible block sizes for two groups. It does not evaluate the citing study’s 60 participants or conclude that a block size of 6 was suboptimal and 4 would have been optimal for that study. Page numbers were not provided in our copy. (LLM, conf=0.85)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Statistical Methods for Rates and Proportions
Fleiss, J. L., Levin, B., & Paik, M. C. (2003) · Wiley Series in Probability and Statistics · doi:10.1002/0471445428 · Cited by 18,646 · see citing works
Applied Longitudinal Data Analysis: Modeling Change and Event Occurrence
Singer, J. D., & Willett, J. B. (2003) · doi:10.1093/acprof:oso/9780195152968.001.0001 · Cited by 10,647 · see citing works
Pocock, S. J., & Simon, R. (1975) · Biometrics · doi:10.2307/2529712 · Cited by 2,350 · see citing works
The Arrangement of Field Experiments
Fisher, R. A. (1992) · Springer series in statistics · doi:10.1007/978-1-4612-4380-9_8 · Cited by 979 · see citing works
Allocation concealment in randomised trials: defending against deciphering
Schulz, K. F., & Grimes, D. A. (2002) · The Lancet · doi:10.1016/s0140-6736(02)07750-4 · Cited by 923 · see citing works
Minimization: A new method of assigning patients to treatment and control groups
Taves, D. R. (1974) · Clinical Pharmacology & Therapeutics · doi:10.1002/cpt1974155443 · Cited by 891 · see citing works
Forcing a sequential experiment to be balanced
EFRON, B. (1971) · Biometrika · doi:10.1093/biomet/58.3.403 · Cited by 873 · see citing works
Generation of allocation sequences in randomised trials: chance, not choice
Schulz, K. F., & Grimes, D. A. (2002) · The Lancet · doi:10.1016/s0140-6736(02)07683-3 · Cited by 774 · see citing works
The method of minimization for allocation to clinical trials
Scott, N. W., McPherson, G. C., Ramsay, C. R., & Campbell, M. K. (2002) · Controlled Clinical Trials · doi:10.1016/s0197-2456(02)00242-8 · Cited by 651 · see citing works
Statistics notes: How to randomise
Altman, D. G., & Bland, J. M. (1999) · BMJ · doi:10.1136/bmj.319.7211.703 · Cited by 506 · see citing works
Applied longitudinal data analysis modeling change and event occurrence
Singer, J. D. 1., & Willett, J. B. 1. (2003) · Cited by 405 · see citing works
Statistics notes. Treatment allocation in controlled trials: why randomise?
Altman, D. G., & Bland, J. M. (1999) · BMJ · doi:10.1136/bmj.318.7192.1209 · Cited by 362 · see citing works
Minimisation: the platinum standard for trials?
Treasure, T., & MacRae, K. D. (1998) · BMJ · doi:10.1136/bmj.317.7155.362 · Cited by 346 · see citing works
Randomization in clinical trials: Conclusions and recommendations
Lachin, J. M., Matts, J. P., & Wei, L. J. (1988) · Controlled Clinical Trials · doi:10.1016/0197-2456(88)90049-9 · Cited by 272 · see citing works
A Treatment Allocation Procedure for Sequential Clinical Trials
Begg, C. B., & Iglewicz, B. (1980) · Biometrics · doi:10.2307/2530497 · Cited by 220 · see citing works
Statistical concepts: a second course for education and the behavioral sciences
(1998) · Choice Reviews Online · doi:10.5860/choice.35-6282 · Cited by 158 · see citing works
Treatment allocation methods in clinical trials: A review
Kalish, L. A., & Begg, C. B. (1985) · Statistics in Medicine · doi:10.1002/sim.4780040204 · Cited by 148 · see citing works
The Pursuit of Balance Using Stratified and Dynamic Randomization Techniques: An Overview
McEntegart, D. J. (2003) · Drug Information Journal · doi:10.1177/009286150303700305 · Cited by 145 · see citing works
How many stratification factors are “too many” to use in a randomization plan?
Therneau, T. M. (1993) · Controlled Clinical Trials · doi:10.1016/0197-2456(93)90013-4 · Cited by 136 · see citing works
A Method of Biased Coin Randomization, Its Implementation, and Its Validation
Frane, J. W. (1998) · Drug Information Journal · doi:10.1177/009286159803200213 · Cited by 121 · see citing works
Weir, C. J., & Lees, K. R. (2003) · Statistics in Medicine · doi:10.1002/sim.1366 · Cited by 102 · see citing works
A Clinical Trial of Sanocrysin in Pulmonary Tuberculosis1
Amberson, J. B., McMahon, B. T., & Pinner, M. (2019) · American Review of Tuberculosis · Cited by 91 · see citing works
The choice of a balanced allocation method for a clinical trial in otitis media with effusion
Zielhuis, G. A., Straatman, H., Hof‐Grootenboer, A. E. V., van Lier, H. J. J., Rach, G. H., & van den Broek, P. (1990) · Statistics in Medicine · doi:10.1002/sim.4780090306 · Cited by 70 · see citing works
Is the Randomized Clinical Trial the Gold Standard of Research?
Simon, S. D. (2001) · Journal of Andrology · doi:10.1002/j.1939-4640.2001.tb03433.x · Cited by 68 · see citing works
Blair, E. M. (2004) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.06.003 · Cited by 67 · see citing works
A Framework for Investigating Change over Time
Singer, J. D., & Willett, J. B. (2003) · doi:10.1093/acprof:oso/9780195152968.003.0001 · Cited by 59 · see citing works
Randomization in substance abuse clinical trials
Hedden, S. L., Woolson, R. F., & Malcolm, R. J. (2006) · Substance Abuse Treatment Prevention and Policy · doi:10.1186/1747-597x-1-6 · Cited by 42 · see citing works
Ingersoll, C. D. (2006) · Europe PMC (PubMed Central) · Cited by 6 · see citing works
Fleiss, J. L., Levin, B. L., & Paik, M. C. (2003) · Wiley series in probability and statistics · doi:10.1002/0471445428.ch5 · Cited by 6 · see citing works
Flagged first, then by citations
2 of the 31 references couldn’t be matched to a known paper.
Research works printed but not linked: 2
- Altman, D. G. and J. M.Bland. How to randomise.BMJ1999. 319 (7211):703–704.
- Blair, E. Gold is not always good enough: the shortcomings of randomization when evaluating interventions in small heterogeneous samples. J Clin Epidemiol 2004. 57 (12):1219–1222.
Cited by
Sorted by citations
Reporting animal research: Explanation and elaboration for the ARRIVE guidelines 2.0
Percie du Sert, N., Ahluwalia, A., Alam, S., Avey, M. T., Baker, M., Browne, W. J., Clark, A., Cuthill, I. C., Dirnagl, U., Emerson, M., et al. (2020) · PLOS Biology · doi:10.1371/journal.pbio.3000411 · Cited by 2,677 · see citing works
“This splits up the experiment into smaller subexperiments (blocks), and treatments are randomised to experimental units within each block [17,66,73].”
Reporting animal research: Explanation and Elaboration for the ARRIVE guidelines 2019Preprint
du Sert, N. P., Ahluwalia, A., Alam, S., Avey, M. T., Baker, M., Browne, W. J., Clark, A., Cuthill, I. C., Dirnagl, U., Emerson, M., et al. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/703355 · Cited by 557 · see citing works
“This splits up the experiment into smaller sub-experiments (blocks), and treatments are randomised to experimental units within each block [24, 68, 69].”
MethodBonrath, E. M., Dedy, N. J., Gordon, L. E., & Grantcharov, T. P. (2015) · Annals of Surgery · doi:10.1097/sla.0000000000001214 · Cited by 260 · see citing works
Curtis, P. J., van der Velpen, V., Berends, L. M., Jennings, A., Feelisch, M., Umpleby, A. M., Evans, M. L., Fernandez, B. O., Meiss, M. S., Minnion, M., et al. (2018) · American Journal of Clinical Nutrition · doi:10.1093/ajcn/nqy380 · Cited by 262 · see citing works
“AR2007 adaptive random-sequence allocation software (22) was utilized, which incorporated 4 balancing strata that were considered likely a priori to affect insulin resistance and vascular function: sex, number of MetS criteria, age, and statin/blood pressure (BP) medication use.”
MethodHickey, G. L., Dunning, J., Seifert, B., Sodeck, G. H., Carr, M., Burger, H. U., & Beyersdorf, F. (2015) · European Journal of Cardio-Thoracic Surgery · doi:10.1093/ejcts/ezv168 · Cited by 221 · see citing works
Merchant, R. K., Inamdar, R., & Quade, R. (2016) · The Journal of Allergy and Clinical Immunology In Practice · doi:10.1016/j.jaip.2015.11.022 · Cited by 221 · see citing works
Naftali, T., Mechulam, R., Marii, A., Gabay, G., Stein, A., Bronshtain, M., Laish, I., Benjaminov, F., & Konikoff, F. M. (2017) · Digestive Diseases and Sciences · doi:10.1007/s10620-017-4540-z · Cited by 216 · see citing works
“The bottles were numbered using the block method [26] in a 1:1 ratio in the laboratory where cannabidiol was produced, and none of the clinical investigators had any approach to the code; patients were randomly assigned to receive either cannabidiol or placebo in the form of oil.”
MethodOwoeye, O. B. A., Akinbo, S. R., Tella, B. A., & Olawale, O. A. (2014) · Europe PMC (PubMed Central) · Cited by 200 · see citing works
Childs, C. E., Röytiö, H., Alhoniemi, E. J., Fekete, A. A., Forssten, S. D., Hudjec, N., Lim, Y. N., Steger, C. J., Yaqoob, P., Tuohy, K. M., et al. (2014) · British Journal Of Nutrition · doi:10.1017/s0007114513004261 · Cited by 169 · see citing works
“The volunteers were randomised by sex, age and BMI to their starting point in the supplement sequence (MDX þ MDX, XOS þ MDX, Bi-07 þ MDX and XOS þ Bi-07) by covariate adaptive randomisation((35)).”
MethodEsteves, S. C., Roque, M., Bedoschi, G., Conforti, A., Humaidan, P., & Alviggi, C. (2018) · Frontiers in Endocrinology · doi:10.3389/fendo.2018.00461 · Cited by 153 · see citing works
“Researchers have rightfully argued that critical methodological issues like the one discussed above should be taken into account when designing studies on poor responders (64, 76, 77).”
BackgroundOrtblad, K. F., Musoke, D. K., Ngabirano, T., Nakitende, A., Magoola, J., Kayiira, P., Taasi, G., Barresi, L. G., Haberer, J. E., McConnell, M. A., et al. (2017) · PLoS Medicine · doi:10.1371/journal.pmed.1002458 · Cited by 138 · see citing works
“1, The R Foundation for Statistical Computing, Vienna, Austria) [61].”
BackgroundInfluentialManchikanti, L., Hirsch, J. A., & Smith, H. S. (2008) · PubMed · Cited by 132 · see citing works
Dong, H., Rowland, I., Thomas, L. V., & Yaqoob, P. (2013) · European Journal of Nutrition · doi:10.1007/s00394-012-0487-1 · Cited by 127 · see citing works
“The volunteers were randomized by an Excel-based covariate adaptive randomization programme [15] to enter two intervention arms: probiotic (10 females, 6 males) or placebo (8 females, 6 males) stratified by age, gender and BMI.”
Methodde Souza, H. C. D., Rocha, T. D. D. S., Pessoa, M. F., Rattes, C., Brandão, D. C., Fregonezi, G., Campos, S. L., Aliverti, A., & Dornelas, A. (2014) · The Journals of Gerontology Series A · doi:10.1093/gerona/glu182 · Cited by 127 · see citing works
“After the initial evaluation, the participants were randomly distributed into blocks of four individuals (18) using a table of random numbers by a third person who did not directly participate in the research, thus ensuring the allocation concealment.”
MethodFekete, Á. A., Giromini, C., Chatzidiakou, Y., Givens, D. I., & Lovegrove, J. A. (2016) · American Journal of Clinical Nutrition · doi:10.3945/ajcn.116.137919 · Cited by 123 · see citing works
“5) (15) who was also responsible for the treatment allocation.”
Manchikanti, L. (2008) · Pain Physician · doi:10.36076/ppj.2008/11/717 · Cited by 156 · see citing works
Thyrian, J. R., Fiß, T., Dreier, A., Böwing, G., Angelow, A., Lueke, S., Teipel, S. J., Fleßa, S., Grabe, H. J., Freyberger, H. J., et al. (2012) · Trials · doi:10.1186/1745-6215-13-56 · Cited by 119 · see citing works
“There is evidence that simple coin-tossing will lead to problematic sample sizes in small clinical trials (N< 100) but that it can be trusted to generate equal numbers in large trials (N = >200) [34].”
BackgroundGeneralized method for adaptive randomization in clinical trials
Russell, D., Hoare, Z., Whitaker, R., Whitaker, C. J., & Russell, I. T. (2011) · Statistics in Medicine · doi:10.1002/sim.4175 · Cited by 119 · see citing works
Phase 1/2a clinical trial in ALS with ropinirole, a drug candidate identified by iPSC drug discovery
Morimoto, S., Takahashi, S., Ito, D., Daté, Y., Okada, K., Kato, C., Nakamura, S., Ozawa, F., Chai, M., Nishiyama, A., et al. (2023) · Cell stem cell · doi:10.1016/j.stem.2023.04.017 · Cited by 111 · see citing works
Abellaneda‐Pérez, K., Vaqué‐Alcázar, L., Perellón‐Alfonso, R., Bargalló, N., Kuo, M., Pascual‐Leone, Á., Nitsche, M. A., & David Bartrés-faz, A. (2020) · Frontiers in Neuroscience · doi:10.3389/fnins.2019.01440 · Cited by 107 · see citing works
Mayhew, P. D., & Brown, D. C. (2009) · Veterinary Surgery · doi:10.1111/j.1532-950x.2009.00554.x · Cited by 105 · see citing works
Malfliet, A., Kregel, J., Meeus, M., Roussel, N., Danneels, L., Cagnie, B., Dolphens, M., & Nijs, J. (2018) · Physical Therapy · doi:10.1093/ptj/pzx092 · Cited by 100 · see citing works
Springer, S. A., Paola, A. D., Azar, M. M., Barbour, R. C., Biondi, B. E., Desabrais, M., Lincoln, T., Skiest, D. J., & Altice, F. L. (2018) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/qai.0000000000001634 · Cited by 96 · see citing works
Costabile, A., Bergillos-Meca, T., Rasinkangas, P., Korpela, K., de Vos, W. M., & Gibson, G. R. (2017) · Frontiers in Immunology · doi:10.3389/fimmu.2017.01443 · Cited by 94 · see citing works
“An Excel-based covariate adaptive randomization program (16) to enter four intervention arms randomized the volunteers: L.”
MethodSilva, F. B. D. A. E., Kojima, K. E., Joeris, A., et al. (2015) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.n.00497 · Cited by 90 · see citing works
Cottrell, M. A., O’Leary, S. P., Kelly, P. S., Elwell, B., Hess, S. A., Litchfield, M.-A., McLoughlin, I. V., Tweedy, R., Raymer, M. E., Hill, A. J., et al. (2018) · Musculoskeletal Science and Practice · doi:10.1016/j.msksp.2018.09.014 · Cited by 89 · see citing works
Implementing the ESHRE 'poor responder' criteria in research studies: methodological implications
Papathanasiou, A. (2014) · Human Reproduction · doi:10.1093/humrep/deu135 · Cited by 85 · see citing works
“Although this bias can be further explored by use of post hoc statistical analysis, it is still preferable that researchers make every effort to a priori address the issue of patient allocation (Kang et al., 2008).”
BackgroundCurtis, P. J., Berends, L. M., van der Velpen, V., Jennings, A., Haag, L., Chandra, P., Kay, C. D., Rimm, E. B., & Cassidy, A. (2021) · Clinical Nutrition · doi:10.1016/j.clnu.2021.11.030 · Cited by 90 · see citing works
Kurt, E. E., Büyükturan, B., Büyükturan, Ö., Erdem, H. R., & Tuncay, F. (2017) · Disability and Rehabilitation · doi:10.1080/09638288.2016.1276972 · Cited by 83 · see citing works
“Covariate adaptive randomization [16] was performed using a computer program for optimal allocation of patients to Ai Chi and land-based exercise groups [covariates: age, gender, and Parkinson’s disease stages (according the Hoehn and Yahr scale)].”
MethodHawkins, J., Hires, C., Keenan, L., & Dunne, E. (2022) · Complementary Therapies in Medicine · doi:10.1016/j.ctim.2022.102823 · Cited by 83 · see citing works
Jensen, R. K., Leboeuf‐Yde, C., Wedderkopp, N., Sørensen, J. S., & Manniche, C. (2012) · BMC Medicine · doi:10.1186/1741-7015-10-22 · Cited by 79 · see citing works
“Minimization [35] is a covariate adaptive randomization method [36] which aims to ensure that treatment arms are balanced with respect to certain predefined factors as well as for the number of patients in each group [37].”
MethodYap, P., Du, Z.-W., Wu, F., Jiang, J., Chen, R., Zhou, X., Hattendorf, J., Utzinger, J., & Steinmann, P. (2013) · American Journal of Tropical Medicine and Hygiene · doi:10.4269/ajtmh.13-0009 · Cited by 78 · see citing works
“Treatment allocation was determined by a statistician using block randomization with randomly varying block sizes of 2, 4, and 6 to ensure that both treatment arms had similar sample sizes.(24) Triple-dose nonflavored albendazole (400 mg) and placebo treatments (tablets matched in color, size, taste, and shape) were p…”
MethodSpoorenberg, S. L. W., Wynia, K., Uittenbroek, R. J., Kremer, H. P. H., & Reijneveld, S. A. (2018) · PLoS ONE · doi:10.1371/journal.pone.0190751 · Cited by 76 · see citing works
“Therefore, participants were equally distributed within each GP practice to Embrace and CAU, taking into account predetermined patient characteristics deemed capable of affecting intervention outcomes, for example age, gender, number of chronic conditions and living situation [23].”
Auricular Vagus Neuromodulation—A Systematic Review on Quality of Evidence and Clinical Effects
Verma, N., Mudge, J., Kasole, M., Chen, R. C., Blanz, S. L., Trevathan, J. K., Lovett, E. G., Williams, J. C., & Ludwig, K. A. (2021) · Frontiers in Neuroscience · doi:10.3389/fnins.2021.664740 · Cited by 69 · see citing works
“This is more likely to occur in studies with a smaller number of participants (Kang et al., 2008), which is the sample size found inmany aVNS studies.”
BackgroundChen, S.-Y., Chen, K.-L., Ding, L.-Y., et al. (2022) · Oncogene · doi:10.1038/s41388-022-02325-7 · Cited by 70 · see citing works
“Block randomization [42] was applied unless specified in the experiment.”
MethodZeng, X., Chen, Y., Sehrawat, A., Lee, J., Lafferty, T. K., Kofler, J., Berman, S. B., Sweet, R. A., Tudorascu, D., Klunk, W. E., et al. (2024) · Molecular Neurodegeneration · doi:10.1186/s13024-024-00711-1 · Cited by 73 · see citing works
“There are various methods of randomization, including simple randomization, block randomization, stratified randomization, and covariate adaptive randomization [146].”
MethodHigh-Definition and Non-invasive Brain Modulation of Pain and Motor Dysfunction in Chronic TMD
Donnell, A., Nascimento, T. D., Lawrence, M., Gupta, V., Zieba, T., Truong, D. Q., Bikson, M., Datta, A., Bellile, E. L., & DaSilva, A. F. M. (2015) · Brain stimulation · doi:10.1016/j.brs.2015.06.008 · Cited by 68 · see citing works
“Using this method, a new participant was sequentially assigned to a group based upon the previous assignments of other participants and certain covariates [20].”
MethodHammami, M., Gaamouri, N., Aloui, G., Shephard, R. J., & Chelly, M. S. (2018) · The Journal of Strength and Conditioning Research · doi:10.1519/jsc.0000000000002870 · Cited by 67 · see citing works
“The null hypothesis (28) was H0: m1 = m2 and the alternative hypothesis was Ha: m1 = m2 + d, where d is the difference between 2 mean values and n1 and n2 are the sample sizes for the E and C, respectively, such that N = n1 + n2.”
BackgroundMethodAbellaneda‐Pérez, K., Vaqué‐Alcázar, L., Dídac Vidal-piñeiro, A., Jannati, A., Solana, E., Bargalló, N., Santarnecchi, E., Pascual‐Leone, Á., & David Bartrés-faz, A. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.11.036 · Cited by 55 · see citing works
“A simple randomization procedure was used M AN US CR IP T AC CE PT ED 8 (Altman & Bland, 1999; Kang et al., 2008).”
Teaching of evidence-based medicine to medical students in Mexico: a randomized controlled trial
Mendiola, M. S., Kieffer-Escobar, L. F., Marín-Beltrán, S., Downing, S. M., & Schwartz, A. (2012) · BMC Medical Education · doi:10.1186/1472-6920-12-107 · Cited by 59 · see citing works
“The randomization was done by the medical school with a computer generated list, using the block randomization method with blocks of two to ensure equal sample sizes [24].”
MethodConsolidated guidance for behavioral intervention pilot and feasibility studies
Pfledderer, C. D., von Klinggraeff, L., Burkart, S. A., Bandeira, A. D. S., Lubans, D. R., Jago, R., Okely, A. D., van Sluijs, E. M. F., Ioannidis, J. P. A., Thrasher, J. F., et al. (2024) · Pilot and Feasibility Studies · doi:10.1186/s40814-024-01485-5 · Cited by 65 · see citing works
Theurich, S., Fischmann, H., Shimabukuro‐Vornhagen, A., Chemnitz, J. M., Holtick, U., Scheid, C., Skoetz, N., & von Bergwelt‐Baildon, M. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009159.pub2 · Cited by 56 · see citing works
Leerssen, J., Lakbila-Kamal, O., Dekkers, L. M. S., Ikelaar, S. L. C., Albers, A. C. W., Blanken, T. F., Lancee, J., van der Lande, G. J. M., Maksimovic, T., Mastenbroek, S. E., et al. (2022) · Psychotherapy and Psychosomatics · doi:10.1159/000520282 · Cited by 54 · see citing works
High-Rosmarinic Acid Spearmint Tea in the Management of Knee Osteoarthritis Symptoms
Connelly, A. E., Tucker, A. J., Tulk, H. M. F., Catapang, M., Chapman, L., Sheikh, N., Yurchenko, S., Fletcher, R., Kott, L. S., Duncan, A. M., et al. (2014) · Journal of Medicinal Food · doi:10.1089/jmf.2013.0189 · Cited by 54 · see citing works
Dankel, S. J., Bell, Z. W., Spitz, R. W., Wong, V. H. Y., Viana, R. B., Chatakondi, R. N., Buckner, S. L., Jessee, M. B., Mattocks, K. T., Mouser, J. G., et al. (2019) · Applied Physiology, Nutrition, and Metabolism · doi:10.1139/apnm-2019-0470 · Cited by 52 · see citing works
“…would not be able to predict the group assignment for all subsequent individuals who were randomly assigned to a group based on quartiles of dominant arm 1RM strength using a covariate adaptive randomization program that was supplied by the authors of a previous paper (Kang et al. 2008).”
MethodOrange, S. T., Hritz, A., Pearson, L. T., Jeffries, O., Jones, T. W. A., & Steele, J. (2022) · Journal of Sports Sciences · doi:10.1080/02640414.2022.2059320 · Cited by 49 · see citing works
“Future studies should follow best practice guidelines for trial randomisation procedures (Kang et al., 2008).”
BackgroundMalfliet, A., Kregel, J., Meeus, M., Danneels, L. A., Cagnie, B. J., Roussel, N. A., & Nijs, J. (2018) · PM&R · doi:10.1016/j.pmrj.2018.04.010 · Cited by 45 · see citing works
“Participants were randomly assigned into an educational group, using a stratified permuted block allocation (block size of 4), with stratification factors being treatment center (Ghent or Brussels), dominant pain location (low back or neck), and gender (male or female) [45,46].”
MethodRandomization: beyond tossing a coin
Ferreira, J. C., & Patino, C. M. (2016) · Jornal Brasileiro de Pneumologia · doi:10.1590/s1806-37562016000000296 · Cited by 44 · see citing works
Dolphens, M., Nijs, J., Cagnie, B. J., Meeus, M., Roussel, N. A., Kregel, J., Malfliet, A., Vanderstraeten, G., & Danneels, L. A. (2014) · BMC Musculoskeletal Disorders · doi:10.1186/1471-2474-15-149 · Cited by 44 · see citing works
“Participants will then be randomized to either control or experimental group (1:1 ratio) using a stratified permuted block allocation with stratification factors being treatment center (Ghent or Brussels), dominant pain location (low back or neck) and gender (male or female) and with a block size of four [34,35].”
MethodAditya, P. V. A., Prasad, M. G., Nagaradhakrishna, A., Raju, N. S., & Babu, D. N. (2021) · Heliyon · doi:10.1016/j.heliyon.2021.e08092 · Cited by 44 · see citing works
Harvey, M.-P., Lorrain, D., Martel, M., Bergeron-Vézina, K., Houde, F., Seguin, M., & Léonard, G. (2017) · Clinical Interventions in Aging · doi:10.2147/cia.s133423 · Cited by 42 · see citing works
“49,50 This is particularly true for small-sample-size studies, as conventional simple randomization methods can generate imbalances in base-line characteristics among groups.”
Kooshki, A., Taleban, F. A., Tabibi, H., & Hedayati, M. (2011) · Annals of Nutrition and Metabolism · doi:10.1159/000329727 · Cited by 41 · see citing works
“Thirty-four adult hemodialysis patients (21 men and 13 women) in the age range of 19–76 years were selected using convenience sampling from the hemodialysis unit of Vaseii Hospital in Sabzevar, Iran. Patients enrolled in the study did not have inflammatory diseases, infectious diseases including hepatitis, and none of…”
MethodMarins, E. F., Cabistany, L. D., Farias, C., et al. (2018) · The Journal of Strength and Conditioning Research · doi:10.1519/jsc.0000000000002892 · Cited by 41 · see citing works
“First, this study used an approach of randomization of samples (coin toss), which is not considered the best form (20).”
MethodChen, C., Huang, W., Chen, H.-C., Chang, C., Lee, L., Chen, H., Kang, Y.-D., Chie, W., Jan, C.-F. J., Wang, W.-D., et al. (2020) · PLoS ONE · doi:10.1371/journal.pone.0240158 · Cited by 41 · see citing works
Sidiq, M., Muzaffar, T., Janakiraman, B., Masoodi, S. R., Vasanthi, R. K., Ramachandran, A., Bansal, N., Chahal, A., Kashoo, F. Z., Rizvi, M. R., et al. (2024) · PLoS ONE · doi:10.1371/journal.pone.0294302 · Cited by 47 · see citing works
“Random sequences within each block were generated using index cards folded in opaque envelopes for randomization [25].”
MethodCoffee Consumption and Risk of Hypertension in Adults: Systematic Review and Meta-Analysis
Haghighatdoost, F., Hajihashemi, P., Romeiro, A. M. D. S., Mohammadifard, N., Sarrafzadegan, N., de Oliveira, C. M., & Silveira, É. A. (2023) · Nutrients · doi:10.3390/nu15133060 · Cited by 43 · see citing works
“A smaller case number cannot provide enough power to find the expected effect size, which is in concordance with our results as the confidence interval for studies with smaller case number was wider than those with more cases [65].”
ResultWang, C., Tachimori, H., Yamaguchi, H., Sekiguchi, A., Li, Y., Yamashita, Y., & Initiative, F. A. D. N. (2024) · Translational Psychiatry · doi:10.1038/s41398-024-02819-w · Cited by 39 · see citing works
“3, we proposed an AI-based randomization method in which the prediction of cognitive decline outputted by the AI model was used as the strati fi cation index in strati fi ed randomization [23, 24].”
MethodPaterson, C. C., Primeau, C., & Nabi, G. (2018) · European Journal of Oncology Nursing · doi:10.1016/j.ejon.2018.10.007 · Cited by 38 · see citing works
Przemska-Kosicka, A., Childs, C. E., Enani, S. M., Maidens, C. M., Dong, H., Bindayel, I. A., Tuohy, K. M., Todd, S., Gosney, M., & Yaqoob, P. (2016) · Immunity & Ageing · doi:10.1186/s12979-016-0061-4 · Cited by 37 · see citing works
“Subjects were randomized by a research nurse not involved in the analysis according to gender, age and BMI to receive the probiotic or placebo by covariate adaptive randomization [35].”
Paola, A. D., Lincoln, T., Skiest, D. J., Desabrais, M., Altice, F. L., & Springer, S. A. (2014) · Contemporary Clinical Trials · doi:10.1016/j.cct.2014.09.002 · Cited by 36 · see citing works
“To control for covariates potentially associated with the outcomes, covariate adaptive randomization was used [45-47].”
MethodKoletsi, D., Pandis, N., Polychronopoulou, A., & Eliades, T. (2012) · American Journal of Orthodontics and Dentofacial Orthopedics · doi:10.1016/j.ajodo.2011.12.020 · Cited by 37 · see citing works
Yoo, S.-H., Park, S.-K., Yoon, S., Lim, H.-S., & Ryu, J.-S. (2018) · Europe PMC (PubMed Central) · Cited by 36 · see citing works
Evidence-based medicine: an overview of key concepts.
Carter, M. J. (2010) · PubMed · Cited by 36 · see citing works
Pilloni, A., Marini, L., Gagliano, N., et al. (2023) · Journal of Periodontology · doi:10.1002/jper.22-0338 · Cited by 35 · see citing works
Randomised Controlled Trials in WOHP Interventions: A Review and Guidelines for Use
O’Shea, D. E., Connell, B. O., & Gallagher, S. M. (2015) · Applied Psychology · doi:10.1111/apps.12053 · Cited by 35 · see citing works
Fekete, Á. A., Giromini, C., Chatzidiakou, Y., Givens, D. I., & Lovegrove, J. A. (2018) · Scientific Reports · doi:10.1038/s41598-018-23333-2 · Cited by 35 · see citing works
“The volunteers were randomised by an independent researcher using an Excel-based randomisation program 23 , who was also responsible for treatment allocation.”
Russo, F. M., Benachi, A., Mieghem, T. V., Hoon, J. N. J. M. D., Calsteren, K. V., Annaert, P., Tréluyer, J., Allegaert, K., & Deprest, J. A. (2018) · Trials · doi:10.1186/s13063-018-2897-8 · Cited by 35 · see citing works
“To ensure a balance in sample size across groups over time, a block size randomization of 8 with equal numbers for each group is chosen [41, 42].”
MethodTrevisan, D. D., São‐João, T. M., Cornélio, M. E., Jannuzzi, F. F., Sousa, M. R., Rodrigues, R. C. M., & Lima, M. H. M. (2019) · Patient Education and Counseling · doi:10.1016/j.pec.2019.10.003 · Cited by 35 · see citing works
“com website and random size blocks method [25] was used to prepare a numerical sequence of 100 participants that was concealed from the investigators.”
MethodAzher, S., Cervantes, A., Marchionni, C., Grewal, K., Marchand, H., & Harley, J. M. (2023) · Clinical Simulation in Nursing · doi:10.1016/j.ecns.2023.02.009 · Cited by 34 · see citing works
Can propensity score matching replace randomized controlled trials?
Liau, M. Y. Q., Toh, E. Q., Muhamed, S., Selvakumar, S. V., & Shelat, V. G. (2024) · World Journal of Methodology · doi:10.5662/wjm.v14.i1.90590 · Cited by 34 · see citing works
Karimzadeh, A., Raeissadat, S. A., fam, S. E., Sedighipour, L., & Babaei-Ghazani, A. (2016) · Clinical Rheumatology · doi:10.1007/s10067-016-3484-6 · Cited by 34 · see citing works
Ghahfarokhi, M. M., Mohammadian, S. K., & Mohammadinezhad, B. (2017) · Nursing Open · doi:10.1002/nop2.101 · Cited by 34 · see citing works
Idiopathic granulomatous mastitis associated with erythema nodosum may indicate a worse prognosis
Velidedeoğlu, M., Kundaktepe, B. P., Mete, B., et al. (2021) · International Journal of Rheumatic Diseases · doi:10.1111/1756-185x.14218 · Cited by 34 · see citing works
McManus, B. M., & Nugent, J. K. (2012) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-012-9283-1 · Cited by 33 · see citing works
Schwartz, B., Kapellusch, J. M., Baca, A., & Wessner, B. (2019) · Ergonomics · doi:10.1080/00140139.2019.1577497 · Cited by 33 · see citing works
“…randomised controlled cross-sover trial, 18 office workers randomly recruited via e-mail by regional health insurance were randomly allocated to either an intervention arm (study arm I) or a control arm (study arm II) by means of a covariate adaptive randomisation (Kang, Ragan, and Park 2008).”
MethodBasson, A. R., LaSalla, A., Lam, G., Kulpins, D., Moen, E. L., Sundrud, M. S., Miyoshi, J., Ilić, S., Theriault, B. R., Cominelli, F., et al. (2020) · Scientific Reports · doi:10.1038/s41598-020-60900-y · Cited by 34 · see citing works
van Deursen, M., Reuvers, L., Duits, J. D., de Jong, G., van den Hurk, M. M., & Henssen, D. J. H. A. (2021) · Scientific Reports · doi:10.1038/s41598-021-92109-y · Cited by 33 · see citing works
Do, H. J., Kong, H.-K., Tetali, P., Lee, J., & Bailey, B. P. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579532 · Cited by 32 · see citing works
“…in a group) and extroversion personality [36] (i.e., the proportion of extroverted members in a group) were balanced across conditions using covariate adaptive randomization [44] when assigning participants to groups because those two features were known to influence group behavior [27, 68].”
MethodKooshki, A., Tofighiyan, T., & Miri, M. (2019) · Hemodialysis International · doi:10.1111/hdi.12748 · Cited by 31 · see citing works
Güldal, Ş. T., & Satan, A. (2020) · Current Psychology · doi:10.1007/s12144-020-01153-w · Cited by 31 · see citing works
Flocke, S. A., Antognoli, E., Step, M. M., Marsh, S., Parran, T. V., & Mason, M. J. (2012) · BMC Health Services Research · doi:10.1186/1472-6963-12-109 · Cited by 31 · see citing works
Do, H. J., Kong, H., Lee, J., & Bailey, B. P. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555112 · Cited by 31 · see citing works
“We balanced gender (i.e., proportion of females in a group) and personality [22] (i.e., proportion of extro-verted members in a group) across conditions using covariate adaptive randomization [30] when assigning participants to groups.”
MethodQuetsch, L. B., Girard, E. I., & McNeil, C. B. (2020) · Children and Youth Services Review · doi:10.1016/j.childyouth.2020.104886 · Cited by 30 · see citing works
Pandis, N., Polychronopoulou, A., & Eliades, T. (2011) · European Journal of Orthodontics · doi:10.1093/ejo/cjq141 · Cited by 30 · see citing works
“Therefore, simple randomization has given way to more precise and unbiased randomization methods (Kang et al., 2008), which will follow.”
MethodRandom Allocation in Controlled Clinical Trials: A Review
Egbewale, B. E. (2014) · Journal of Pharmacy & Pharmaceutical Sciences · doi:10.18433/j3sw36 · Cited by 29 · see citing works
“Medical researchers have variously submitted that minimization offers a solution to the limitations of stratification at balancing for multiple prognostic factors in small trials as the procedure makes treatment groups similar in several important features even with small samples [1,18,21,25].”
BackgroundMethodFundamentals of Randomization in Clinical Trial
Baghbaninaghadehi, F. (2016) · International Journal of Advanced Nutritional and Health Science · doi:10.23953/cloud.ijanhs.143 · Cited by 29 · see citing works
“Using stratified randomization, investigators can balance the control and treatment groups for age, sex, and other similar covariates [4].”
BackgroundMethodInfluentialSpringer, S. A., Altice, F. L., Herme, M., & Paola, A. D. (2014) · Contemporary Clinical Trials · doi:10.1016/j.cct.2013.12.006 · Cited by 28 · see citing works
“Covariate adaptive randomization [27] assured that covariates potentially associated with outcomes were controlled for in the randomization [28, 29].”
BackgroundRRApp, a robust randomization app, for clinical and translational research
Tu, C., & Benn, E. K. T. (2017) · Journal of Clinical and Translational Science · doi:10.1017/cts.2017.310 · Cited by 28 · see citing works
“While beyond the scope of our discussion, it is important to note that researchers should pay close attention to certain covariates, like comorbid conditions, when using block randomization since these factors could compromise the process and cause noncomparable groups [12].”
BackgroundBailey, R. L., Sahni, S., Chocano-Bedoya, P. O., Daly, R. M., Welch, A. A., Bischoff-Ferrari, H. A., & Weaver, C. M. (2018) · Advances in Nutrition · doi:10.1093/advances/nmy111 · Cited by 28 · see citing works
“The sample size not only dictates the cost of collecting data, but also is critical to ensure that true or clinically meaningful associations or effects can be detected (25, 26).”
BackgroundZeinali, F., Zarch, S. M. A., Mehrjardi, M. Y. V., Kalantar, S. M., Jahan-Mihan, A., Karimi‐Nazari, E., Fallahzadeh, H., Hosseinzadeh, M., Rahmanian, M., Fazeli, M. R., et al. (2020) · Trials · doi:10.1186/s13063-020-04236-y · Cited by 28 · see citing works
Methodology and design of platform trials: a meta-epidemiological study
Pitre, T., Cheng, S., Cusano, E., Khan, N., Mikhail, D., Leung, G., Vernooij, R. W. M., Yarnell, C. J., Goligher, E. C., Murthy, S., et al. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2023.02.010 · Cited by 27 · see citing works
Comparing the Antiswelling and Analgesic Effects of Three Different Ice Pack Therapy Durations
Kuo, C., Lin, C., Lee, W., et al. (2013) · Journal of Nursing Research · doi:10.1097/jnr.0b013e3182a0af12 · Cited by 27 · see citing works
Effect of alternating postures on cognitive performance for healthy people performing sedentary work
Schwartz, B., Kapellusch, J. M., Schrempf, A., Probst, K., Haller, M., & Baca, A. (2017) · Ergonomics · doi:10.1080/00140139.2017.1417642 · Cited by 27 · see citing works
Widenhoefer, T. L., Miller, T. M., Weigand, M. S., Watkins, E., & Almonroeder, T. G. (2019) · Sports Biomechanics · doi:10.1080/14763141.2019.1584237 · Cited by 27 · see citing works
Lecce, E., Conti, A., Vecchio, A. D., Felici, F., di Palumbo, A. S., Sacchetti, M., & Bazzucchi, I. (2025) · Frontiers in Physiology · doi:10.3389/fphys.2024.1512309 · Cited by 26 · see citing works
Williams, E. M., Egede, L. E., Oates, J. C., Dismuke, C., Ramakrishnan, V., Faith, T. D., Johnson, H., & Rose, J. (2019) · Trials · doi:10.1186/s13063-019-3580-4 · Cited by 27 · see citing works
Lee, D., Frey, G. C., Cothran, D. J., Harezlak, J., & Shih, P. C. (2022) · JMIR Formative Research · doi:10.2196/35701 · Cited by 27 · see citing works
“The major strengths of this study include (1) the use of a covariate-adaptive randomized controlled trial design to control the influence of covariates in the results [99], (2) objective assessment of PA and sedentary time, and (3) relatively good adherence to the study protocol and low attrition.”
MethodStatistical issues in randomised controlled trials: a narrative synthesis
Egbewale, B. E. (2015) · Asian Pacific Journal of Tropical Biomedicine · doi:10.1016/s2221-1691(15)30367-1 · Cited by 26 · see citing works
“For example, as earlier observed[4], treatment differences identified from observational designs, rather than from experimental clinical ARTICLE INFO ABSTRACT”
ResultSawula, E., Polgar, J. M., Porter, M. M., Gagnon, S., Weaver, B., Nakagawa, S., Stinchcombe, A., & Bédard, M. (2017) · Traffic Injury Prevention · doi:10.1080/15389588.2016.1236194 · Cited by 26 · see citing works
“Participants were then randomized to the BT group, the BT + OR group, or the BT + OR + S group using stratified randomization, an approach that produces equal-sized study groups that are balanced by covariates (Kang et al. 2008).”
MethodSimple randomization may lead to unequal group sizes. Is that a problem?
Shibasaki, W. M., & Martins, R. P. (2018) · American Journal of Orthodontics and Dentofacial Orthopedics · doi:10.1016/j.ajodo.2018.07.005 · Cited by 25 · see citing works
- Authors
- Kang, M., Ragan, B. G., & Park, J.-H.
- Affiliations
- Middle Tennessee State University (US)
- University of Northern Iowa (US)
- Korea National Sport University (KR)
- Venue
- Journal of Athletic Training
- Published
- 2008-03
- Volume
- 43
- Issue
- 2
- Pages
- 215-221
- ISSN
- 1062-6050 (ISSN-L)
- PMC
- PMC2267325
- OpenAlex
- W2103799103
- Semantic Scholar
- 76a894a7f31f671125792589418911fc63574599
- Cited by
- 555
- References
- 31
- Citations by year
- 2026: 54 · 2025: 79 · 2024: 90 · 2023: 54 · 2022: 29 · 2021: 33 · 2020: 39 · 2019: 22 · 2018: 26 · 2017: 27 · 2016: 20 · 2015: 16 · 2014: 17 · 2013: 12 · 2012: 15
- FWCI
- 6.61
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Journal of Athletic Training (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- UNI ScholarWorks (University of Northern Iowa) (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- randomization technique, clinical trials, block randomization, stratified randomization, covariate-adaptive randomization, covariate control, evidence-based practice
- MeSH terms
- Clinical Trials as Topic, Female, Humans, Male, Random Allocation, Outcome Assessment, Health Care, Evidence-Based Medicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review