Properties of permuted-block randomization in clinical trials
Abstract
This article describes some of the important statistical properties of the commonly used permuted-block design, also known simply as blocked-randomization. Under a permutation model for statistical tests, proper analyses should employ tests that incorporate the blocking used in the randomization. These include the block-stratified Mantel-Haenszel chi-square test for binary data, the blocked analysis of variance F test, and the blocked nonparametric linear rank test. It is common, however, to ignore the blocking in the analysis. For these tests, it is shown that the size of a test obtained from an analysis incorporating the blocking (say T), versus an analysis ignoring the blocking (say TI), is related to the intrablock correlation coefficient (R) as TI = T(1-R). For blocks of common length 2m, the range of R is from -1/(2m-1) to 1. Thus, if there is a positive intrablock correlation, which is more likely than not for m greater than 1, an analysis ignoring blocking will be unduly conservative. Permutation tests are also presented for the case of stratified analyses within one or more subgroups of patients defined post hoc on the basis of a covariate. This provides a basis for the analysis when responses from some patients are assumed to be missing-at-random. An alternative strategy that requires no assumptions is to perform the analysis using only the subset of complete blocks in which no observations are missing. The Blackwell-Hodges model is used to assess the potential for selection bias induced by investigator attempts to guess which treatment is more likely to be assigned to each incoming patient. In an unmasked trial, the permuted-block design provides substantial potential for selection bias in the comparison of treatments due to the predictability of the assignments that is induced by the requirement of balance within blocks. Further, this bias is not eliminated by the use of random block sizes. We also modify the Blackwell-Hodges model to allow for selection bias only when the investigator is able to discern the next assignment with certainty. This type of bias is reduced by the use of random block sizes and is eliminated only if the possible block sizes are unknown to the investigators. Finally, the Efron model for accidental bias is used to assess the potential for bias in the estimation of treatment effects due to covariate imbalances. For the permuted-block design, the variance of this bias approaches that of complete randomization as the half-block length m----infinity.(ABSTRACT TRUNCATED AT 400 WORDS)
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Randomization used randomly permuted blocks and was stratified into two blocks by use of psychotropic medication.
“we randomized each of them to a single treatment by using the method of randomly permuted blocks (Matts & Lachin, 1988).Randomization was stratified into two blocks by the use of psychotropic medication”
From Efficacy of an acceptance-based group behavioral therapy for generalized anxiety disorder. (2020) · cites this paper as Matts & Lachin, 1988
Randomization was generated using a random number generator and randomly permuted blocks, and was stratified by current psychotropic medication use.
“A random number generator (http://www.randomization.com) was used to generate a random number for each participant and randomly allocate each enrolled participant to one of the two treatment groups, in a 1:1 ratio, following the method of randomly permuted blocks (Matts and Lachin, 1988).”
From Inflammatory markers changes following acceptance-based behavioral psychotherapy in generalized anxiety disorder patients: Evidence from a randomized controlled trial (2024) · cites this paper as Matts and Lachin, 1988
Randomization of the 288 participants into control and intervention groups used the permuted block randomization method.
“Dr Shi randomized the 288 participants into control and intervention groups using the permuted block randomization method [21]”
From Mobile-Delivered Mindfulness Intervention on Anxiety Level Among College Athletes: Randomized Controlled Trial (2024) · cites this paper as [21]
Generation of the random allocation sequence used permuted block randomization and was conducted by the second author (JP).
“Generation of the random allocation sequence, using permuted block randomization [55], was conducted by the second author (JP).”
Cites
Statistical Aspects of the Analysis of Data From Retrospective Studies of Disease
(1959) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/22.4.719 · Cited by 14,689 · see citing works
Statistical Methods for Rates and Proportions.
Everitt, B. S., & Fleiss, J. L. (1981) · Biometrics · doi:10.2307/2530193 · Cited by 9,034 · see citing works
Nonparametrics: Statistical Methods Based on Ranks
Mergenthaler, M. J., & Lehmann, E. L. (1979) · Technometrics · doi:10.2307/1268531 · Cited by 3,353 · see citing works
The Design and Analysis of Clinical Experiments.
Hills, M., & Fleiss, J. L. (1987) · Journal of the Royal Statistical Society Series A (General) · doi:10.2307/2982050 · Cited by 3,261 · see citing works
Fundamentals of Clinical Trials
Friedman, L. M., Furberg, C. D., DeMets, D. L., Reboussin, D. M., & Granger, C. B. (2015) · doi:10.1007/978-3-319-18539-2 · Cited by 2,237 · see citing works
Nonparametrics: Statistical Methods Based on Ranks.
Beaver, R. J., & Lehmann, E. L. (1976) · Biometrics · doi:10.2307/2529529 · Cited by 2,067 · see citing works
Forcing a sequential experiment to be balanced
EFRON, B. (1971) · Biometrika · doi:10.1093/biomet/58.3.403 · Cited by 873 · see citing works
The randomization and stratification of patients to clinical trials
Zelen, M. (1974) · Journal of Chronic Diseases · doi:10.1016/0021-9681(74)90015-0 · Cited by 614 · see citing works
Fundamentals of Clinical Trials
Rhoads, G. G. (1986) · JAMA · doi:10.1001/jama.1986.03380080101043 · Cited by 345 · see citing works
Properties of the urn randomization in clinical trials
Wei, L. J., & Lachin, J. M. (1988) · Controlled Clinical Trials · doi:10.1016/0197-2456(88)90048-7 · Cited by 308 · see citing works
Design for the Control of Selection Bias
Blackwell, D., & Hodges, J. L. (1957) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177706973 · Cited by 209 · see citing works
Statistical properties of randomization in clinical trials
Lachin, J. M. (1988) · Controlled Clinical Trials · doi:10.1016/0197-2456(88)90045-1 · Cited by 200 · see citing works
Self-citationCancer clinical trials: methods and practice
Brookmeyer, R. (1985) · Controlled Clinical Trials · doi:10.1016/0197-2456(85)90100-x · Cited by 179 · see citing works
Properties of simple randomization in clinical trials
Lachin, J. M. (1988) · Controlled Clinical Trials · doi:10.1016/0197-2456(88)90046-3 · Cited by 175 · see citing works
Self-citationTHE RANDOMZATION ANALYSIS OF A GENERALIZED RANDOMIZED BLOCK DESIGN
Wilk, M. B. (1955) · Biometrika · doi:10.1093/biomet/42.1-2.70 · Cited by 72 · see citing works
Imbalance in treatment assignments in stratified blocked randomization
Hallstrom, A., & Davis, K. B. (1988) · Controlled Clinical Trials · doi:10.1016/0197-2456(88)90050-5 · Cited by 61 · see citing works
Analysis of accrual randomized clinical trials with balanced groups in strata
Matts, J. P., & McHugh, R. B. (1978) · Journal of Chronic Diseases · doi:10.1016/0021-9681(78)90057-7 · Cited by 39 · see citing works
Self-citationThe Randomization Analysis of a Generalized Randomized Block Design
Wilk, M. B. (1955) · Biometrika · doi:10.2307/2333423 · Cited by 32 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Generation of allocation sequences in randomised trials: chance, not choice
Schulz, K. F., & Grimes, D. A. (2002) · The Lancet · doi:10.1016/s0140-6736(02)07683-3 · Cited by 774 · see citing works
Blocked randomization with randomly selected block sizes
Efird, J. (2010) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph8010015 · Cited by 564 · see citing works
Spinal Anesthesia or General Anesthesia for Hip Surgery in Older Adults
Neuman, M. D., Feng, R., Carson, J. L., Gaskins, L. J., Dillane, D., Sessler, D. I., Sieber, F., Magaziner, J. S., Marcantonio, E. R., Mehta, S., et al. (2021) · New England Journal of Medicine · doi:10.1056/nejmoa2113514 · Cited by 511 · see citing works
Arora, R. R., Chou, T. M., Jain, D., Fleishman, B. L., Crawford, L. E., McKiernan, T. L., & Nesto, R. W. (1999) · Journal of the American College of Cardiology · doi:10.1016/s0735-1097(99)00140-0 · Cited by 492 · see citing works
Effects of Vesnarinone on Morbidity and Mortality in Patients with Heart Failure
Feldman, A. M., Bristow, M. R., Parmley, W. W., Carson, P. E., Pepine, C. J., Gilbert, E. M., Strobeck, J. E., Hendrix, G., Powers, E. R., Bain, R. P., et al. (1993) · New England Journal of Medicine · doi:10.1056/nejm199307153290301 · Cited by 472 · see citing works
Ensuring balanced distribution of prognostic factors in treatment outcome research.
Stout, R. L., Wirtz, P. W., Carbonari, J. P., & Del Boca, F. K. (1994) · Journal of Studies on Alcohol, Supplement · doi:10.15288/jsas.1994.s12.70 · Cited by 461 · see citing works
Sloan, E. P. (1999) · JAMA · doi:10.1001/jama.282.19.1857 · Cited by 459 · see citing works
Kirwan, M., Vandelanotte, C., Fenning, A., & Duncan, M. J. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2588 · Cited by 343 · see citing works
The REMATCH trial: rationale, design, and end points
Rose, E. A., Moskowitz, A. J., Packer, M., Sollano, J. A., Williams, D. L., Tierney, A. R., Heitjan, D. F., Meier, P., Ascheim, D. D., Levitan, R. G., et al. (1999) · The Annals of Thoracic Surgery · doi:10.1016/s0003-4975(99)00042-9 · Cited by 373 · see citing works
Wilson, F. P., Shashaty, M. G. S., Testani, J. M., Aqeel, I., Borovskiy, Y., Ellenberg, S. S., Feldman, H. I., Fernández, H., Gitelman, Y., Lin, J. J., et al. (2015) · The Lancet · doi:10.1016/s0140-6736(15)60266-5 · Cited by 353 · see citing works
Improper analysis of trials randomised using stratified blocks or minimisation
Kahan, B. C., & Morris, T. P. (2011) · Statistics in Medicine · doi:10.1002/sim.4431 · Cited by 333 · see citing works
Chan, F. K. L., Wong, V. W. S., Suen, B. Y., Wu, J. C. Y., Ching, J. Y. L., Hung, L. C. T., Hui, A. J., Leung, V. K. S., Lee, V. W. Y., Lai, L. H., et al. (2007) · The Lancet · doi:10.1016/s0140-6736(07)60749-1 · Cited by 330 · see citing works
Zhou, C., Wu, L., Fan, Y., Wang, Z., Liu, L., Chen, G., Zhang, L., Huang, D., Cang, S., Yang, Z., et al. (2021) · Journal of Thoracic Oncology · doi:10.1016/j.jtho.2021.04.011 · Cited by 322 · see citing works
Properties of the urn randomization in clinical trials
Wei, L. J., & Lachin, J. M. (1988) · Controlled Clinical Trials · doi:10.1016/0197-2456(88)90048-7 · Cited by 308 · see citing works
Kahan, B. C., & Morris, T. P. (2012) · BMJ · doi:10.1136/bmj.e5840 · Cited by 294 · see citing works
Randomization in clinical trials: Conclusions and recommendations
Lachin, J. M., Matts, J. P., & Wei, L. J. (1988) · Controlled Clinical Trials · doi:10.1016/0197-2456(88)90049-9 · Cited by 272 · see citing works
Self-citationZabor, E. C., Kaizer, A. M., & Hobbs, B. P. (2020) · Chest · doi:10.1016/j.chest.2020.03.013 · Cited by 294 · see citing works
Freedman, B. I., Wuerth, J.-P., Cartwright, K. J., Bain, R. P., Dippe, S. E., Hershon, K. S., Mooradian, A. D., & Spinowitz, B. (1999) · Controlled Clinical Trials · doi:10.1016/s0197-2456(99)00024-0 · Cited by 257 · see citing works
Unequal group sizes in randomised trials: guarding against guessing
Schulz, K. F., & Grimes, D. A. (2002) · The Lancet · doi:10.1016/s0140-6736(02)08029-7 · Cited by 250 · see citing works
Randomization in Clinical Trials: Permuted Blocks and Stratification
Broglio, K. (2018) · JAMA · doi:10.1001/jama.2018.6360 · Cited by 243 · see citing works
Henninger, H. B., Barg, A., Anderson, A. E., Bachus, K. N., Burks, R. T., & Tashjian, R. Z. (2011) · Journal of Shoulder and Elbow Surgery · doi:10.1016/j.jse.2011.07.034 · Cited by 206 · see citing works
Optimal multivariate matching before randomization.
Greevy, R., Lu, B., Silber, J., & Rosenbaum, P. (2004) · Biostatistics · doi:10.1093/biostatistics/5.2.263 · Cited by 233 · see citing works
Rochon, J., Bales, C. W., Ravussin, É., Redman, L. M., Holloszy, J. O., Racette, S. B., Roberts, S. B., Das, S. K., Romashkan, S., Galan, K. M., et al. (2010) · The Journals of Gerontology Series A · doi:10.1093/gerona/glq168 · Cited by 203 · see citing works
Statistical properties of randomization in clinical trials
Lachin, J. M. (1988) · Controlled Clinical Trials · doi:10.1016/0197-2456(88)90045-1 · Cited by 200 · see citing works
Self-citationProperties of simple randomization in clinical trials
Lachin, J. M. (1988) · Controlled Clinical Trials · doi:10.1016/0197-2456(88)90046-3 · Cited by 175 · see citing works
Self-citationA phase I/II study of intrathecal idursulfase-IT in children with severe mucopolysaccharidosis II
Muenzer, J., Hendriksz, C. J., Fan, Z., Vijayaraghavan, S., Perry, V., Santra, S., Solanki, G. A., Mascelli, M. A., Pan, L., Wang, N., et al. (2015) · Genetics in Medicine · doi:10.1038/gim.2015.36 · Cited by 168 · see citing works
Lin, Y., Zhu, M., & Su, Z. (2015) · Contemporary Clinical Trials · doi:10.1016/j.cct.2015.07.011 · Cited by 152 · see citing works
Alegria, A. A., Wulff, M., Brinson, H., Barker, G. J., Norman, L. J., Brandeis, D., Stahl, D., David, A. S., Taylor, E., Giampietro, V., et al. (2017) · Human Brain Mapping · doi:10.1002/hbm.23584 · Cited by 151 · see citing works
Self-Study from Web-Based and Printed Guideline Materials
Bell, D. S., Fonarow, G. C., Hays, R. D., & Mangione, C. M. (2000) · Annals of Internal Medicine · doi:10.7326/0003-4819-132-12-200006200-00003 · Cited by 154 · see citing works
Henninger, H. B., Barg, A., Anderson, A. E., Bachus, K. N., Tashjian, R. Z., & Burks, R. T. (2011) · Journal of Shoulder and Elbow Surgery · doi:10.1016/j.jse.2011.01.040 · Cited by 139 · see citing works
A roadmap to using randomization in clinical trials
Berger, V. W., Bour, L. J., Carter, K., Chipman, J. J., Everett, C. C., Heussen, N., Hewitt, C., Hilgers, R.-D., Luo, Y. A., Renteria, J., et al. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01303-z · Cited by 135 · see citing works
Arresting Dentine Caries with Different Concentration and Periodicity of Silver Diamine Fluoride
Fung, M. H. T., Duangthip, D., Wong, M. C. M., Lo, E. C. M., & Chu, C. H. (2016) · JDR Clinical & Translational Research · doi:10.1177/2380084416649150 · Cited by 132 · see citing works
Alexander, D., Northcross, A., Karrison, T. G., Morhasson-Bello, O., Wilson, N. R., Atalabi, O. M., Dutta, A., Adu, D., Ibigbami, T., Olamijulo, J., et al. (2017) · Environment International · doi:10.1016/j.envint.2017.11.021 · Cited by 119 · see citing works
Advance Care Planning Does Not Adversely Affect Hope or Anxiety Among Patients With Advanced Cancer
Green, M. J., Schubart, J. R., Whitehead, M. M., Farace, E., Lehman, E. B., & Levi, B. H. (2014) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2014.11.293 · Cited by 116 · see citing works
Asymptotic properties of covariate-adaptive randomization
Hu, Y., & Hu, F. (2012) · The Annals of Statistics · doi:10.1214/12-aos983 · Cited by 114 · see citing works
Adaptive adjustment of the randomization ratio using historical control data
Hobbs, B. P., Carlin, B. P., & Sargent, D. J. (2013) · Clinical Trials · doi:10.1177/1740774513483934 · Cited by 112 · see citing works
Shortreed, S. M., Peeters, A., & Forbes, A. B. (2013) · Heart · doi:10.1136/heartjnl-2012-303461 · Cited by 105 · see citing works
Bell, D. S., Harless, C. E., Higa, J. K., Bjork, E. L., Bjork, R. A., Bazargan, M., & Mangione, C. M. (2008) · Journal of General Internal Medicine · doi:10.1007/s11606-008-0604-2 · Cited by 102 · see citing works
Randomized Controlled Ethanol Cookstove Intervention and Blood Pressure in Pregnant Nigerian Women
Alexander, D., Northcross, A., Wilson, N., Dutta, A., Pandya, R., Ibigbami, T., Adu, D., Olamijulo, J., Morhason-Bello, O., Karrison, T., et al. (2017) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.201606-1177oc · Cited by 91 · see citing works
Neuman, M. D., Ellenberg, S. S., Sieber, F. E., Magaziner, J. S., Feng, R., & Carson, J. L. (2016) · BMJ Open · doi:10.1136/bmjopen-2016-013473 · Cited by 90 · see citing works
Han, J. W., Lee, H., Hong, J. W., Kim, K., Kim, T., Byun, H. J., Ko, J. W., Youn, J. C., Ryu, S., Lee, N., et al. (2016) · Journal of Alzheimer s Disease · doi:10.3233/jad-160619 · Cited by 89 · see citing works
Can we improve gait skills in chronic hemiplegics? A randomised control trial with gait trainer.
Dias, D., Laíns, J., Pereira, A., Nunes, R. F. R., Caldas, J., do Amaral, C. M. S., Pires, S., Costa, A., Alves, P., Moreira, M., et al. (2007) · PubMed · Cited by 88 · see citing works
Metformin Plus Insulin for Preexisting Diabetes or Gestational Diabetes in Early Pregnancy
Boggess, K., Valint, A., Refuerzo, J., Zork, N. M., Battarbee, A. N., Eichelberger, K. Y., Ramos, G. A., Olson, G., Durnwald, C. P., Landon, M. B., et al. (2023) · JAMA · doi:10.1001/jama.2023.22949 · Cited by 84 · see citing works
Recommendations for the Design and Analysis of Treatment Trials for Alcohol Use Disorders
Witkiewitz, K. A., Finney, J. W., Harris, A. H. S., Kivlahan, D. R., & Kranzler, H. R. (2015) · Alcoholism Clinical and Experimental Research · doi:10.1111/acer.12800 · Cited by 79 · see citing works
Is restricted randomisation necessary?
Hewitt, C. E., & Torgerson, D. J. (2006) · BMJ · doi:10.1136/bmj.332.7556.1506 · Cited by 77 · see citing works
PREVENT-DM Comparative Effectiveness Trial of Lifestyle Intervention and Metformin
O’Brien, M. J., Perez, A., Scanlan, A. B., Alos, V. A., Whitaker, R. C., Foster, G. D., Ackermann, R. T., Ciolino, J. D., & Homko, C. J. (2017) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2017.01.008 · Cited by 77 · see citing works
Tranos, P. (2006) · British Journal of Ophthalmology · doi:10.1136/bjo.2006.092965 · Cited by 75 · see citing works
Ji, Y. W., Kim, M., Kang, D. S. Y., Reinstein, D. Z., Archer, T. J., Choi, J., Kim, E. K., Lee, H. K., Seo, K. Y., & Kim, T.-I. (2017) · American Journal of Ophthalmology · doi:10.1016/j.ajo.2017.05.005 · Cited by 73 · see citing works
Zhao, W., & Weng, Y. (2011) · Contemporary Clinical Trials · doi:10.1016/j.cct.2011.08.004 · Cited by 72 · see citing works
Goldfischer, E. R., Cromie, W. J., Karrison, T. G., Naszkiewicz, L., & Gerber, G. S. (1997) · The Journal of Urology · doi:10.1016/s0022-5347(01)65292-3 · Cited by 72 · see citing works
Nelwan, E. J., Ekawati, L. L., Tjahjono, B., Setiabudy, R., Sutanto, I., Chand, K., Ekasari, T., Djoko, D., Basri, H., Taylor, W., et al. (2015) · BMC Medicine · doi:10.1186/s12916-015-0535-9 · Cited by 70 · see citing works
Huang, Q., Wu, W., Chen, X., Wu, B., Wu, L., Huang, X., Jiang, S., & Huang, L. (2019) · Trials · doi:10.1186/s13063-019-3177-y · Cited by 65 · see citing works
Han, J. W., Son, K., Byun, H. J., Ko, J. W., Kim, K., Hong, J. W., Kim, K. W., & Kim, K. W. (2017) · Alzheimer s Research & Therapy · doi:10.1186/s13195-017-0264-8 · Cited by 67 · see citing works
Swartz, H. A., Frank, E., & Cheng, Y. (2012) · Bipolar Disorders · doi:10.1111/j.1399-5618.2012.00988.x · Cited by 63 · see citing works
Feldman, A. M., Baughman, K. L., Lee, W. K., Gottlieb, S. H., Weiss, J. L., Becker, L. C., & Strobeck, J. E. (1991) · The American Journal of Cardiology · doi:10.1016/0002-9149(91)90194-p · Cited by 61 · see citing works
Ussher, J. M., & Perz, J. (2017) · PLoS ONE · doi:10.1371/journal.pone.0175068 · Cited by 60 · see citing works
Vail, E. A., Feng, R., Sieber, F. E., Carson, J. L., Ellenberg, S. S., Magaziner, J. S., Dillane, D., Marcantonio, E. R., Sessler, D. I., Ayad, S. S., et al. (2023) · Anesthesiology · doi:10.1097/aln.0000000000004807 · Cited by 60 · see citing works
Neuman, M. D., Feng, R., Ellenberg, S. S., Sieber, F., Sessler, D. I., Magaziner, J., Elkassabany, N., Schwenk, E. S., Dillane, D., Marcantonio, E. R., et al. (2022) · Annals of Internal Medicine · doi:10.7326/m22-0320 · Cited by 59 · see citing works
Ariel, B., & Farrington, D. P. (2009) · Springer eBooks · doi:10.1007/978-0-387-77650-7_21 · Cited by 58 · see citing works
On model-based time trend adjustments in platform trials with non-concurrent controls
Roig, M. B., Krotka, P., Burman, C., Glimm, E., Gold, S. M., Hees, K., Jacko, P., König, F., Magirr, D., Mesenbrink, P. G., et al. (2022) · BMC Medical Research Methodology · doi:10.1186/s12874-022-01683-w · Cited by 58 · see citing works
Zhao, W., Weng, Y., Wu, Q., & Palesch, Y. Y. (2011) · Pharmaceutical Statistics · doi:10.1002/pst.493 · Cited by 57 · see citing works
Virtual Reality Relaxation to Decrease Dental Anxiety: Immediate Effect Randomized Clinical Trial
Lahti, S. M., Suominen, A. L., Freeman, R., Lähteenoja, T., & Humphris, G. M. (2020) · JDR Clinical & Translational Research · doi:10.1177/2380084420901679 · Cited by 60 · see citing works
Tashjian, R. Z., Burks, R. T., Zhang, Y., & Henninger, H. B. (2014) · Journal of Shoulder and Elbow Surgery · doi:10.1016/j.jse.2014.08.017 · Cited by 55 · see citing works
Khalili, N., Fereydoonzadeh, R., Mohtashami, R., Mehrzadi, S., Heydari, M., & Huseini, H. F. (2017) · Journal of Evidence-Based Complementary & Alternative Medicine · doi:10.1177/2156587217696929 · Cited by 55 · see citing works
Chi, M., Yang, K.-L., Chang, Y.-C., Ko, H.-L., Lin, Y.-H., Huang, S.-C., Huang, Y.-Y., Liao, K., Kondo, M., & Chi, K.-H. (2017) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2017.09.030 · Cited by 55 · see citing works
Manuel, J. K., Lum, P. J., Hengl, N. S., & Sorensen, J. L. (2013) · AIDS Care · doi:10.1080/09540121.2012.733331 · Cited by 52 · see citing works
An introduction to clinical trial design
Schultz, A., Saville, B. R., Marsh, J. A., & Snelling, T. (2019) · Paediatric Respiratory Reviews · doi:10.1016/j.prrv.2019.06.002 · Cited by 53 · see citing works
Olopade, C., Frank, E., Bartlett, E. C., Alexander, D., Dutta, A., Ibigbami, T., Adu, D., Olamijulo, J., Arinola, G., Karrison, T., et al. (2017) · Environment International · doi:10.1016/j.envint.2016.11.004 · Cited by 50 · see citing works
Ekhaguere, O. A., Oluwafemi, R. O., Badejoko, B. O., Oyeneyin, L. O., Butali, A., Lowenthal, E. D., & Steenhoff, A. P. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-001232 · Cited by 49 · see citing works
Firl, D. J., Sasaki, K., Agopian, V. G., Gorgen, A., Kimura, S., Dumronggittigule, W., McVey, J. C., Iesari, S., Mennini, G., Vitale, A., et al. (2019) · Hepatology · doi:10.1002/hep.30838 · Cited by 49 · see citing works
Zhao, W. (2014) · Statistics in Medicine · doi:10.1002/sim.6266 · Cited by 45 · see citing works
The Efficacy of Screening for Common Dental Diseases by Hygiene-Therapists
Macey, R., Glenny, A., Walsh, T., Tickle, M., Worthington, H. V., Ashley, J., & Brocklehurst, P. R. (2015) · Journal of Dental Research · doi:10.1177/0022034514567335 · Cited by 46 · see citing works
Reproductive Health Choices for Young Adults With Sickle Cell Disease or Trait
Wilkie, D. J., Gallo, A. M., Yao, Y., Molokie, R. E., Stahl, C., Hershberger, P. E., Zhao, Z., Suarez, M. L., Labotka, R. J., Johnson, B., et al. (2013) · Nursing Research · doi:10.1097/nnr.0b013e3182a0316b · Cited by 44 · see citing works
Effectiveness of airway clearance techniques in children hospitalized with acute bronchiolitis
Ginderdeuren, F. V., Vandenplas, Y., Deneyer, M., Vanlaethem, S., Buyl, R., & Kerckhofs, E. (2016) · Pediatric Pulmonology · doi:10.1002/ppul.23495 · Cited by 44 · see citing works
de Oliveira, F. C. L., de Fontenay, B. P., Bouyer, L. J., Desmeules, F., & Roy, J. (2020) · Sports Health A Multidisciplinary Approach · doi:10.1177/1941738120944254 · Cited by 46 · see citing works
Serruys, P. W. J. C., Vranckx, P., Slagboom, T., Regar, E. S., Meliga, E., de Winter, R. J., Heyndrickx, G. R., Schuler, G. C., van Remortel, E., Dubé, G. P., et al. (2008) · EuroIntervention · doi:10.4244/eijv3i5a108 · Cited by 44 · see citing works
Keys, E., Luctkar‐Flude, M., Tyerman, J. J., Sears, K., & Woo, K. Y. (2021) · Clinical Simulation in Nursing · doi:10.1016/j.ecns.2021.01.013 · Cited by 43 · see citing works
Hilgers, R.-D., & Tamm, M. (2014) · Methods of Information in Medicine · doi:10.3414/me14-01-0048 · Cited by 42 · see citing works
Randomization in substance abuse clinical trials
Hedden, S. L., Woolson, R. F., & Malcolm, R. J. (2006) · Substance Abuse Treatment Prevention and Policy · doi:10.1186/1747-597x-1-6 · Cited by 42 · see citing works
Environmental intervention for house dust mite control in childhood bronchial asthma
El‐Ghitany, E. M., & El-Salam, M. M. A. (2012) · Environmental Health and Preventive Medicine · doi:10.1007/s12199-011-0263-5 · Cited by 42 · see citing works
Chang, M., Brown, R., & Nitzke, S. A. (2017) · BMC Public Health · doi:10.1186/s12889-017-4109-y · Cited by 40 · see citing works
Niven, D. J., Stelfox, H. T., Léger, C., Kubes, P., & Laupland, K. B. (2012) · Journal of Critical Care · doi:10.1016/j.jcrc.2012.08.015 · Cited by 40 · see citing works
Gallo, A. M., Wilkie, D. J., Yao, Y., Molokie, R. E., Stahl, C., Hershberger, P. E., Zhao, Z., Suarez, M. L., Johnson, B., Angulo, R., et al. (2015) · Journal of Genetic Counseling · doi:10.1007/s10897-015-9874-0 · Cited by 39 · see citing works
Duong, D. T. T., Binns, C. W., Pham, N. M., Zhao, Y., Dinh, T. P. H., Ha, B. T. T., Tran, C. T., Nguyen, X. H., Giglia, R. C., Xu, F., et al. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17155552 · Cited by 39 · see citing works
Buhimschi, C. S., Bahtiyar, M. O., Zhao, G., Abdelghany, O., Schneider, L., Abdel‐Razeq, S. S., Dulay, A. T., Lipkind, H. S., Mieth, S., Rogers, L. K., et al. (2020) · Pediatric Research · doi:10.1038/s41390-020-01106-w · Cited by 39 · see citing works
Rennick‐Egglestone, S., Elliott, R. A., Smuk, M., Robinson, C., Bailey, S., Smith, R., Keppens, J., Hussain, H., Pollock, K., Cuijpers, P. J., et al. (2020) · Trials · doi:10.1186/s13063-020-04428-6 · Cited by 38 · see citing works
Nejatbakhsh, F., Karegar-Borzi, H., Amin, G., Eslaminejad, A., Hosseini, M., Bozorgi, M., & Gharabaghi, M. A. (2016) · Journal of Ethnopharmacology · doi:10.1016/j.jep.2016.12.032 · Cited by 35 · see citing works
Stevens, J. H., Lutz, R., Osuagwu, N., Rotz, D., & Goesling, B. (2017) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2017.06.010 · Cited by 37 · see citing works
Robust Tests for Treatment Effect in Survival Analysis under Covariate-Adaptive Randomization
Ye, T., & Shao, J. (2020) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/rssb.12392 · Cited by 35 · see citing works
Manlove, J. S., Cook, E. L., Whitfield, B., Johnson, M., Martínez-García, G., & Garrido, M. (2019) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2019.08.017 · Cited by 35 · see citing works
Henninger, H. B., King, F. K., Tashjian, R. Z., & Burks, R. T. (2013) · Journal of Shoulder and Elbow Surgery · doi:10.1016/j.jse.2013.08.008 · Cited by 34 · see citing works
Prasad, S. M., Large, M. C., Patel, A. R., Famakinwa, O. J., Galocy, R. M., Karrison, T., Shalhav, A. L., & Zagaja, G. P. (2014) · The Journal of Urology · doi:10.1016/j.juro.2014.01.004 · Cited by 33 · see citing works
Ford, T. J., Last, A., Henley, W., Norman, S., Guglani, S., Kelesidi, K., Martin, A., Moran, P., Latham-Cork, H., & Goodman, R. (2012) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-012-0564-z · Cited by 32 · see citing works
Oo, W. M. (2014) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2014.06.001 · Cited by 32 · see citing works
Losina, E., Wright, J. G., & Katz, J. N. (2012) · Journal of Bone and Joint Surgery. American volume · doi:10.2106/jbjs.k.00009 · Cited by 31 · see citing works
Lipchik, G. L., Nicholson, R. A., & Penzien, D. B. (2005) · Headache The Journal of Head and Face Pain · doi:10.1111/j.1526-4610.2005.05093.x · Cited by 29 · see citing works
Eggener, S. E., Large, M. C., Gerber, G. S., Pettus, J. A., Yossepowitch, O., Smith, N. D., KUNDU, S. D., Kunnavakkam, R., Zorn, K. C., & Raman, J. D. (2013) · British Journal of Urology · doi:10.1111/bju.12241 · Cited by 28 · see citing works
Effects of unstratified and centre‐stratified randomization in multi‐centre clinical trials
Anisimov, V. V. (2010) · Pharmaceutical Statistics · doi:10.1002/pst.412 · Cited by 26 · see citing works
Dynamic randomization and a randomization model for clinical trials data
Kaiser, L. D. (2012) · Statistics in Medicine · doi:10.1002/sim.5448 · Cited by 26 · see citing works
Racial Differences in the Effectiveness of Internet-Delivered Mental Health Care
Jonassaint, C. R., Belnap, B. H., Huang, Y., Karp, J. F., Abebe, K. Z., & Rollman, B. L. (2019) · Journal of General Internal Medicine · doi:10.1007/s11606-019-05542-1 · Cited by 24 · see citing works
- Authors
- Matts, J. P., & Lachin, J. M.
- Affiliations
- University of Minnesota (US)
- George Washington University (US)
- Corresponding author
- Matts, John P.
- ORCID
- Lachin, John M.
- Venue
- Controlled Clinical Trials
- Publisher
- Elsevier BV
- Published
- 1988-12
- Volume
- 9
- Issue
- 4
- Pages
- 327-344
- ISSN
- 0197-2456 (ISSN-L)
- OpenAlex
- W2005415125
- Cited by
- 321
- References
- 18
- Citations by year
- 2026: 14 · 2025: 13 · 2024: 23 · 2023: 22 · 2022: 19 · 2021: 18 · 2020: 33 · 2019: 14 · 2018: 6 · 2017: 15 · 2016: 13 · 2015: 18 · 2014: 16 · 2013: 12 · 2012: 15
- FWCI
- 4.39
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Controlled Clinical Trials (publishedVersion)
- PubMed (publishedVersion)
- Funders
- U.S. Public Health Service (R01-DI-39826)
- National Heart, Lung, and Blood Institute (HL15265)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Social Sciences › Decision Sciences › Management Science and Operations Research › Optimal Experimental Design Methods
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Keywords
- permuted block randomization, permutation tests, nonparametric rank tests, stratified analysis, selection bias, covariate imbalance, treatment effect estimation
- MeSH terms
- Analysis of Variance, Clinical Trials as Topic, Humans, Random Allocation, Research Design, Models, Statistical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review