The DOI matches its Crossref record; 30 of the 33 references it cites were found in a registry or an index.
Risk of selection bias in randomised trials
Open accessAbstract
BACKGROUND: Selection bias occurs when recruiters selectively enrol patients into the trial based on what the next treatment allocation is likely to be. This can occur even if appropriate allocation concealment is used if recruiters can guess the next treatment assignment with some degree of accuracy. This typically occurs in unblinded trials when restricted randomisation is implemented to force the number of patients in each arm or within each centre to be the same. Several methods to reduce the risk of selection bias have been suggested; however, it is unclear how often these techniques are used in practice. METHODS: We performed a review of published trials which were not blinded to assess whether they utilised methods for reducing the risk of selection bias. We assessed the following techniques: (a) blinding of recruiters; (b) use of simple randomisation; (c) avoidance of stratification by site when restricted randomisation is used; (d) avoidance of permuted blocks if stratification by site is used; and (e) incorporation of prognostic covariates into the randomisation procedure when restricted randomisation is used. We included parallel group, individually randomised phase III trials published in four general medical journals (BMJ, Journal of the American Medical Association, The Lancet, and New England Journal of Medicine) in 2010. RESULTS: We identified 152 eligible trials. Most trials (98%) provided no information on whether recruiters were blind to previous treatment allocations. Only 3% of trials used simple randomisation; 63% used some form of restricted randomisation, and 35% did not state the method of randomisation. Overall, 44% of trials were stratified by site of recruitment; 27% were not, and 29% did not report this information. Most trials that did stratify by site of recruitment used permuted blocks (58%), and only 15% reported using random block sizes. Many trials that used restricted randomisation also included prognostic covariates in the randomisation procedure (56%). CONCLUSIONS: The risk of selection bias could not be ascertained for most trials due to poor reporting. Many trials which did provide details on the randomisation procedure were at risk of selection bias due to a poorly chosen randomisation methods. Techniques to reduce the risk of selection bias should be more widely implemented.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“This finding is consistent with findings in individual randomized trials which have also been identified at risk of bias due to implementation of the randomization process [21].”
From Cluster randomized trials of individual-level interventions were at high risk of bias (2021) · cites this paper as [21]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials
Chan, A.-W., Tetzlaff, J. M., Gotzsche, P. C., Altman, D. G., Mann, H., Berlin, J. A., Dickersin, K., Hrobjartsson, A., Schulz, K. F., Parulekar, W. R., et al. (2013) · BMJ · doi:10.1136/bmj.e7586 · Cited by 6,251
Schulz (1995) · doi:10.1001/jama.1995.03520290060030 · Cited by 5,634
Kunz, R., & Oxman, A. D. (1998) · BMJ · doi:10.1136/bmj.317.7167.1185 · Cited by 770
Subverting Randomization in Controlled Trials
Schulz, K. F. (1995) · JAMA · doi:10.1001/jama.1995.03530180050029 · Cited by 518
Kahan, B. C., Jairath, V., Doré, C. J., & Morris, T. P. (2014) · Trials · doi:10.1186/1745-6215-15-139 · Cited by 497
Self-citationRandomisation to protect against selection bias in healthcare trials
Odgaard-Jensen, J., Vist, G. E., Timmer, A., Kunz, R., Akl, E. A., Schünemann, H., Briel, M., Nordmann, A. J., Pregno, S., & Oxman, A. D. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000012.pub3 · Cited by 439
Randomization in Clinical Trials
Rosenberger, W. F., & Lachin, J. M. (2002) · Wiley series in probability and statistics · doi:10.1002/0471722103 · Cited by 369
Improper analysis of trials randomised using stratified blocks or minimisation
Kahan, B. C., & Morris, T. P. (2011) · Statistics in Medicine · doi:10.1002/sim.4431 · Cited by 333
Self-citationProperties of the urn randomization in clinical trials
Wei, L. J., & Lachin, J. M. (1988) · Controlled Clinical Trials · doi:10.1016/0197-2456(88)90048-7 · Cited by 308
Kahan, B. C., & Morris, T. P. (2012) · BMJ · doi:10.1136/bmj.e5840 · Cited by 294
Self-citation
Cited by
Sorted by citations
Items 101–180 of 180
Alkhalaf, Z., Mumford, S. L., Shenassa, E. D., Schisterman, E. F., Silver, R. M., & Thoma, M. E. (2026) · Pregnancy Hypertension · doi:10.1016/j.preghy.2026.101417 · Cited by 2
"Skin and Wound Complications after Calcaneal Fracture Fixation"
Khedr, A. M. (2018) · Orthoplastic Surgery & Orthopedic Care International Journal · doi:10.31031/ooij.2018.02.000528 · Cited by 2
Oakley, J. G. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108649247.009 · Cited by 2
Knowlson, C. N., Brealey, S., Keding, A., Torgerson, D. J., & Rangan, A. (2023) · Bone & Joint Open · doi:10.1302/2633-1462.42.bjo-2022-0139 · Cited by 2
Phelps, T., Gilby, J., Hosking, J., & Gill, J. (2025) · Musculoskeletal Care · doi:10.1002/msc.70141 · Cited by 2
REVIEW OF EXPERIMENTAL DESIGNS AND METHODS IN ECONOMICS OF EDUCATION RESEARCH
Keskin, H. A., & YILMAZ, M. L. (2020) · Finansal Araştırmalar ve Çalışmalar Dergisi · doi:10.14784/marufacd.785236 · Cited by 5
The Choice of a Randomization Procedure in Survival Studies with Nonproportional Hazards
Rückbeil, M. V., Manolov, M., & Hilgers, R.-D. (2021) · Statistics in Biopharmaceutical Research · doi:10.1080/19466315.2021.1952894 · Cited by 2
Ingroup Bias in Healthcare Contexts: Israeli-Jewish Perceptions of Arab and Jewish Doctors
Graham, E., Halabi, S., & Nadler, A. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.771028 · Cited by 2
Sharaf, S. E., Dahlawi, A., Alhajjaji, A., Alqurashi, A., Albarakati, M., Badawi, M., Alhassani, N., Alshareef, O., Bajawi, S., Alsufyani, W., et al. (2024) · International Journal of Clinical Practice · doi:10.1155/2024/3435718 · Cited by 1
Buch, K., van der Wardt, V., Seifart, U., Haasenritter, J., Maulbecker-Armstrong, C. C., Seferi, P., & Becker, A. (2024) · Trials · doi:10.1186/s13063-024-08571-2 · Cited by 1
Huang, Z., & Huang, A. (2025) · Asia Pacific Journal of Tourism Research · doi:10.1080/10941665.2025.2574036 · Cited by 1
Koronarchirurgie – Literaturübersicht 2024
Fleckenstein, P., Caldonazo, T. M. M., Mukharyamov, M., Toshmatov, S., Kyashif, T., Siemeni, T., Doenst, T., & Kirov, H. (2025) · Zeitschrift für Herz- Thorax- und Gefäßchirurgie · doi:10.1007/s00398-025-00738-6 · Cited by 1
Raina, S. (2018) · Neurology India · doi:10.4103/0028-3886.227290 · Cited by 1
Ryeznik, Y. V., Sverdlov, O., & Hooker, A. C. (2018) · The AAPS Journal · doi:10.1208/s12248-018-0242-5 · Cited by 1
Grosser, F., Herrmann, S., Bretschneider, M. P., Timpel, P., Schildt, J., Bentrup, M., & Schwarz, P. E. H. (2022) · Journal of Diabetes Science and Technology · doi:10.1177/19322968221075333 · Cited by 2
Reducing corporate influence on university research in America
Morgan, H. (2022) · Policy Futures in Education · doi:10.1177/14782103221102265 · Cited by 1
Yang, Y., Han, Y., Zou, G., Sui, Y.-B., Jin, J., & Liu, L. (2023) · BMC Cardiovascular Disorders · doi:10.1186/s12872-023-03258-z · Cited by 1
Majlesara, A., Aminizadeh, E., Ramouz, A., Khajeh, E., Shahrbaf, M., Borges, F., Gonçalves, G., Carvalho, C. T., Golriz, M., & Mehrabi, A. (2024) · European Journal of Clinical Investigation · doi:10.1111/eci.14210 · Cited by 1
Ou, S., Liu, L., & Gan, J. L. (2024) · International Journal of Innovation Management · doi:10.1142/s1363919624500245 · Cited by 1
Describing randomization in trials included in systematic reviews in orthopaedic surgery
Tang, M., Lun, K. K., Lewin, A. M., & Harris, I. A. (2024) · Bone & Joint Open · doi:10.1302/2633-1462.512.bjo-2024-0042.r1 · Cited by 1
Validity of the efficacy of the spray flushing cleaning method in flexible endoscope reprocessing
Ziaudeen, S. Z. A., Yeo, C., & Yeo, D. X. W. (2025) · World Journal of Gastroenterology · doi:10.3748/wjg.v31.i11.101743 · Cited by 1
Lechterbeck, L., & Sönnichsen, A. C. (2020) · Zeitschrift für Evidenz Fortbildung und Qualität im Gesundheitswesen · doi:10.1016/j.zefq.2020.03.005 · Cited by 1
Martín, J., Middleton, L., & Hemming, K. (2023) · Clinical Trials · doi:10.1177/17407745221149104 · Cited by 1
Lateral Plantar Nerve Release with or without Calcaneal Drilling for Resistant Plantar Fasciitis
Seewoonarain, S., Quansah, B., & Magan, A. A. (2015) · Journal of orthopaedic surgery · doi:10.1177/230949901502300332 · Cited by 1
Swalwell, G. C. (2018) · Queensland University of Technology · doi:10.5204/thesis.eprints.118729 · Cited by 1
Response to impaired awareness of hypoglycaemia in a study protocol
Almomani, H. Y., Pascual, C., Al-Azzam, S. I., & Ahmadi, K. (2021) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2021.03.001 · Cited by 1
Efficacy of biofortified (yellow) cassava on serum retinol in pre-school Nigerian children
Afolami, I. (2021) · doi:10.18174/551311 · Cited by 1
Systemic Family Work in the Context of Severe Mental Illnesses
Ochs, M., Pfautsch, B., Schweitzer, J., Aderhold, V., Borst, U., & Cubellis, L. (2020) · Wiley eBooks · doi:10.1002/9781119788409.ch12 · Cited by 1
Metastases-Targeting Radiotherapy and ADT
Liu, J., & Kao, Y. (2023) · JAMA Oncology · doi:10.1001/jamaoncol.2023.3628 · Cited by 1
Planning Clinical Trials: The Main Step in Developing New Drugs
Bourin, M. (2017) · SOJ Pharmacy & Pharmaceutical Sciences · doi:10.15226/2374-6866/4/5/00170
Bennett‐Brown, M. (2019) · OpenCommons - UConn (University of Connecticut)
Mylod, D. (2020) · Bournemouth University Research Online (Bournemouth University)
Janíková, A., Michalka, J., Bortlíček, Z., Chloupková, R., Campr, V., Kopálová, N., Klener, P., Benešová, K., Hamouzova, J., Belada, D., et al. (2020) · Annals of Hematology · doi:10.1007/s00277-020-04099-y
Systemic Family Work in the Context of Severe Mental Illnesses
Ochs, M., Pfautsch, B., Schweitzer, J., Aderhold, V., Borst, U., & Cubellis, L. (2020) · Wiley eBooks · doi:10.1002/9781119438519.ch94
Datt, R., Jain, G., Morankar, R., & Digge, V. K. (2020) · Arthroscopy The Journal of Arthroscopic and Related Surgery · doi:10.1016/j.arthro.2020.11.004
Sadana, D., Kaur, S., Sankaramangalam, K. P., Banerjee, K., Siuba, M., Amaral, V., Gadre, S. K., Torbic, H., Krishnan, S., & Duggal, A. (2020) · doi:10.21203/rs.3.rs-99742/v1
Sensitivity analyses in pragmatic randomized clinical trials
Suarez, E. A., & Girman, C. J. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-817663-4.00029-5
Assessment of the Risk of Bias
Moon, K., & Rao, S. C. (2021) · Springer eBooks · doi:10.1007/978-3-030-71921-0_4
Khan, M. H. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3262878
Physical activity and health during the SARS-CoV2 pandemic
Wilke, J. (2022) · Publication Server of Goethe University Frankfurt am Main (Goethe University Frankfurt) · doi:10.21248/gups.71408
Exploring the conduct and reporting of qualitative research in trials using mixed methods
Clement, C. (2023) · Cronfa (Swansea University) · doi:10.23889/suthesis.62588
Uysal, H. Ş., Karafil, A. Y., Dalkıran, O., UYSAL, S. N., & Korkmaz, S. (2023) · Spor Bilimleri Araştırmaları Dergisi · doi:10.25307/jssr.1301934
Taylor, S. J., Sohanpal, R., Steed, L., Heslop-Marshall, K., Kelly, M. J., Underwood, M. R., White, P. T., & Pinnock, H. (2024) · European Respiratory Journal · doi:10.1183/13993003.02149-2023
Alaidaros, A., Motayam, K. E., & Abdelgawad, F. K. I. (2024) · Advanced Dental Journal · doi:10.21608/adjc.2023.215736.1335
Randomized controlled trials: Design, measures, and classic examples
Patel, H. D., & Gupta, G. N. (2024) · Elsevier eBooks · doi:10.1016/b978-0-323-90186-4.00078-x
Poploski, K. M., Smith, C., & Popchak, A. (2025) · Springer eBooks · doi:10.1007/978-3-030-65430-6_116-1 · Cited by 1
Yu, F., Zhang, G., Guo, L., Luo, F., Chen, Y., & Xu, Y. (2025) · Journal of Visualized Experiments · doi:10.3791/68459
Semerci, R., Tuna, A., Kudubeş, A. A., Tayaz, E., İbek, E., Şimşek, E., Gündoğdu, F., Çilengiroğlu, İ. Y., Yılmaz, P., & Selçukbırıcık, F. (2025) · European Journal of Oncology Nursing · doi:10.1016/j.ejon.2025.102969
Dunford, B., Bacani, R. C., Anderson, J. M., Checketts, J. X., Scott, J., Torgerson, T., Hartwell, M. L., & Vassar, M. B. (2022) · Journal of the American Osteopathic Academy of Orthopedics · doi:10.70709/3a3zmf8mdd
Herzklappenchirurgie – Literaturübersicht 2024
Fleckenstein, P., Caldonazo, T. M. M., Kirov, H., Mukharyamov, M., Toshmatov, S., Kyashif, T., Siemeni, T., & Doenst, T. (2025) · Zeitschrift für Herz- Thorax- und Gefäßchirurgie · doi:10.1007/s00398-025-00739-5
Wildlife friendly gardening: Current practices, constraints and effective interventions
Ward, N. D., & Evans, K. L. (2026) · Biological Conservation · doi:10.1016/j.biocon.2026.111983
Problems of meta-analysis to explore rare diseases
Colwill, M., Hall, R., Ezekwe, S., Pollok, R., & Poullis, A. P. (2025) · World Journal of Meta-Analysis · doi:10.13105/wjma.v13.i4.111946
Conroy, E. J., Blazeby, J. M., Burnside, G., Cook, J. A., & Gamble, C. L. (2020) · Figshare · doi:10.6084/m9.figshare.12381152
Conroy, E. J., Blazeby, J. M., Burnside, G., Cook, J. A., & Gamble, C. L. (2020) · Figshare · doi:10.6084/m9.figshare.12381128
Conroy, E. J., Blazeby, J. M., Burnside, G., Cook, J. A., & Gamble, C. L. (2020) · Figshare · doi:10.6084/m9.figshare.12381122
Conroy, E. J., Blazeby, J. M., Burnside, G., Cook, J. A., & Gamble, C. L. (2020) · Figshare · doi:10.6084/m9.figshare.12381116
Conroy, E. J., Blazeby, J. M., Burnside, G., Cook, J. A., & Gamble, C. L. (2020) · Figshare · doi:10.6084/m9.figshare.12381143
Conroy, E. J., Blazeby, J. M., Burnside, G., Cook, J. A., & Gamble, C. L. (2020) · Figshare · doi:10.6084/m9.figshare.12381137
Conroy, E. J., Blazeby, J. M., Burnside, G., Cook, J. A., & Gamble, C. L. (2020) · Figshare · doi:10.6084/m9.figshare.12381146
Conroy, E. J., Blazeby, J. M., Burnside, G., Cook, J. A., & Gamble, C. L. (2020) · Figshare · doi:10.6084/m9.figshare.12381110
Conroy, E. J., Blazeby, J. M., Burnside, G., Cook, J. A., & Gamble, C. L. (2020) · Figshare · doi:10.6084/m9.figshare.12381131
Fernainy, P., Cohen, A. A., Murray, E. J., Losina, E., Lamontagne, F., & Sourial, N. (2024) · Figshare · doi:10.6084/m9.figshare.25017842
Conroy, E. J., Blazeby, J. M., Burnside, G., Cook, J. A., & Gamble, C. L. (2020) · Figshare · doi:10.6084/m9.figshare.12381140
Conroy, E. J., Blazeby, J. M., Burnside, G., Cook, J. A., & Gamble, C. L. (2020) · Figshare · doi:10.6084/m9.figshare.12381119
Yang, Y., Han, Y., Zou, G., Sui, Y., Jin, J., & Liu, L. (2023) · Figshare · doi:10.6084/m9.figshare.22757356
Edwards, M., Forbes, G., Walker, N., Morton, D. G., Mythen, M. G., Murray, D., Anderson, I. D., Mihaylova, B., Thomson, A., Taylor, M., et al. (2023) · Figshare · doi:10.6084/m9.figshare.22775906
Self-citationConroy, E. J., Blazeby, J. M., Burnside, G., Cook, J. A., & Gamble, C. L. (2020) · Figshare · doi:10.6084/m9.figshare.12381125
Edwards, M., Forbes, G., Walker, N., Morton, D. G., Mythen, M. G., Murray, D., Anderson, I. D., Mihaylova, B., Thomson, A., Taylor, M., et al. (2023) · Figshare · doi:10.6084/m9.figshare.22775909
Self-citationNagarajan, K., Muniyandi, M., Jeyachithra, A. V., Muniappan, S., Rajamani, N., D’Souza, P. M., Santhoshkumar, Y., Balasubramanian, A. K., Kothoju, B. C., Rebecca, P., et al. (2026) · Trials · doi:10.1186/s13063-026-09590-x
Hazewinkel, A., Curnow, E., Tilling, K. M., & Hughes, R. A. (2026) · BMC Medical Research Methodology · doi:10.21203/rs.3.rs-9283156/v1
Bruce, C. L., Montgomery, A. A., Ndungu, A. W., Ogollah, R. O., & Partlett, C. (2026) · F1000Research · doi:10.12688/f1000research.177973.1
Wang, B., Wang, X. L., Ni, C., Xie, J., Wu, S., Wu, Y., Shen, Y., Dong, Z., Lv, W., & He, Y. Y. (2026) · BMC Medical Research Methodology · doi:10.1186/s12874-026-02877-2
Hamaya, R., LI, S., Rist, P. M., Shadyab, A. H., Manson, J. E., & Sesso, H. D. (2026) · European Journal of Epidemiology · doi:10.1007/s10654-026-01361-x
Fast weighted linear model trees
Debois, F., Raymaekers, J., Servotte, T., & Verdonck, T. (2026) · Advances in Data Analysis and Classification · doi:10.1007/s11634-026-00683-8
Role of Case Management for Improving Cardiac Rehabilitation Participation in Women
Khadanga, S., Yant, B., Savage, P. D., Gaalema, D. E., & Ades, P. A. (2026) · Journal of Cardiopulmonary Rehabilitation and Prevention · doi:10.1097/hcr.0000000000001040
Federated causal discovery in medicine: trends, opportunities, and challenges
Rocchi, N., Scutari, M., Zanga, A., Nagarajan, R., & Stella, F. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2026.1846020
Yadgarov, M. Y., Бондоевич, Б. Л., & Likhvantsev, V. V. (2026) · Russian Journal of Anesthesiology and Reanimatology · doi:10.17116/anaesthesiology202605181
Metadata
- Authors
- Kahan, B. C., Rehal, S., & Cro, S.
- Affiliations
- Queen Mary University of London (GB)
- MRC Clinical Trials Unit at UCL (GB)
- Corresponding author
- Kahan, Brennan C.
- Venue
- Trials
- Published
- 2015-09-10
- Volume
- 16
- Issue
- 1
- Pages
- 405-405
- ISSN
- 1745-6215 (ISSN-L)
- PMC
- PMC4566301
- OpenAlex
- W1703551835
- Cited by
- 180
- References
- 33
- Citations by year
- 2026: 12 · 2025: 21 · 2024: 21 · 2023: 18 · 2022: 16 · 2021: 19 · 2020: 36 · 2019: 11 · 2018: 10 · 2017: 11 · 2016: 3 · 2015: 1
- FWCI
- 7.42
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Trials (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Queen Mary Research Online (Queen Mary University of London) (submittedVersion, cc-by)
- Spiral (Imperial College London) (submittedVersion, cc-by)
- Funders
- Medical Research Council (MC_UU_12023/29)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Keywords
- selection bias, randomization methods, allocation concealment, prognostic factors, reporting quality
- MeSH terms
- Humans, Selection Bias, Randomized Controlled Trials as Topic, Clinical Trials, Phase III as Topic, Sample Size, Patient Selection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review