Impact of allocation concealment on conclusions drawn from meta-analyses of randomized trials
The DOI matches its Crossref record; 97 of the 97 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Randomized trials without reported adequate allocation concealment have been shown to overestimate the benefit of experimental interventions. We investigated the robustness of conclusions drawn from meta-analyses to exclusion of such trials. MATERIAL: Random sample of 38 reviews from The Cochrane Library 2003, issue 2 and 32 other reviews from PubMed accessed in 2002. Eligible reviews presented a binary effect estimate from a meta-analysis of randomized controlled trials as the first statistically significant result that supported a conclusion in favour of one of the interventions. METHODS: We assessed the methods sections of the trials in each included meta-analysis for adequacy of allocation concealment. We replicated each meta-analysis using the authors' methods but included only trials that had adequate allocation concealment. Conclusions were defined as not supported if our result was not statistically significant. RESULTS: Thirty-four of the 70 meta-analyses contained a mixture of trials with unclear or inadequate concealment as well as trials with adequate allocation concealment. Four meta-analyses only contained trials with adequate concealment, and 32, only trials with unclear or inadequate concealment. When only trials with adequate concealment were included, 48 of 70 conclusions (69%; 95% confidence interval: 56-79%) lost support. The loss of support mainly reflected loss of power (the total number of patients was reduced by 49%) but also a shift in the point estimate towards a less beneficial effect. CONCLUSION: Two-thirds of conclusions in favour of one of the interventions were no longer supported if only trials with adequate allocation concealment were included.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Inadequate allocation concealment can lead to overestimation or underestimation of treatment effects [64], while attrition bias could skew results, thereby affecting our overall judgement of the effectiveness of ACT [65].”
From Acceptance and commitment therapy for patients with chronic pain: A systematic review and meta-analysis on psychological outcomes and quality of life (2024) · cites this paper as [64]
In the citing paper
“RCTs without reported adequate allocation concealment have been shown to overestimate treatment effects (Pildal et al., 2007).”
From Guided internet-based cognitive-behavioral therapy for patients with rheumatic conditions: A systematic review (2021) · cites this paper as Pildal et al., 2007
In the citing paper
“Empirical evidence shows that inadequate reporting of randomization, a core feature of any randomized trial, is associated with biased estimates of the treatment effect of the order of 20% [3].”
From Helping editors, peer reviewers and authors improve the clarity, completeness and transparency of reporting health research. (2008) · cites this paper as [3]
In the citing paper
“trials without reported adequate allocation concealment exaggerate treatment effects on average compared to those with adequate concealment [88].”
From The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration (2009) · cites this paper as [88]
In the citing paper
“The likelihood that the treatment effect reported in a systematic review approximates the truth depends on the validity of the included studies, as certain methodological characteristics may be associated with effect sizes [87],[88].”
From The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration (2009) · cites this paper as [88]
Citations
Cites
5 retracted
Assertive community treatment for people with severe mental disorders
Marshall, M., & Lockwood, A. (1998) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001089 · Cited by 589
RetractedWong, R. K., & Malthaner, R. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002092.pub3 · Cited by 185
RetractedAntibiotics for preventing leptospirosis
Guidugli, F., Castro, A. A., & Atallah, Á. N. (2000) · doi:10.1002/14651858.cd001305 · Cited by 51
RetractedInterventions for chronic suppurative otitis media
Acuin, J., Smith, A. W., & Mackenzie, I. (1998) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000473 · Cited by 43
RetractedRizatriptan for acute migraine
Oldman, A., Smith, L., McQuay, H., & Moore, R. (2000) · doi:10.1002/14651858.cd003221 · Cited by 22
RetractedMeasuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139
Self-citationSchulz (1995) · doi:10.1001/jama.1995.03520290060030 · Cited by 5,634
The Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration
Altman, D. G., Schulz, K. F., Moher, D., Egger, M., Davidoff, F., Elbourne, D., Gøtzsche, P. C., Lang, T., & for the CONSORT Group (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-8-200104170-00012 · Cited by 3,835
Self-citationMoher, D., Pham, B., Jones, A., Cook, D. J., Jadad, A. R., Moher, M., Tugwell, P., & Klassen, T. P. (1998) · The Lancet · doi:10.1016/s0140-6736(98)01085-x · Cited by 3,560
Assessing the quality of controlled clinical trials
Jüni, P., Altman, D. G., & Egger, M. (2001) · BMJ · doi:10.1136/bmj.323.7303.42 · Cited by 3,309
Self-citation
Research works printed but not linked: 2
- 2002, Annals of emergency medicine, 40, 145, 10.1067/mem.2002.124753 · DOI
- Matzen, 2003, Ugeskrift for laeger, 165, 1431
Cited by
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
Self-citationLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gotzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · BMJ · doi:10.1136/bmj.b2700 · Cited by 17,648
Self-citationLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.006 · Cited by 10,578
Self-citationLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00136 · Cited by 10,349
Self-citationMoher, D., Hopewell, S., Schulz, K. F., Montori, V., Gotzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c869 · Cited by 8,883
Self-citation(2008) · Cited by 3,790
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Italian Journal of Public Health · doi:10.2427/5768 · Cited by 3,374
Self-citationMoher, D., Hopewell, S., Schulz, K. F., Montori, V., Gøtzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2012) · International Journal of Surgery · doi:10.1016/j.ijsu.2011.10.001 · Cited by 2,345
Self-citationMoher, D., Hopewell, S., Schulz, K. F., Montori, V., Gøtzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.03.004 · Cited by 1,858
Self-citationIndustry sponsorship and research outcome
Lundh, A., Lexchin, J., Mintzes, B., Schroll, J. B., & Bero, L. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000033.pub3 · Cited by 1,697
Armijo‐Olivo, S., Stiles, C. R., Hagen, N. A., Biondo, P. D., & Cummings, G. G. (2012) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2010.01516.x · Cited by 1,539
A call for transparent reporting to optimize the predictive value of preclinical research
Landis, S. C., Amara, S. G., Asadullah, K., Austin, C. P., Blumenstein, R., Bradley, E. W., Crystal, R. G., Darnell, R. B., Ferrante, R. J., Fillit, H., et al. (2012) · Nature · doi:10.1038/nature11556 · Cited by 1,196
Savović, J., Jones, H. E., Altman, D. G., Harris, R. J., Jüni, P., Pildal, J., Als-Nielsen, B., Balk, E. M., Gluud, C., Gluud, L. L., et al. (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-157-6-201209180-00537 · Cited by 1,049
Self-citationA pragmatic view on pragmatic trials
Patsopoulos, N. A. (2011) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2011.13.2/npatsopoulos · Cited by 844
Opioid antagonists for alcohol dependence
Srisurapanont, M., & Jarusuraisin, N. (2002) · The Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001867 · Cited by 764
PRISMA for Abstracts: Reporting Systematic Reviews in Journal and Conference Abstracts
Beller, E. M., Glasziou, P. P., Altman, D. G., Hopewell, S., Bastian, H., Chalmers, I., Gøtzsche, P. C., Lasserson, T., Tovey, D., & for the PRISMA for Abstracts Group (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001419 · Cited by 706
Self-citationRoot resorption associated with orthodontic tooth movement: A systematic review
Weltman, B., Vig, K. W. L., Fields, H. W., Shanker, S., & Kaizar, E. E. (2010) · American Journal of Orthodontics and Dentofacial Orthopedics · doi:10.1016/j.ajodo.2009.06.021 · Cited by 689
Meta‐Analysis in Medical Research: The Handbook for the Understanding and Practice of Meta‐Analysis
(2005) · Wiley eBooks · doi:10.1002/9780470994894 · Cited by 687
Hopewell, S., Clarke, M., Moher, D., Wager, E., Middleton, P., Altman, D. G., Schulz, K. F., & and the CONSORT Group (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050020 · Cited by 674
Self-citationSavović, J., Jones, H., Altman, D., Harris, R., Jűni, P., Pildal, J., Als-Nielsen, B., Balk, E., Gluud, C., Gluud, L., et al. (2012) · Health Technology Assessment · doi:10.3310/hta16350 · Cited by 668
Self-citationSelenium for preventing cancer
Vinceti, M., Filippini, T., Del Giovane, C., Dennert, G., Zwahlen, M., Brinkman, M., Zeegers, M. P., Horneber, M., D'Amico, R., & Crespi, C. M. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005195.pub4 · Cited by 649
Industry sponsorship and research outcome
Lundh, A., Sismondo, S., Lexchin, J., Busuioc, O. A., & Bero, L. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000033.pub2 · Cited by 605
Small study effects in meta-analyses of osteoarthritis trials: meta-epidemiological study
Nuesch, E., Trelle, S., Reichenbach, S., Rutjes, A. W. S., Tschannen, B., Altman, D. G., Egger, M., & Juni, P. (2010) · BMJ · doi:10.1136/bmj.c3515 · Cited by 559
Self-citationBurr, J., Mowatt, G., Hernández, R., Siddiqui, M., Cook, J., Lourenco, T., Ramsay, C., Vale, L., Fraser, C., Azuara-Blanco, A., et al. (2007) · Health Technology Assessment · doi:10.3310/hta11410 · Cited by 549
Influence of trial sample size on treatment effect estimates: meta-epidemiological study
Dechartres, A., Trinquart, L., Boutron, I., & Ravaud, P. (2013) · BMJ · doi:10.1136/bmj.f2304 · Cited by 544
Hróbjartsson, A., Thomsen, A. S. S., Emanuelsson, F., Tendal, B., Hilden, J., Boutron, I., Ravaud, P., & Brorson, S. (2013) · Canadian Medical Association Journal · doi:10.1503/cmaj.120744 · Cited by 527
“5,6 However, such studies address blinding crudely because “double-blind” is an ambiguous term.”
BackgroundMethodResultInfluentialSelf-citationMale circumcision for prevention of heterosexual acquisition of HIV in men
Siegfried, N., Muller, M., Deeks, J. J., & Volmink, J. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003362.pub2 · Cited by 494
Hrobjartsson, A., Thomsen, A. S. S., Emanuelsson, F., Tendal, B., Hilden, J., Boutron, I., Ravaud, P., & Brorson, S. (2012) · BMJ · doi:10.1136/bmj.e1119 · Cited by 483
Self-citationVerret, M., Lauzier, F., Zarychanski, R., Perron, C., Savard, X., Pinard, A.-M., Leblanc, G., Cossi, M.-J., Neveu, X., Turgeon, A. F., et al. (2020) · Anesthesiology · doi:10.1097/aln.0000000000003428 · Cited by 457
Bhandari, M., Guyatt, G., Walter, S. D., Tornetta, P., Schemitsch, E. H., Swiontkowski, M., & Sanders, D. (2008) · The Journal of Bone and Joint Surgery-American Volume · doi:10.2106/jbjs.g.01694 · Cited by 450
Randomisation to protect against selection bias in healthcare trials
Odgaard-Jensen, J., Vist, G. E., Timmer, A., Kunz, R., Akl, E. A., Schünemann, H., Briel, M., Nordmann, A. J., Pregno, S., & Oxman, A. D. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000012.pub3 · Cited by 439
Galuschka, K., Ise, E., Krick, K., & Schulte-Körne, G. (2014) · PLoS ONE · doi:10.1371/journal.pone.0089900 · Cited by 425
Acamprosate for alcohol dependence
Rösner, S., Hackl-Herrwerth, A., Leucht, S., Lehert, P., Vecchi, S., & Soyka, M. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004332.pub2 · Cited by 412
Healing by primary versus secondary intention after surgical treatment for pilonidal sinus
AL-Khamis, A., McCallum, I., King, P. M., & Bruce, J. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006213.pub3 · Cited by 386
Savović, J., Turner, R. M., Mawdsley, D., Jones, H. E., Beynon, R., Higgins, J. P. T., & Sterne, J. A. C. (2018) · American Journal of Epidemiology · doi:10.1093/aje/kwx344 · Cited by 382
Bower, P., Kontopantelis, E., Sutton, A., Kendrick, T., Richards, D. A., Gilbody, S., Knowles, S., Cuijpers, P., Andersson, G., Christensen, H., et al. (2013) · BMJ · doi:10.1136/bmj.f540 · Cited by 341
Van Strydonck, D. A. C., Slot, D. E., Van der Velden, U., & Van der Weijden, F. (2012) · Journal of Clinical Periodontology · doi:10.1111/j.1600-051x.2012.01883.x · Cited by 353
Recommendations by Cochrane Review Groups for assessment of the risk of bias in studies
Lundh, A., & Gøtzsche, P. C. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-22 · Cited by 352
Ten Heggeler, J. M. A. G., Slot, D. E., & Van der Weijden, G. A. (2011) · Clinical Oral Implants Research · doi:10.1111/j.1600-0501.2010.02064.x · Cited by 342
Savović, J., Weeks, L., Sterne, J. A., Turner, L., Altman, D. G., Moher, D., & Higgins, J. P. (2014) · Systematic Reviews · doi:10.1186/2046-4053-3-37 · Cited by 340
Self-citationA Meta-Analytic Review of Stand-Alone Interventions to Improve Body Image
Alleva, J. M., Sheeran, P., Webb, T. L., Martijn, C., & Miles, E. (2015) · PLOS ONE · doi:10.1371/journal.pone.0139177 · Cited by 319
Dechartres, A., Boutron, I., Trinquart, L., Charles, P., & Ravaud, P. (2011) · Annals of Internal Medicine · doi:10.7326/0003-4819-155-1-201107050-00006 · Cited by 307
Panagioti, M., Richardson, G., Small, N., Murray, E., Rogers, A., Kennedy, A., Newman, S., & Bower, P. (2014) · BMC Health Services Research · doi:10.1186/1472-6963-14-356 · Cited by 301
Systematic meta-review of supported self-management for asthma: a healthcare perspective
groups, F. T. P. A. R., Pinnock, H., Parke, H. L., Panagioti, M., Daines, L., Pearce, G., Epiphaniou, E., Bower, P., Sheikh, A., Griffiths, C. J., et al. (2017) · BMC Medicine · doi:10.1186/s12916-017-0823-7 · Cited by 291
Page, M. J., Higgins, J. P. T., Clayton, G., Sterne, J. A. C., Hróbjartsson, A., & Savović, J. (2016) · PLOS ONE · doi:10.1371/journal.pone.0159267 · Cited by 284
Self-citationLacroix, A., Hortobágyi, T., Beurskens, R., & Granacher, U. (2017) · Sports Medicine · doi:10.1007/s40279-017-0747-6 · Cited by 279
Nuesch, E., Trelle, S., Reichenbach, S., Rutjes, A. W. S., Burgi, E., Scherer, M., Altman, D. G., & Juni, P. (2009) · BMJ · doi:10.1136/bmj.b3244 · Cited by 248
Self-citationMindfulness and acceptance approaches to sporting performance enhancement: a systematic review.
Noetel, M., Ciarrochi, J., Van Zanden, B., & Lonsdale, C. (2019) · International Review of Sport and Exercise Psychology · doi:10.1080/1750984x.2017.1387803 · Cited by 282
Association Between Analytic Strategy and Estimates of Treatment Outcomes in Meta-analyses
Dechartres, A., Altman, D. G., Trinquart, L., Boutron, I., & Ravaud, P. (2014) · JAMA · doi:10.1001/jama.2014.8166 · Cited by 233
Self-citationGagnier, J. J., Moher, D., Boon, H., Beyene, J., & Bombardier, C. (2012) · BMC Medical Research Methodology · doi:10.1186/1471-2288-12-111 · Cited by 222
CONSORT 2025 explanation and elaboration: updated guideline for reporting randomised trials
Hopewell, S., Chan, A.-W., Collins, G. S., Hróbjartsson, A., Moher, D., Schulz, K. F., Tunn, R., Aggarwal, R., Berkwits, M., Berlin, J. A., et al. (2025) · BMJ · doi:10.1136/bmj-2024-081124 · Cited by 205
A Randomized Trial of Endometrial Scratching before In Vitro Fertilization
Lensen, S., Osavlyuk, D., Armstrong, S., Stadelmann, C., Hennes, A., Napier, E., Wilkinson, J., Sadler, L., Gupta, D., Strandell, A., et al. (2019) · New England Journal of Medicine · doi:10.1056/nejmoa1808737 · Cited by 198
Forbes, D., Blake, C. M., Thiessen, E. J., Peacock, S., & Hawranik, P. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003946.pub4 · Cited by 194
Dechartres, A., Trinquart, L., Atal, I., Moher, D., Dickersin, K., Boutron, I., Perrodeau, E., Altman, D. G., & Ravaud, P. (2017) · BMJ · doi:10.1136/bmj.j2490 · Cited by 171
Self-citationMoreno, S. G., Sutton, A. J., Turner, E. H., Abrams, K. R., Cooper, N. J., Palmer, T. M., & Ades, A. E. (2009) · BMJ · doi:10.1136/bmj.b2981 · Cited by 184
The efficacy of manual toothbrushes following a brushing exercise: a systematic review
Slot, D., Wiggelinkhuizen, L., Rosema, N., & Van der Weijden, G. (2012) · International Journal of Dental Hygiene · doi:10.1111/j.1601-5037.2012.00557.x · Cited by 182
Knopp, J., Knowles, S., Bee, P., Lovell, K., & Bower, P. (2013) · Clinical Psychology Review · doi:10.1016/j.cpr.2013.08.008 · Cited by 164
Moher, D., Simera, I., Schulz, K. F., Hoey, J., & Altman, D. G. (2008) · BMC Medicine · doi:10.1186/1741-7015-6-13 · Cited by 153
Self-citationCásedas, L., Pirruccio, V., Vadillo, M. A., & Lupiáñez, J. (2020) · Mindfulness · doi:10.1007/s12671-019-01279-4 · Cited by 145
Bafeta, A., Dechartres, A., Trinquart, L., Yavchitz, A., Boutron, I., & Ravaud, P. (2012) · BMJ · doi:10.1136/bmj.e813 · Cited by 129
Armijo-Olivo, S., Ospina, M., da Costa, B. R., Egger, M., Saltaji, H., Fuentes, J., Ha, C., & Cummings, G. G. (2014) · PLoS ONE · doi:10.1371/journal.pone.0096920 · Cited by 124
Interventions for compassionate nursing care: A systematic review
Blomberg, K., Griffiths, P., Wengström, Y., May, C., & Bridges, J. (2016) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2016.07.009 · Cited by 111
Panagioti, M., Bower, P., Kontopantelis, E., Lovell, K., Gilbody, S., Waheed, W., Dickens, C., Archer, J., Simon, G., Ell, K., et al. (2016) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2016.1794 · Cited by 94
Yakobi, O., Smilek, D., & Danckert, J. (2021) · Cognitive Therapy and Research · doi:10.1007/s10608-020-10177-2 · Cited by 85
Empirical evaluation of which trial characteristics are associated with treatment effect estimates
Dechartres, A., Trinquart, L., Faber, T., & Ravaud, P. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.04.005 · Cited by 85
School-Based Mentoring for Adolescents: A Systematic Review and Meta-Analysis
Wood, S., & Mayo-Wilson, E. (2012) · Research on Social Work Practice · doi:10.1177/1049731511430836 · Cited by 83
Scott, J. L., Dawkins, S., Quinn, M. G., Sanderson, K., Elliott, K.-E. J., Stirling, C., Schüz, B., & Robinson, A. (2016) · Aging & Mental Health · doi:10.1080/13607863.2015.1040724 · Cited by 77
Chen, C., Liu, J., Sun, M., Liu, W., Han, J., & Wang, H. (2019) · Complementary Therapies in Clinical Practice · doi:10.1016/j.ctcp.2019.04.004 · Cited by 72
Chen, T., Li, C., Qin, R., Wang, Y., Yu, D., Dodd, J., Wang, D., & Cornelius, V. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.7242 · Cited by 68
Hopewell, S., Boutron, I., Altman, D. G., & Ravaud, P. (2013) · BMJ Open · doi:10.1136/bmjopen-2013-003342 · Cited by 66
Self-citationA systematic review and meta-analysis of tai chi for treating type 2 diabetes
Lee, M. S., Jun, J. H., Lim, H.-J., & Lim, H.-S. (2015) · Maturitas · doi:10.1016/j.maturitas.2014.09.008 · Cited by 63
Armijo-Olivo, S., Fuentes, J., Ospina, M., Saltaji, H., & Hartling, L. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-116 · Cited by 60
Janackovic, K., & Puljak, L. (2018) · Trials · doi:10.1186/s13063-018-2976-x · Cited by 56
Wood, L., Byrne, R., Enache, G., & Morrison, A. P. (2018) · Psychiatry Research · doi:10.1016/j.psychres.2017.12.030 · Cited by 41
Saltaji, H., Armijo-Olivo, S., Cummings, G. G., Amin, M., da Costa, B. R., & Flores-Mir, C. (2018) · Journal of Dental Research · doi:10.1177/0022034517725049 · Cited by 40
Ye, L., Li, Y., Deng, Q., Zhao, X., Zhong, L., & Yang, L. (2024) · PLoS ONE · doi:10.1371/journal.pone.0301226 · Cited by 43
The impact of blinding on trial results: A systematic review and meta‐analysis
(2023) · doi:10.1002/cesm.12015 · Cited by 35
Comparing machine and human reviewers to evaluate the risk of bias in randomized controlled trials
Armijo‐Olivo, S., Craig, R., & Campbell, S. (2020) · Research Synthesis Methods · doi:10.1002/jrsm.1398 · Cited by 31
Corso, M., Cancelliere, C., Mior, S., Salmi, L. R., Cedraschi, C., Nordin, M., Sci, D. M., Taylor-Vaisey, A., & Côté, P. (2022) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2021.09.007 · Cited by 24
Failure to Respond after Reinstatement of Antidepressant Medication: A Systematic Review
Bosman, R. C., Waumans, R. C., Jacobs, G. E., Oude Voshaar, R. C., Muntingh, A. D. T., Batelaan, N. M., & van Balkom, A. J. L. M. (2018) · Psychotherapy and Psychosomatics · doi:10.1159/000491550 · Cited by 21
Speyer, H., Nørgaard, H. C. B., Hjorthøj, C., Madsen, T. A., Drivsholm, S., Pisinger, C., Gluud, C., Mors, O., Krogh, J., & Nordentoft, M. (2015) · BMC Psychiatry · doi:10.1186/s12888-015-0465-2 · Cited by 20
Terpstra, J. A., van der Vaart, R., Ding, H. J., Kloppenburg, M., & Evers, A. W. M. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100444 · Cited by 19
“RCTs without reported adequate allocation concealment have been shown to overestimate treatment effects (Pildal et al., 2007).”
BackgroundTsujimoto, Y., Fujii, T., Onishi, A., Omae, K., Luo, Y., Imai, H., Takahashi, S., Itaya, T., Pinson, C., Nevitt, S. J., et al. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.10.004 · Cited by 17
Optimizing Expectations via Mobile Apps: A New Approach for Examining and Enhancing Placebo Effects
Gruszka, P., Burger, C., & Jensen, M. P. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00365 · Cited by 15
“As it has been shown that trials with inadequate or unclear allocation concealment exaggerate subjective outcome effects (8, 60), the use of apps could potentially increase the reliability of effect size estimates.”
Background
Metadata
- Authors
- Pildal, J., Hrobjartsson, A., Jorgensen, K., Hilden, J., Altman, D., & Gotzsche, P.
- Affiliations
- Rigshospitalet (DK)
- University of Copenhagen (DK)
- University of Oxford (GB)
- Corresponding author
- Pildal, J
- ORCID
- Venue
- International Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2007-05-21
- Volume
- 36
- Issue
- 4
- Pages
- 847-857
- ISSN
- 0300-5771 (ISSN-L)
- 1464-3685
- OpenAlex
- W2134430160
- Cited by
- 472
- References
- 97
- Citations by year
- 2026: 7 · 2025: 6 · 2024: 11 · 2023: 11 · 2022: 39 · 2021: 27 · 2020: 23 · 2019: 36 · 2018: 28 · 2017: 34 · 2016: 28 · 2015: 29 · 2014: 27 · 2013: 41 · 2012: 34
- FWCI
- 23.96
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- International Journal of Epidemiology (publishedVersion)
- PubMed (publishedVersion)
- Research at the University of Copenhagen (University of Copenhagen) (submittedVersion)
- Funders
- Cancer Research UK
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Keywords
- allocation concealment, randomized controlled trials, methodological quality of trials, overestimation of treatment effects
- MeSH terms
- Data Interpretation, Statistical, Double-Blind Method, Humans, Sensitivity and Specificity, Meta-Analysis as Topic, Bias, Randomized Controlled Trials as Topic, Single-Blind Method, Treatment Outcome
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.