The DOI matches its Crossref record; 97 of the 97 references it cites were found in a registry or an index.
Impact of allocation concealment on conclusions drawn from meta-analyses of randomized trials
Abstract
BACKGROUND: Randomized trials without reported adequate allocation concealment have been shown to overestimate the benefit of experimental interventions. We investigated the robustness of conclusions drawn from meta-analyses to exclusion of such trials. MATERIAL: Random sample of 38 reviews from The Cochrane Library 2003, issue 2 and 32 other reviews from PubMed accessed in 2002. Eligible reviews presented a binary effect estimate from a meta-analysis of randomized controlled trials as the first statistically significant result that supported a conclusion in favour of one of the interventions. METHODS: We assessed the methods sections of the trials in each included meta-analysis for adequacy of allocation concealment. We replicated each meta-analysis using the authors' methods but included only trials that had adequate allocation concealment. Conclusions were defined as not supported if our result was not statistically significant. RESULTS: Thirty-four of the 70 meta-analyses contained a mixture of trials with unclear or inadequate concealment as well as trials with adequate allocation concealment. Four meta-analyses only contained trials with adequate concealment, and 32, only trials with unclear or inadequate concealment. When only trials with adequate concealment were included, 48 of 70 conclusions (69%; 95% confidence interval: 56-79%) lost support. The loss of support mainly reflected loss of power (the total number of patients was reduced by 49%) but also a shift in the point estimate towards a less beneficial effect. CONCLUSION: Two-thirds of conclusions in favour of one of the interventions were no longer supported if only trials with adequate allocation concealment were included.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Inadequate allocation concealment can lead to overestimation or underestimation of treatment effects [64], while attrition bias could skew results, thereby affecting our overall judgement of the effectiveness of ACT [65].”
From Acceptance and commitment therapy for patients with chronic pain: A systematic review and meta-analysis on psychological outcomes and quality of life (2024) · cites this paper as [64]
In the citing paper
“RCTs without reported adequate allocation concealment have been shown to overestimate treatment effects (Pildal et al., 2007).”
From Guided internet-based cognitive-behavioral therapy for patients with rheumatic conditions: A systematic review (2021) · cites this paper as Pildal et al., 2007
In the citing paper
“Empirical evidence shows that inadequate reporting of randomization, a core feature of any randomized trial, is associated with biased estimates of the treatment effect of the order of 20% [3].”
From Helping editors, peer reviewers and authors improve the clarity, completeness and transparency of reporting health research. (2008) · cites this paper as [3]
In the citing paper
“trials without reported adequate allocation concealment exaggerate treatment effects on average compared to those with adequate concealment [88].”
From The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration (2009) · cites this paper as [88]
In the citing paper
“The likelihood that the treatment effect reported in a systematic review approximates the truth depends on the validity of the included studies, as certain methodological characteristics may be associated with effect sizes [87],[88].”
From The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration (2009) · cites this paper as [88]
Citations
Cites
5 retracted
Assertive community treatment for people with severe mental disorders
Marshall, M., & Lockwood, A. (1998) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001089 · Cited by 589
RetractedWong, R. K., & Malthaner, R. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002092.pub3 · Cited by 185
RetractedAntibiotics for preventing leptospirosis
Guidugli, F., Castro, A. A., & Atallah, Á. N. (2000) · doi:10.1002/14651858.cd001305 · Cited by 51
RetractedInterventions for chronic suppurative otitis media
Acuin, J., Smith, A. W., & Mackenzie, I. (1998) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000473 · Cited by 43
RetractedRizatriptan for acute migraine
Oldman, A., Smith, L., McQuay, H., & Moore, R. (2000) · doi:10.1002/14651858.cd003221 · Cited by 22
RetractedMeasuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139
Self-citationSchulz (1995) · doi:10.1001/jama.1995.03520290060030 · Cited by 5,634
The Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration
Altman, D. G., Schulz, K. F., Moher, D., Egger, M., Davidoff, F., Elbourne, D., Gøtzsche, P. C., Lang, T., & for the CONSORT Group (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-8-200104170-00012 · Cited by 3,835
Self-citationMoher, D., Pham, B., Jones, A., Cook, D. J., Jadad, A. R., Moher, M., Tugwell, P., & Klassen, T. P. (1998) · The Lancet · doi:10.1016/s0140-6736(98)01085-x · Cited by 3,560
Assessing the quality of controlled clinical trials
Jüni, P., Altman, D. G., & Egger, M. (2001) · BMJ · doi:10.1136/bmj.323.7303.42 · Cited by 3,309
Self-citation
Research works printed but not linked: 2
- 2002, Annals of emergency medicine, 40, 145, 10.1067/mem.2002.124753 · DOI
- Matzen, 2003, Ugeskrift for laeger, 165, 1431
Cited by
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
Self-citationLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gotzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · BMJ · doi:10.1136/bmj.b2700 · Cited by 17,648
Self-citationLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.006 · Cited by 10,578
Self-citationLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00136 · Cited by 10,349
Self-citationMoher, D., Hopewell, S., Schulz, K. F., Montori, V., Gotzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c869 · Cited by 8,883
Self-citation
Metadata
- Authors
- Pildal, J., Hrobjartsson, A., Jorgensen, K., Hilden, J., Altman, D., & Gotzsche, P.
- Affiliations
- Rigshospitalet (DK)
- University of Copenhagen (DK)
- University of Oxford (GB)
- Corresponding author
- Pildal, J
- ORCID
- Venue
- International Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2007-05-21
- Volume
- 36
- Issue
- 4
- Pages
- 847-857
- ISSN
- 0300-5771 (ISSN-L)
- 1464-3685
- OpenAlex
- W2134430160
- Cited by
- 472
- References
- 97
- Citations by year
- 2026: 7 · 2025: 6 · 2024: 11 · 2023: 11 · 2022: 39 · 2021: 27 · 2020: 23 · 2019: 36 · 2018: 28 · 2017: 34 · 2016: 28 · 2015: 29 · 2014: 27 · 2013: 41 · 2012: 34
- FWCI
- 23.96
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- International Journal of Epidemiology (publishedVersion)
- PubMed (publishedVersion)
- Research at the University of Copenhagen (University of Copenhagen) (submittedVersion)
- Funders
- Cancer Research UK
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Keywords
- allocation concealment, randomized controlled trials, methodological quality of trials, overestimation of treatment effects
- MeSH terms
- Data Interpretation, Statistical, Double-Blind Method, Humans, Sensitivity and Specificity, Meta-Analysis as Topic, Bias, Randomized Controlled Trials as Topic, Single-Blind Method, Treatment Outcome
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Impact of allocation concealment on conclusions drawn from meta-analyses of randomized trials. https://app.cochat.ai/papers/10.1093/ije/dym087
- The paper
- Pildal, J., Hrobjartsson, A., Jorgensen, K., Hilden, J., Altman, D., & Gotzsche, P. (2007). Impact of allocation concealment on conclusions drawn from meta-analyses of randomized trials. International Journal of Epidemiology. https://doi.org/10.1093/ije/dym087
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.