What is the influence of randomisation sequence generation and allocation concealment on treatment effects of physical therapy trials? A meta-epidemiological study
Open accessThe DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
Objective: To determine if adequacy of randomisation and allocation concealment is associated with changes in effect sizes (ES) when comparing physical therapy (PT) trials with and without these methodological characteristics. Design: Meta-epidemiological study. Participants: A random sample of randomised controlled trials (RCTs) included in meta-analyses in the PT discipline were identified. Intervention: Data extraction including assessments of random sequence generation and allocation concealment was conducted independently by two reviewers. To determine the association between sequence generation, and allocation concealment and ES, a two-level analysis was conducted using a meta-meta-analytic approach. Primary and secondary outcome measures: association between random sequence generation and allocation concealment and ES in PT trials. Results: 393 trials included in 43 meta-analyses, analysing 44 622 patients contributed to this study. Adequate random sequence generation and appropriate allocation concealment were accomplished in only 39.7% and 11.5% of PT trials, respectively. Although trials with inappropriate allocation concealment tended to have an overestimate treatment effect when compared with trials with adequate concealment of allocation, the difference was non-statistically significant (ES=0.12; 95% CI −0.06 to 0.30). When pooling our results with those of Nuesch et al , we obtained a pooled statistically significant value (ES=0.14; 95% CI 0.02 to 0.26). There was no difference in ES in trials with appropriate or inappropriate random sequence generation (ES=0.02; 95% CI −0.12 to 0.15). Conclusions: Our results suggest that when evaluating risk of bias of primary RCTs in PT area, systematic reviewers and clinicians implementing research into practice should pay attention to these biases since they could exaggerate treatment effects. Systematic reviewers should perform sensitivity analysis including trials with low risk of bias in these domains as primary analysis and/or in combination with less restrictive analyses. Authors and editors should make sure that allocation concealment and random sequence generation are properly reported in trial reports.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Moher, D., Pham, B., Jones, A., Cook, D. J., Jadad, A. R., Moher, M., Tugwell, P., & Klassen, T. P. (1998) · The Lancet · doi:10.1016/s0140-6736(98)01085-x · Cited by 3,560
Pulmonary rehabilitation for chronic obstructive pulmonary disease
McCarthy, B., Casey, D., Devane, D., Murphy, K., Murphy, E., & Lacasse, Y. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003793.pub3 · Cited by 2,643
Wood, L., Egger, M., Gluud, L. L., Schulz, K. F., Jüni, P., Altman, D. G., Gluud, C., Martin, R. M., Wood, A. J. G., & Sterne, J. A. C. (2008) · BMJ · doi:10.1136/bmj.39465.451748.ad · Cited by 2,538 · cited 3×
“Over-estimates or underestimates of treatment effects can lead to biased or inaccurate results and conclusions in systematic reviews and meta-analyses.(3) 12–15 These factors can ultimately have repercussions on decision-making and quality of patient care since different assessments could”
BackgroundMethodInfluentialCooney, G. M., Dwan, K., Greig, C. A., Lawlor, D. A., Rimer, J., Waugh, F. R., McMurdo, M., & Mead, G. E. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004366.pub6 · Cited by 1,834
Egger, M., Jüni, P., Bartlett, C., Holenstein, F., & Sterne, J. (2003) · Health Technology Assessment · doi:10.3310/hta7010 · Cited by 1,181
Exercise for the management of cancer-related fatigue in adults
Cramp, F., & Byron-Daniel, J. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006145.pub3 · Cited by 1,096
Savović, J., Jones, H. E., Altman, D. G., Harris, R. J., Jüni, P., Pildal, J., Als-Nielsen, B., Balk, E. M., Gluud, C., Gluud, L. L., et al. (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-157-6-201209180-00537 · Cited by 1,049
Exercise for overweight or obesity
Shaw, K. A., Gennat, H. C., O'Rourke, P., & Del Mar, C. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003817.pub3 · Cited by 950
Pulmonary rehabilitation for chronic obstructive pulmonary disease
Lacasse, Y., Goldstein, R., Lasserson, T. J., & Martin, S. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003793.pub2 · Cited by 821
Home-based versus centre-based cardiac rehabilitation
Taylor, R. S., Dalal, H., Jolly, K., Moxham, T., & Zawada, A. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007130.pub2 · Cited by 623
Self-management education for patients with chronic obstructive pulmonary disease
Effing, T., Monninkhof, E. E., van der Valk, P. P. D. L. P. M., Zielhuis, G. G., Walters, E. H., van der Palen, J. J., & Zwerink, M. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002990.pub2 · Cited by 536
Balk, E. M. (2002) · JAMA · doi:10.1001/jama.287.22.2973 · Cited by 478 · cited 1×
“and treatment effects varies according to each health area(64) 65 and more work should be carried out in other health areas to confirm these results.(64) 65 Our stratified analysis for sequence generation and allocation concealment showed that none of the meta-analysis characteristics presented with significant intera…”
BackgroundExercise for osteoarthritis of the hip
Fransen, M., McConnell, S., Hernandez-Molina, G., & Reichenbach, S. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007912.pub2 · Cited by 476
Impact of allocation concealment on conclusions drawn from meta-analyses of randomized trials
Pildal, J., Hrobjartsson, A., Jorgensen, K., Hilden, J., Altman, D., & Gotzsche, P. (2007) · International Journal of Epidemiology · doi:10.1093/ije/dym087 · Cited by 472
Mead, G. E., Morley, W., Campbell, P., Greig, C. A., McMurdo, M., & Lawlor, D. A. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004366.pub4 · Cited by 448
The Concepts of Power Analysis
Cohen, J. (1977) · Statistical Power Analysis for the Behavioral Sciences · doi:10.1016/b978-0-12-179060-8.50006-2 · Cited by 299
Nuesch, E., Trelle, S., Reichenbach, S., Rutjes, A. W. S., Burgi, E., Scherer, M., Altman, D. G., & Juni, P. (2009) · BMJ · doi:10.1136/bmj.b3244 · Cited by 248
Effectiveness of Aquatic Exercise for Musculoskeletal Conditions: A Meta-Analysis
Barker, A. L., Talevski, J., Morello, R. T., Brand, C. A., Rahmann, A. E., & Urquhart, D. M. (2014) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2014.04.005 · Cited by 173
Assessing the impact of attrition in randomized controlled trials
Hewitt, C. E., Kumaravel, B., Dumville, J. C., & Torgerson, D. J. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.01.010 · Cited by 139
Treadmill training for patients with Parkinson's disease
Mehrholz, J., Friis, R., Kugler, J., Twork, S., Storch, A., & Pohl, M. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007830.pub2 · Cited by 106
Verhagen, A. P., de Vet, H. C. W., Willemsen, S., & Stijnen, T. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.10.006 · Cited by 14
Cited by
Minozzi, S., Cinquini, M., Gianola, S., Gonzalez-Lorenzo, M., & Banzi, R. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.06.015 · Cited by 471
Sideri, S., Papageorgiou, S. N., & Eliades, T. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.01.003 · Cited by 388
Page, M. J., Higgins, J. P. T., Clayton, G., Sterne, J. A. C., Hróbjartsson, A., & Savović, J. (2016) · PLOS ONE · doi:10.1371/journal.pone.0159267 · Cited by 284
CONSORT 2025 explanation and elaboration: updated guideline for reporting randomised trials
Hopewell, S., Chan, A.-W., Collins, G. S., Hróbjartsson, A., Moher, D., Schulz, K. F., Tunn, R., Aggarwal, R., Berkwits, M., Berlin, J. A., et al. (2025) · BMJ · doi:10.1136/bmj-2024-081124 · Cited by 205
Minozzi, S., Dwan, K., Borrelli, F., & Filippini, G. (2022) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.09.021 · Cited by 150
Metadata
- Authors
- Armijo-Olivo, S., Saltaji, H., da Costa, B. R., Fuentes, J., Ha, C., & Cummings, G. G.
- Venue
- BMJ Open
- Publisher
- BMJ
- Published
- 2015-09
- Volume
- 5
- Issue
- 9
- Pages
- e008562
- ISSN
- 2044-6055 (ISSN-L)
- OpenAlex
- W2287844929
- Cited by
- 84
- References
- 21
- FWCI
- 4.78
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.